It’s very corporate, isn’t it? “Just keep scaling what we have.”

That being said, a lot of innovation is happening, but goes unused. It’s incredible how my promising papers come out, and get completely passed over by Big Tech AI, like nothing matters unless it’s developed in house.

The Chinese firms are picking up some research in bigger models, at least, but are kinda falling into local maxima too.