Musk used about 120x more GPUs than DeepSeek yet their Grok is only marginally better than R1..... wtf?!?
Seems like raw brute forcing hit a hard wall of diminishing returns
Probably also why we hadnt had a new GPT version since 2023. And Claude 3.5 OPUS is still nowhere to be found
The real commodity is Chinese engineering talent not the number of GPUs. Even xAI relies heavily on Chinese talent. Too bad the west isn't fighting hard for it.