Brilliant exposition, Cameron! My untutored thought is that we have pushed scaling as far as we need to. Future improvements will hardly reward the effort. However, I don't feel we have hit a "wall". Physics has come to these grinding halts before and always a new paradigm emerges and we trudge forward again. So I'm hopeful. I do dislike that research is becoming secret. Driven by commercial and nationalistic rivalries this does no one any good. We'll come to regret it.
Perfect article, thank you so much for your writing and amazing insights!
Thank you very much for the kind words!
Hi Cameron,
Thanks for the awesome article
You might be interested in this https://arxiv.org/abs/2501.04682 article for the o1/o3 section
Thank you for sharing!
Excellent, thank you!!
Thanks for reading!
Brilliant exposition, Cameron! My untutored thought is that we have pushed scaling as far as we need to. Future improvements will hardly reward the effort. However, I don't feel we have hit a "wall". Physics has come to these grinding halts before and always a new paradigm emerges and we trudge forward again. So I'm hopeful. I do dislike that research is becoming secret. Driven by commercial and nationalistic rivalries this does no one any good. We'll come to regret it.
Thank you! And, I totally agree!