10 Comments

Great deep dive and very helpful. Thanks for writing this!

Expand full comment

Thank you so much, and of course!

Expand full comment

Amazing article, a true gem. I would be interested to learn more about how DeepSeek used reinforcement learning to such great effect.

Expand full comment

Working on that article now!

Expand full comment

Great in-depth article on MoE LLMs.

Expand full comment

Thank you very much!

Expand full comment

I agree with Dr. Bamania- this was very rewarding reading.

Expand full comment

Thank you! I'm glad you found it helpful!

Expand full comment

Great article. I couldn't finish it in one go though. I have book marked it and will come back to it later.

Expand full comment

Do you expect this leapfrogging to persist for a while longer? The collective response to this tug of war seems overwhelmingly simplified and “gotcha!” meme-based. Public discourse overall appears to lean into a predictable lack of reservation for exponential leaps between companies, unknowns, and established methods.

Expand full comment