Archive - Deep (Learning) Focus

AI Agents from First Principles

Understanding AI agents by building upon the most basic concepts of LLMs...

Jun 9 •

Cameron R. Wolfe, Ph.D.

May 2025

A Guide for Debugging LLM Training Data

Data-centric techniques and tools that anyone should use when training an LLM...

May 19 •

Cameron R. Wolfe, Ph.D.

April 2025

Llama 4: The Challenges of Creating a Frontier-Level LLM

The full story behind Llama 4 and Meta's huge pivot in research strategy...

Apr 28 •

Cameron R. Wolfe, Ph.D.

March 2025

Vision Large Language Models (vLLMs)

Teaching LLMs to understand images and videos in addition to text...

Mar 31 •

Cameron R. Wolfe, Ph.D.

nanoMoE: Mixture-of-Experts (MoE) LLMs from Scratch in PyTorch

An introductory, simple, and functional implementation of MoE LLM pretraining...

Mar 10 •

Cameron R. Wolfe, Ph.D.

February 2025

Demystifying Reasoning Models

Understanding reasoning models and their relation to standard LLMs...

Feb 18 •

Cameron R. Wolfe, Ph.D.

January 2025

Mixture-of-Experts (MoE) LLMs

Understanding models like DeepSeek, Grok, and Mixtral from the ground up...

Jan 27 •

Cameron R. Wolfe, Ph.D.

Scaling Laws for LLMs: From GPT-3 to o3

Understanding the current state of LLM scaling and the future of AI research...

Jan 6 •

Cameron R. Wolfe, Ph.D.

December 2024

Finetuning LLM Judges for Evaluation

The Prometheus suite, JudgeLM, PandaLM, AutoJ, and more...

Dec 2, 2024 •

Cameron R. Wolfe, Ph.D.

November 2024

Automatic Prompt Optimization

Practical techniques for improving prompt quality without manual effort...

Nov 4, 2024 •

Cameron R. Wolfe, Ph.D.

September 2024

Model Merging: A Survey

From modern LLM applications to the early days of machine learning research...

Sep 16, 2024 •

Cameron R. Wolfe, Ph.D.

July 2024

Using LLMs for Evaluation

LLM-as-a-Judge and other scalable additions to human quality ratings...

Jul 22, 2024 •

Cameron R. Wolfe, Ph.D.

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts