Deep (Learning) Focus
Subscribe
Sign in
Home
Notes
The Author
Archive
Latest
Top
Discussions
DBRX, Continual Pretraining, RewardBench, Faster Inference, and More
A deep dive into recent and impactful advancements in LLM research...
Apr 1
•
Cameron R. Wolfe, Ph.D.
31
Share this post
DBRX, Continual Pretraining, RewardBench, Faster Inference, and More
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
6
March 2024
Mixture-of-Experts (MoE): The Birth and Rise of Conditional Computation
What two decades of research taught us about sparse language models...
Mar 18
•
Cameron R. Wolfe, Ph.D.
49
Share this post
Mixture-of-Experts (MoE): The Birth and Rise of Conditional Computation
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
16
Decoder-Only Transformers: The Workhorse of Generative LLMs
Building the world's most influential neural network architecture from scratch...
Mar 4
•
Cameron R. Wolfe, Ph.D.
53
Share this post
Decoder-Only Transformers: The Workhorse of Generative LLMs
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
13
February 2024
Dolma, OLMo, and the Future of Open-Source LLMs
How making open-source LLMs truly open will change AI research for the better...
Feb 20
•
Cameron R. Wolfe, Ph.D.
27
Share this post
Dolma, OLMo, and the Future of Open-Source LLMs
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
2
A Practitioners Guide to Retrieval Augmented Generation (RAG)
How basic techniques can be used to build powerful applications with LLMs...
Feb 5
•
Cameron R. Wolfe, Ph.D.
55
Share this post
A Practitioners Guide to Retrieval Augmented Generation (RAG)
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
2
January 2024
Sleeper Agents, LLM Safety, Finetuning vs. RAG, Synthetic Data, and More
Notable advancements and topics in LLM research from January of 2024...
Jan 22
•
Cameron R. Wolfe, Ph.D.
38
Share this post
Sleeper Agents, LLM Safety, Finetuning vs. RAG, Synthetic Data, and More
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
9
The Basics of AI-Powered (Vector) Search
How the modern AI boom has completely revolutionized search applications...
Jan 8
•
Cameron R. Wolfe, Ph.D.
50
Share this post
The Basics of AI-Powered (Vector) Search
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
December 2023
Google Gemini: Fact or Fiction?
Breaking down the capabilities of Google's highly anticipated OpenAI competitor...
Dec 21, 2023
•
Cameron R. Wolfe, Ph.D.
88
Share this post
Google Gemini: Fact or Fiction?
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
2
Explaining ChatGPT to Anyone in <20 Minutes
Distilling the core components of generative LLMs into an accessible framework...
Dec 11, 2023
•
Cameron R. Wolfe, Ph.D.
47
Share this post
Explaining ChatGPT to Anyone in <20 Minutes
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
9
November 2023
Easily Train a Specialized LLM: PEFT, LoRA, QLoRA, LLaMA-Adapter, and More
Training a specialized LLM over your own data is easier than you think...
Nov 27, 2023
77
Share this post
Easily Train a Specialized LLM: PEFT, LoRA, QLoRA, LLaMA-Adapter, and More
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
11
The Story of RLHF: Origins, Motivations, Techniques, and Modern Applications
How learning from human feedback revolutionized generative language models...
Nov 13, 2023
•
Cameron R. Wolfe, Ph.D.
34
Share this post
The Story of RLHF: Origins, Motivations, Techniques, and Modern Applications
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
5
October 2023
Self-Critique, Self-RAG, NEFTune, Safe RLHF and More
Notable advances in LLM research prior to the week of October 30th, 2023...
Oct 30, 2023
•
Cameron R. Wolfe, Ph.D.
21
Share this post
Self-Critique, Self-RAG, NEFTune, Safe RLHF and More
cameronrwolfe.substack.com
Copy link
Facebook
Email
Note
Other
Share
Copy link
Facebook
Email
Note
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
