Differential Transformer Notes
I pulled together notes on the Differential Transformer and its take on attention.
Articles
Notes from building with data
Concise write-ups on systems, evaluations, and tooling — published while the lessons are still sharp.
Latest entries
Browse by topic or stack to jump to the threads you care about most.
OpenELM Notes
I wrote about OpenELM and how Apple approaches efficient language models.
No articles matched your filters. Try a different keyword or tag.
Writing principles
- Capture experiments quickly, then refine iteratively with feedback from peers and production metrics.
- Keep explanations tool-agnostic first, highlighting vendor specifics only when they change the trade-offs.
- Document failure modes alongside wins so readers can reuse the guardrails, not just the playbooks.