What it does
This open book collects one engineer's hard-won notes on training large language models and other big AI models. Much of it comes from work on large open models such as BLOOM.
It covers choosing a cloud provider, graphics-card hardware, storage, networking, managing large computing clusters, training, running models, debugging and testing. It's full of scripts and copy-and-paste commands for solving real problems.
The book is free to read online or download as a PDF or e-book. The author also provides skill files that teach AI agents the same know-how.
Who it's for
Engineers and operators who train or run large AI models on GPU clusters.
Can I use it without coding?
Developers only. Free to read, but the material is highly technical. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Computer
- An ordinary computer is fine
- API key
- Not needed
Try it
- Read the book online, starting from its table of contents.
- Or download the free PDF or EPUB version of the book.
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (CC-BY-SA-4.0): Read the license on the GitHub page before using it for business.
- More on staying safe
Where people are talking about it
- ML Engineering Online BookHacker News · Jan 2024