Plain-AyI
← All projects
Learning resources

tiny-llm

A hands-on course that teaches engineers how AI language models generate text, built step by step on a Mac.

What it does

tiny-llm is a four-week course for systems engineers who want to understand how a large language model (LLM, the kind of AI behind chatbots) actually produces text. You build the code that loads the Qwen3 model and makes it write answers, starting from basic math on arrays of numbers.

Later weeks make a single request faster, then build a small version of a model-serving system (software that answers many users at once), similar to the vLLM project. The final week builds a simple coding agent that can look at files, make approved edits and run a check.

The course uses Apple's MLX toolkit and runs on Apple Silicon Macs, so learners don't need an expensive graphics card. The lessons are published as an online book, and a reference solution is included for the tests.

Who it's for

Programmers and systems engineers who want to learn, by writing code, how AI models are run and served.

Can I use it without coding?

Developers only. It is a programming course where you write Python, C++ or Metal code to complete exercises. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Mac
Computer
Works best on a powerful computer or one with a graphics card (GPU)
Privacy
Runs on your own device: your data stays with you
API key
Not needed

Try it

  1. Open the course book on the project's website and read the environment setup chapter.
  2. Set up the project on an Apple Silicon Mac and run the installation check.
  3. Work through the Week 1 chapters, starting with attention.

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • Plain-AyI is an independent guide and doesn't host or review the software it lists. Please check each project's official page before installing.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it