What it does
LitGPT gives programmers ready-made versions of many open language models, such as Llama, Phi, Gemma and Qwen. Each model is written from scratch in plain code, which its makers say makes it easier to understand and debug.
It includes recipes for the main jobs: using a model to answer prompts, fine-tuning it (adapting it to your own data), pretraining a new one and deploying it so other programs can use it. Its makers say it can save memory so models run on smaller graphics cards.
Who it's for
Developers and researchers who want to train or adapt open language models with their own code.
Can I use it without coding?
Developers only. It is a Python library and command-line tool, so you need to be comfortable with code. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Computer
- Works best on a powerful computer or one with a graphics card (GPU)
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- LoRA from scratch: implementation for LLM finetuningHacker News · Jan 2024
- How to Finetune GPT-Like Large Language Models on a Custom DatasetHacker News · May 2023