What it does
Training large AI models takes huge amounts of memory and computing power. DeepSpeed is a library that spreads this work across many graphics chips (GPUs) and uses memory more efficiently.
Its makers say it has been used to train some very large language models, including BLOOM. It works with PyTorch, a popular AI programming toolkit.
Who it's for
AI engineers and researchers training or serving large models.
Can I use it without coding?
Developers only. A programming library for specialists, usually used on powerful hardware. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Computer
- Made for servers or data centres
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- DeepSpeed Chat: Easy, fast and affordable RLHF training of ChatGPT-like modelsHacker News · Apr 2023
- DeepSpeed Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-Like ModelsHacker News · Apr 2023