What it does
Ray helps programs that are too big for one computer run across many machines at once. Its makers say the same code can scale from a laptop to a cluster without other infrastructure.
It comes with libraries for common AI jobs: preparing data, training models, tuning settings, reinforcement learning (learning by trial and error) and serving models to users.
It runs on ordinary machines, cloud providers and Kubernetes (a system for managing many servers), and includes a dashboard for monitoring jobs.
Who it's for
Engineers and data scientists who need to train or run AI models at large scale.
Can I use it without coding?
Developers only. It's a Python library for programmers and usually runs on server clusters. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Server, Cloud
- Computer
- An ordinary computer is fine
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (Apache-2.0): Permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- A Comprehensive Guide for Building Rag-Based LLM ApplicationsHacker News · Sept 2023
- Numbers every LLM developer should knowHacker News · May 2023
- Exoshuffle: large-scale data shuffle in RayResearch paper · Mar 2022
- Tune paperResearch paper · Jul 2018
- Ray paperResearch paper · Dec 2017
- RLlib paperResearch paper · Dec 2017
- Ray HotOS paperResearch paper · Mar 2017