← All projects
Training & fine-tuning

OpenRLHF

A framework for training large language models with feedback so they give better answers.

New this week

What it does

OpenRLHF helps teams improve large language models with reinforcement learning from human feedback (RLHF), which rewards a model for answers people prefer. It can also train multi-step AI agents and models that understand images.

It spreads the work across many graphics cards, and its makers say it handles models of 70 billion parameters and more.

Who it's for

AI researchers and engineers training large language models.

Can I use it without coding?

Developers only. It needs programming skills and powerful graphics cards. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Server
Computer
Made for servers or data centres
Privacy
Runs on your own device: your data stays with you
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe