← All projects
Training & fine-tuning

PaLM + RLHF (PyTorch)

Example code showing how ChatGPT-style training with human feedback works.

New this week

What it does

This project writes out, in code, the steps for training a chat model with human feedback (RLHF) on top of the PaLM design.

The README says there is no trained model included and calls it a work in progress; training a useful model would need huge computing power and data.

Who it's for

Researchers and students who want to study how RLHF training works.

Can I use it without coding?

Developers only. It is a Python library for researchers. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Computer
Works best on a powerful computer or one with a graphics card (GPU)
Privacy
Runs on your own device: your data stays with you
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (MIT): Very permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it