What it does
This project writes out, in code, the steps for training a chat model with human feedback (RLHF) on top of the PaLM design.
The README says there is no trained model included and calls it a work in progress; training a useful model would need huge computing power and data.
Who it's for
Researchers and students who want to study how RLHF training works.
Can I use it without coding?
Developers only. It is a Python library for researchers. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Computer
- Works best on a powerful computer or one with a graphics card (GPU)
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- License (MIT): Very permissive: free to use, change and share, including for business.
- More on staying safe
Where people are talking about it
- First Open Source Alternative to ChatGPT Has ArrivedHacker News · Dec 2022