What it does
MMF is a research framework for "multimodal" AI, meaning models that work with both pictures and language, such as answering questions about an image. It includes reference versions of well-known models and supports training across many machines.
It serves as a starting point for research challenges like Hateful Memes, TextVQA and VQA. It was formerly called Pythia.
Who it's for
AI researchers working on vision-and-language problems.
Can I use it without coding?
Developers only. It is a PyTorch research codebase. New to this? Start here.
Can I run it?
- Cost
- FreeNothing to pay or sign up for.
- Runs on
- Linux, Server
- Computer
- Works best on a powerful computer or one with a graphics card (GPU)
- Privacy
- Runs on your own device: your data stays with you
- API key
- Not needed
Try it
Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?
Before you install
- Only download from the official GitHub page. Copies with similar names exist for many popular projects.
- No standard license listed. Check the GitHub page before using it for business.
- More on staying safe