Plain-AyI
← All projects
Learning resources

Awesome Multimodal Large Language Models

A research reading list on AI models that understand images, video and sound as well as text.

Research-backed

What it does

Multimodal large language models are AI models that can work with more than one kind of input, such as text, pictures, video and audio. This list collects research papers and datasets on the subject.

It is organised by topic, such as training, hallucination (when AI makes things up), reasoning and evaluation. The research group behind it also lists its own surveys and benchmarks for testing these models.

Who it's for

Researchers and students following progress in multimodal AI.

Can I use it without coding?

Yes. It is a web page of links. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Web browser
Computer
An ordinary computer is fine
API key
Not needed

Try it

  1. Open the list on GitHub and browse the sections that interest you.

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • No standard license listed. Check the GitHub page before using it for business.
  • More on staying safe

Where people are talking about it