← All projects
Running AI at scale

Lance

A data storage format built for AI, holding text, images, video and search data in one place.

New this week

What it does

Lance is a way of storing large datasets for AI work. It can hold images, videos, audio, text and embeddings (number codes that capture meaning) together.

It supports fast searches by meaning, keyword search and database-style queries on the same data. Its makers say it is much faster than common formats like Parquet for jumping to individual records.

It keeps automatic versions of your data and works with tools like Pandas, DuckDB, Spark and PyTorch.

Who it's for

Data engineers and machine learning teams who manage large, mixed datasets for AI training or search.

Can I use it without coding?

Developers only. It is used from code, mainly Python or Rust. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Privacy
Runs on your own device: your data stays with you
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • More on staying safe