Plain-AyI
← All projects
AI memory

VoiceMem

A memory system that helps voice assistants remember facts, feelings and personality from your conversations.

Research-backed

What it does

VoiceMem gives voice assistants a long-term memory. It listens to speech, writes it down, and stores useful facts so the assistant can recall them later. Its makers describe two parts: a "left brain" that keeps facts and a "right brain" that keeps track of emotions, personality and relationships.

It works in a streaming way, meaning it processes audio while you are still talking. It can start looking up related memories before you finish a sentence, which its makers say keeps delays very low. It can also recognise who is speaking and note sounds, music and group conversations.

Developers can plug VoiceMem into their own voice model. The project also includes fine-tuned models that understand its memories, a training dataset, a web demo, and code to test memory accuracy on public benchmarks.

Who it's for

Developers and researchers building voice assistants or voice agents that should remember users over time.

Can I use it without coding?

Developers only. It is a Python library you use in code, though a local web demo can be started with a command. New to this? Start here.

Can I run it?

Cost
Free, but needs an AI accountThe software is free, but it uses an online AI service (like OpenAI or Anthropic), which usually charges for use.
Runs on
Linux, Server
Privacy
Your choice: run it on your device or use an online service
API key
Needed. An API key is a password-like code from an online AI service. What's that?

Try it

  1. Download the project from GitHub and install the voicemem Python package.
  2. Download the required helper models from the project's Hugging Face page.
  3. Add your OpenAI API key and start the web demo to try it in your browser.

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • Plain-AyI is an independent guide and doesn't host or review the software it lists. Please check each project's official page before installing.
  • License (Apache-2.0): Permissive: free to use, change and share, including for business.
  • Keep your API key private. Never paste it into websites or share it, and set a spending limit with the AI service.
  • More on staying safe

Where people are talking about it