Plain-AyI
← All projects
Running AI at scale

SynapseML

A Microsoft library for building machine-learning pipelines that run across large computer clusters.

Research-backedNew this week

What it does

SynapseML, formerly called MMLSpark, adds machine-learning tools to Apache Spark, a system for processing very large amounts of data across many computers.

It covers tasks like text analysis, computer vision, spotting unusual data and fast model training, and can call Microsoft's AI services at large scale.

It can be used from Python, R, Scala, Java and .NET, and on platforms such as Microsoft Fabric and Databricks.

Who it's for

Data engineers and data scientists working with big data on Spark.

Can I use it without coding?

Developers only. Needs a Spark environment and programming skills. New to this? Start here.

Can I run it?

Cost
FreeNothing to pay or sign up for.
Runs on
Server, Cloud
Computer
Made for servers or data centres
API key
Not needed

Try it

Using Claude Code, Cursor or another AI coding assistant? Paste the prompt and it will walk you through the setup.New to this?

Before you install

  • Only download from the official GitHub page. Copies with similar names exist for many popular projects.
  • License (MIT): Very permissive: free to use, change and share, including for business.
  • More on staying safe

Where people are talking about it