kitio.aiAdded Nov 5, 2026
Apache Spark MLlib
FreeDistributed machine learning library built into Apache Spark
What is Apache Spark MLlib?
MLlib is Apache Spark's machine learning library for training models on data spread across a cluster. It works from Java, Scala, Python and R, and is aimed at data engineers and scientists who already process large datasets with Spark.
It covers common algorithms for classification, regression, clustering and recommendation, plus feature transformation, pipelines and model evaluation. Because it runs inside Spark, the same job can load data, prepare it and train a model without moving it to another system.
MLlib reads from any Hadoop data source, including HDFS, HBase and local files, and interoperates with NumPy in Python and with R libraries. It is free and open source under the Apache License as part of the Spark project.
Features
- Distributed model training
- ML pipelines
- Classification and clustering
- Hadoop data sources
- Java, Scala, Python and R APIs
Tags
Releases
+ Submit new release- Listed
Apache Spark MLlib was added to the directory.
Organization
Apache Software Foundation
Listed by kitio.ai · unverified owner
Pricing
- Pricing model
- Free
- Paid options from
- 100% free
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.
Top Apache Spark MLlib alternatives
View allData & analytics
Open-source Java workbench for machine learning and data mining
Data & analytics
Open-source visual workflows for analytics, ML and AI agents
Data & analytics
Open-source product analytics suite with an AI assistant
Data & analytics
Free cloud notebooks, datasets and competitions for machine learning
Compare Apache Spark MLlib
If you liked Apache Spark MLlib
- ml5.jsNew
Beginner-friendly JavaScript library for machine learning in the browser
FreeCodingMade in United States Technical computing notebooks with built-in machine learning and LLM tools
Free trialData & analyticsMade in United States- SAS ViyaNew
Cloud-native SAS platform for analytics, machine learning and AI
Free trialData & analyticsMade in United States - MATLABNew
Numerical computing environment with AI coding help and deep learning
Free trialData & analyticsMade in United States
Pros and cons
Pros
- Scales across large clusters
- Fits into existing Spark jobs
- Free and open source
Cons
- Needs a Spark cluster to be useful
- Few deep learning features
- Heavier setup than single-machine libraries
Prompts & results
No prompts yet. Add your own prompt and output to help others use this tool.
Share a prompt
Reviews
Q&A
What is Apache Spark MLlib?
MLlib is Apache Spark's machine learning library for training models on data spread across a cluster. It works from Java, Scala, Python and R, and is aimed at data engineers and scientists who already process large datasets with Spark.
Which languages can I use with MLlib?
MLlib has APIs for Java, Scala, Python and R.
What data sources does MLlib support?
It can read any Hadoop data source, such as HDFS and HBase, as well as local files.
How much does Apache Spark MLlib cost?
Apache Spark MLlib is 100% free.
Is there a free version of Apache Spark MLlib?
Yes. Apache Spark MLlib is completely free to use.
What are the main features of Apache Spark MLlib?
Distributed model training, ML pipelines, Classification and clustering, Hadoop data sources, Java, Scala, Python and R APIs.
Who makes Apache Spark MLlib?
Apache Spark MLlib is made by Apache Software Foundation.
What are the best alternatives to Apache Spark MLlib?
Popular alternatives include Weka, KNIME, PostHog.