Built at UC Berkeley, Mesos was designed for operations at very large scale. It was tested and refined under the crushing loads of Twitter and Airbnb, and now supports some of the largest applications in the world.
Mesos supports different types of workloads to build a truly modern application. These distributed workloads include container orchestration (Mesos containers, Docker, and Kubernetes), analytics (Spark), big data technologies (Kafka, Cassandra) and much more.
Mesos’ two-level architecture allows it to run existing and new distributed technologies on the same platform. The two-level architecture allows organizations to build their own operational logic in their apps, dramatically simplifying operations.
Mesos began as a research project at UC Berkeley, the birthplace of BSD Unix. The project was started at AMPLab by then PhD students Benjamin Hindman, Andy Konwinski, and Matei Zaharia, with professor Ion Stoica. Inspired by Google’s proprietary Borg system, the project’s goal was to create an open-source kernel that simplifies building and running distributed applications at a very large scale and treats the entire datacenter as a single giant super computer, while also maintaining an extensible architecture.
Mesos can support different types of distributed workloads such as container orchestration (Mesos and Docker containers), analytics (Spark), stateful big-data technologies (Kafka, Cassandra) and even different types of operating systems (Windows and Linux), allowing organizations to simplify operations and achieve higher resource utilization.
By having Mesos handle low-level infrastructure logic and delegating the application-specific logic to the framework, Mesos can easily scale to tens of thousands of nodes, which is why it has been reliably powering some of the largest web-scale platforms in the last couple of years.
As new distributed technologies are introduced to the market, organizations can easily introduce and adopt new technologies as applications or frameworks (such as Kubernetes), and include any application-specific scheduling and operational logic, making Mesos a true future-proof platform for distributed technologies.