Apache Mesos vs Gardener vs YARN Hadoop
Overview
Detailed Comparison
Apache Mesos is a cluster manager that simplifies the complexity of running applications on a shared pool of servers. | Its fundamental idea is to split up the functionalities of resource management and job scheduling/monitoring into separate daemons. The idea is to have a global ResourceManager (RM) and per-application ApplicationMaster (AM). | Many Open Source tools exist which help in creating and updating single Kubernetes clusters. However, the more clusters you need the harder it becomes to operate, monitor, manage and keep all of them alive and up-to-date. And that is exactly what project Gardener focuses on. |
Fault-tolerant replicated master using ZooKeeper;Scalability to 10,000s of nodes;Isolation between tasks with Linux Containers;Multi-resource scheduling (memory and CPU aware);Java, Python and C++ APIs for developing new parallel applications;Web UI for viewing cluster state | - | Central dashboard for comfortable interaction - enables users to easily keep track of their clusters’ health, and operators to monitor, debug, and analyze the clusters they are responsible for; Command line client - simplifies administrative tasks by introducing easy higher-level abstractions with simple commands that allow to condense and multiplex information & actions from/to a set of seed and shoot clusters |
Statistics | ||
GitHub Stars 5.3K | GitHub Stars - | GitHub Stars 3.3K |
GitHub Forks 1.7K | GitHub Forks - | GitHub Forks 540 |
Stacks 311 | Stacks 113 | Stacks 16 |
Followers 418 | Followers 80 | Followers 41 |
Votes 31 | Votes 1 | Votes 2 |
Pros & Cons | ||
Pros
Cons
| Pros
| Pros
|
Integrations | ||
| No integrations available | ||
What are some alternatives to Apache Mesos, YARN Hadoop, Gardener?
Nomad
Nomad is a cluster manager, designed for both long lived services and short lived batch processing workloads. Developers use a declarative job specification to submit work, and Nomad ensures constraints are satisfied and resource utilization is optimized by efficient task packing. Nomad supports all major operating systems and virtualized, containerized, or standalone applications.
DC/OS
Unlike traditional operating systems, DC/OS spans multiple machines within a network, aggregating their resources to maximize utilization by distributed applications.
Mesosphere
Mesosphere offers a layer of software that organizes your machines, VMs, and cloud instances and lets applications draw from a single pool of intelligently- and dynamically-allocated resources, increasing efficiency and reducing operational complexity.
kops
It helps you create, destroy, upgrade and maintain production-grade, highly available, Kubernetes clusters from the command line. AWS (Amazon Web Services) is currently officially supported, with GCE in beta support , and VMware vSphere in alpha, and other platforms planned.
Apache Aurora
Apache Aurora is a service scheduler that runs on top of Mesos, enabling you to run long-running services that take advantage of Mesos' scalability, fault-tolerance, and resource isolation.
Elastic Apache Mesos
Elastic Apache Mesos is a web service that automates the creation of Apache Mesos clusters on Amazon Elastic Compute Cloud (EC2). It provisions EC2 instances, installs dependencies including Apache ZooKeeper and HDFS, and delivers you a cluster with all the services running.
Peloton
A Unified Resource Scheduler to co-schedule mixed types of workloads such as batch, stateless and stateful jobs in a single cluster for better resource utilization. Designed for web-scale companies with millions of containers and tens of thousands of nodes.
Kocho
Kocho provides a set of mechanisms to bootstrap AWS nodes that must follow a specific configuration with CoreOS. It sets up fleet meta-data, and patched versions of fleet, etcd, and docker when using Yochu.
Warewulf
It is an operating system provisioning platform for Linux that is designed to produce secure, scalable, turnkey cluster deployments that maintain flexibility and simplicity.
