Home
Application and Data
Data Stores
Big Data Tools

Druid vs Pig

Need advice about which tool to choose?Ask the StackShare community!

Druid
381
867
+ 1
32
Pig
59
111
+ 1
5
Add tool

Druid vs Pig: What are the differences?

What is Druid? Fast column-oriented distributed data store. Druid is a distributed, column-oriented, real-time analytics data store that is commonly used to power exploratory dashboards in multi-tenant environments. Druid excels as a data warehousing solution for fast aggregate queries on petabyte sized data sets. Druid supports a variety of flexible filters, exact calculations, approximate algorithms, and other useful calculations.

What is Pig? Platform for analyzing large data sets. Pig is a dataflow programming environment for processing very large files. Pig's language is called Pig Latin. A Pig Latin program consists of a directed acyclic graph where each node represents an operation that transforms data Operations are of two flavors: (1) relational-algebra style operations such as join, filter, project; (2) functional-programming style operators such as map, reduce. .

Druid and Pig can be categorized as "Big Data" tools.

Druid and Pig are both open source tools. It seems that Druid with 8.31K GitHub stars and 2.08K forks on GitHub has more adoption than Pig with 583 GitHub stars and 449 GitHub forks.

Airbnb, Instacart, and Dial Once are some of the popular companies that use Druid, whereas Pig is used by Netflix, Outbrain, and Cobrain. Druid has a broader approval, being mentioned in 24 company stacks & 12 developers stacks; compared to Pig, which is listed in 9 company stacks and 4 developer stacks.

Manage your open source components, licenses, and vulnerabilities
Learn More
Pros of Druid
Pros of Pig
  • 15
    Real Time Aggregations
  • 6
    Batch and Real-Time Ingestion
  • 5
    OLAP
  • 3
    OLAP + OLTP
  • 2
    Combining stream and historical analytics
  • 1
    OLTP
  • 2
    Finer-grained control on parallelization
  • 1
    Proven at Petabyte scale
  • 1
    Open-source
  • 1
    Join optimizations for highly skewed data

Sign up to add or upvote prosMake informed product decisions

Cons of Druid
Cons of Pig
  • 3
    Limited sql support
  • 2
    Joins are not supported well
  • 1
    Complexity
    Be the first to leave a con

    Sign up to add or upvote consMake informed product decisions

    - No public GitHub repository available -

    What is Druid?

    Druid is a distributed, column-oriented, real-time analytics data store that is commonly used to power exploratory dashboards in multi-tenant environments. Druid excels as a data warehousing solution for fast aggregate queries on petabyte sized data sets. Druid supports a variety of flexible filters, exact calculations, approximate algorithms, and other useful calculations.

    What is Pig?

    Pig is a dataflow programming environment for processing very large files. Pig's language is called Pig Latin. A Pig Latin program consists of a directed acyclic graph where each node represents an operation that transforms data. Operations are of two flavors: (1) relational-algebra style operations such as join, filter, project; (2) functional-programming style operators such as map, reduce.

    Need advice about which tool to choose?Ask the StackShare community!

    Jobs that mention Druid and Pig as a desired skillset
    Senior Software Engineer, Big Data
    Pinterest
    San Francisco, CA, US; , CA, US
    View Job Details
    DreamTrinoAirflow+11
    Senior Software Engineer, Big Data
    Pinterest
    San Francisco, CA, US; , CA, US
    View Job Details
    DreamTrinoAirflow+11
    Senior Software Engineer, Big Data
    Pinterest
    San Francisco, CA, US; , CA, US
    View Job Details
    DreamTrinoAirflow+11
    Senior Software Engineer, Big Data
    Pinterest
    San Francisco, CA, US; , CA, US
    View Job Details
    DreamTrinoAirflow+11
    Staff Software Engineer, Ads Serving Platform
    Pinterest
    San Francisco, CA, US; , US
    View Job Details
    guidanceInfraDream+9
    Manager II, Engineering - Big Data Query Platform
    Pinterest
    San Francisco, CA, US; , US
    View Job Details
    DreamTrinoYarn+7
    Manager II, Engineering - Big Data Query Platform
    Pinterest
    San Francisco, CA, US; , US
    View Job Details
    DreamTrinoYarn+7
    Manager II, Engineering - Big Data Query Platform
    Pinterest
    San Francisco, CA, US; , US
    View Job Details
    DreamTrinoYarn+7
    What companies use Druid?
    What companies use Pig?
    Manage your open source components, licenses, and vulnerabilities
    Learn More

    Sign up to get full access to all the companiesMake informed product decisions

    What tools integrate with Druid?
    What tools integrate with Pig?

    Sign up to get full access to all the tool integrationsMake informed product decisions

    Blog Posts

    Pinterest Druid Holiday Load Testing
    Dec 22 2021 at 5:41AM

    Pinterest

    MySQLKafkaDruid+3
    3
    699
    Unified Flink Source at Pinterest: Streaming Data Processing
    Jul 29 2021 at 7:12PM

    Pinterest

    Amazon S3KafkaApache Flink+4
    4
    1373
    Powering Pinterest Ads Analytics with Apache Druid
    Apr 8 2020 at 5:37PM

    Pinterest

    MySQLKafkaApache Spark+6
    2
    2164
    How Raygun Solves Performance Issues at 100M API Calls Per Hou...
    Mar 28 2019 at 2:12PM

    Raygun

    JavaScriptNode.jsMySQL+12
    13
    4637
    What are some alternatives to Druid and Pig?
    HBase
    Apache HBase is an open-source, distributed, versioned, column-oriented store modeled after Google' Bigtable: A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities on top of Apache Hadoop.
    MongoDB
    MongoDB stores data in JSON-like documents that can vary in structure, offering a dynamic, flexible schema. MongoDB was also designed for high availability and scalability, with built-in replication and auto-sharding.
    Cassandra
    Partitioning means that Cassandra can distribute your data across multiple machines in an application-transparent matter. Cassandra will automatically repartition as machines are added and removed from the cluster. Row store means that like relational databases, Cassandra organizes data by rows and columns. The Cassandra Query Language (CQL) is a close relative of SQL.
    Prometheus
    Prometheus is a systems and service monitoring system. It collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts if some condition is observed to be true.
    Elasticsearch
    Elasticsearch is a distributed, RESTful search and analytics engine capable of storing data and searching it in near real time. Elasticsearch, Kibana, Beats and Logstash are the Elastic Stack (sometimes called the ELK Stack).
    See all alternatives

    Related Comparisons

    Apache Spark vs PigApache Kudu vs DruidApache Kylin vs DruidApache Flink vs DruidApache Impala vs Apache Spark vs Pig

    Trending Comparisons

    Django vs Laravel vs Node.jsBootstrap vs Foundation vs Material-UINode.js vs Spring BootFlyway vs LiquibaseAWS CodeCommit vs Bitbucket vs GitHub

    Top Comparisons

    HipChat vs Mattermost vs SlackPostman vs Swagger UIBitbucket vs GitHub vs GitLabBootstrap vs Materialize