StackShareStackShare
Follow on
StackShare

Discover and share technology stacks from companies around the world.

Follow on

© 2025 StackShare. All rights reserved.

Product

  • Stacks
  • Tools
  • Feed

Company

  • About
  • Contact

Legal

  • Privacy Policy
  • Terms of Service
  1. Stackups
  2. DevOps
  3. Log Management
  4. Log Management
  5. Dremio vs Splunk

Dremio vs Splunk

OverviewDecisionsComparisonAlternatives

Overview

Splunk
Splunk
Stacks773
Followers1.0K
Votes20
Dremio
Dremio
Stacks116
Followers348
Votes8

Dremio vs Splunk: What are the differences?

<Write Introduction here>
  1. Data Source Support: Dremio primarily focuses on processing data directly from various sources, providing high-performance queries without the need to move data into a separate system. On the other hand, Splunk also offers support for processing data from various sources but is more known for its log management and analysis capabilities, especially for machine-generated data.

  2. Cost Model: Dremio follows an open-source business model, allowing users to download and use the platform for free. They charge fees for enterprise features and support. Conversely, Splunk is a commercial product that requires a paid license, which can become costly based on the volume of data being processed and analyzed.

  3. User Interface and Use Cases: Dremio is designed with a focus on data engineers and data analysts, providing a more technical interface tailored for data processing tasks. Splunk, on the other hand, is known for its user-friendly interface and is frequently used by IT and security professionals for log management, monitoring, and troubleshooting purposes.

  4. Extensibility and Integrations: Dremio offers a high level of extensibility, allowing users to integrate with various third-party tools and services through APIs and connectors. In contrast, Splunk provides a broad range of pre-built integrations and plugins to extend its functionality within the IT and security ecosystem.

  5. Architecture and Scalability: Dremio utilizes a distributed SQL engine to process queries in parallel, enabling horizontal scalability and efficient resource utilization. Splunk, on the other hand, is based on a proprietary indexing technology that indexes and searches data in real-time, which can sometimes lead to scalability challenges with large volumes of data.

  6. Community and Ecosystem: Dremio has a growing community of users and contributors, providing support through forums, documentation, and community-driven initiatives. Splunk, being a more mature platform, has a well-established ecosystem with a wide range of plugins, apps, and professional support services available for users.

In Summary, Dremio and Splunk differ in terms of their data source support, cost model, user interface, extensibility, architecture, and community ecosystem.

Share your Stack

Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.

View Docs
CLI (Node.js)
or
Manual

Advice on Splunk, Dremio

karunakaran
karunakaran

Consultant

Jun 26, 2020

Needs advice

I am trying to build a data lake by pulling data from multiple data sources ( custom-built tools, excel files, CSV files, etc) and use the data lake to generate dashboards.

My question is which is the best tool to do the following:

  1. Create pipelines to ingest the data from multiple sources into the data lake
  2. Help me in aggregating and filtering data available in the data lake.
  3. Create new reports by combining different data elements from the data lake.

I need to use only open-source tools for this activity.

I appreciate your valuable inputs and suggestions. Thanks in Advance.

80.5k views80.5k
Comments
datocrats-org
datocrats-org

Jul 29, 2020

Needs adviceonAmazon EC2Amazon EC2TableauTableauPowerBIPowerBI

We need to perform ETL from several databases into a data warehouse or data lake. We want to

  • keep raw and transformed data available to users to draft their own queries efficiently
  • give users the ability to give custom permissions and SSO
  • move between open-source on-premises development and cloud-based production environments

We want to use inexpensive Amazon EC2 instances only on medium-sized data set 16GB to 32GB feeding into Tableau Server or PowerBI for reporting and data analysis purposes.

319k views319k
Comments

Detailed Comparison

Splunk
Splunk
Dremio
Dremio

It provides the leading platform for Operational Intelligence. Customers use it to search, monitor, analyze and visualize machine data.

Dremio—the data lake engine, operationalizes your data lake storage and speeds your analytics processes with a high-performance and high-efficiency query engine while also democratizing data access for data scientists and analysts.

Predict and prevent problems with one unified monitoring experience; Streamline your entire security stack with Splunk as the nerve center; Detect, investigate and diagnose problems easily with end-to-end observability
Democratize all your data; Make your data engineers more productive; Accelerate your favorite tools; Self service, for everybody
Statistics
Stacks
773
Stacks
116
Followers
1.0K
Followers
348
Votes
20
Votes
8
Pros & Cons
Pros
  • 3
    Alert system based on custom query results
  • 3
    API for searching logs, running reports
  • 2
    Ability to style search results into reports
  • 2
    Custom log parsing as well as automatic parsing
  • 2
    Dashboarding on any log contents
Cons
  • 1
    Splunk query language rich so lots to learn
Pros
  • 3
    Nice GUI to enable more people to work with Data
  • 2
    Connect NoSQL databases with RDBMS
  • 2
    Easier to Deploy
  • 1
    Free
Cons
  • 1
    Works only on Iceberg structured data
Integrations
No integrations available
Amazon S3
Amazon S3
Python
Python
Tableau
Tableau
Azure Database for PostgreSQL
Azure Database for PostgreSQL
Qlik Sense
Qlik Sense
PowerBI
PowerBI

What are some alternatives to Splunk, Dremio?

Papertrail

Papertrail

Papertrail helps detect, resolve, and avoid infrastructure problems using log messages. Papertrail's practicality comes from our own experience as sysadmins, developers, and entrepreneurs.

Logmatic

Logmatic

Get a clear overview of what is happening across your distributed environments, and spot the needle in the haystack in no time. Build dynamic analyses and identify improvements for your software, your user experience and your business.

Loggly

Loggly

It is a SaaS solution to manage your log data. There is nothing to install and updates are automatically applied to your Loggly subdomain.

Google BigQuery

Google BigQuery

Run super-fast, SQL-like queries against terabytes of data in seconds, using the processing power of Google's infrastructure. Load data with ease. Bulk load your data using Google Cloud Storage or stream it in. Easy access. Access BigQuery by using a browser tool, a command-line tool, or by making calls to the BigQuery REST API with client libraries such as Java, PHP or Python.

Apache Spark

Apache Spark

Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.

Amazon Redshift

Amazon Redshift

It is optimized for data sets ranging from a few hundred gigabytes to a petabyte or more and costs less than $1,000 per terabyte per year, a tenth the cost of most traditional data warehousing solutions.

Logentries

Logentries

Logentries makes machine-generated log data easily accessible to IT operations, development, and business analysis teams of all sizes. With the broadest platform support and an open API, Logentries brings the value of log-level data to any system, to any team member, and to a community of more than 25,000 worldwide users.

Logstash

Logstash

Logstash is a tool for managing events and logs. You can use it to collect logs, parse them, and store them for later use (like, for searching). If you store them in Elasticsearch, you can view and analyze them with Kibana.

Graylog

Graylog

Centralize and aggregate all your log files for 100% visibility. Use our powerful query language to search through terabytes of log data to discover and analyze important information.

Qubole

Qubole

Qubole is a cloud based service that makes big data easy for analysts and data engineers.

Related Comparisons

Bootstrap
Materialize

Bootstrap vs Materialize

Laravel
Django

Django vs Laravel vs Node.js

Bootstrap
Foundation

Bootstrap vs Foundation vs Material UI

Node.js
Spring Boot

Node.js vs Spring-Boot

Liquibase
Flyway

Flyway vs Liquibase