Amazon Athena vs Delta Lake vs Apache Spark

Need advice about which tool to choose?Ask the StackShare community!

Amazon Athena

496
838
+ 1
49
Delta Lake

99
314
+ 1
0
Apache Spark

3K
3.5K
+ 1
140
Manage your open source components, licenses, and vulnerabilities
Learn More
Pros of Amazon Athena
Pros of Delta Lake
Pros of Apache Spark
  • 16
    Use SQL to analyze CSV files
  • 8
    Glue crawlers gives easy Data catalogue
  • 7
    Cheap
  • 6
    Query all my data without running servers 24x7
  • 4
    No data base servers yay
  • 3
    Easy integration with QuickSight
  • 2
    Query and analyse CSV,parquet,json files in sql
  • 2
    Also glue and athena use same data catalog
  • 1
    No configuration required
  • 0
    Ad hoc checks on data made easy
    Be the first to leave a pro
    • 61
      Open-source
    • 48
      Fast and Flexible
    • 8
      One platform for every big data problem
    • 8
      Great for distributed SQL like applications
    • 6
      Easy to install and to use
    • 3
      Works well for most Datascience usecases
    • 2
      Interactive Query
    • 2
      Machine learning libratimery, Streaming in real
    • 2
      In memory Computation

    Sign up to add or upvote prosMake informed product decisions

    Cons of Amazon Athena
    Cons of Delta Lake
    Cons of Apache Spark
      Be the first to leave a con
        Be the first to leave a con
        • 4
          Speed

        Sign up to add or upvote consMake informed product decisions

        - No public GitHub repository available -

        What is Amazon Athena?

        Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run.

        What is Delta Lake?

        An open-source storage layer that brings ACID transactions to Apache Spark™ and big data workloads.

        What is Apache Spark?

        Spark is a fast and general processing engine compatible with Hadoop data. It can run in Hadoop clusters through YARN or Spark's standalone mode, and it can process data in HDFS, HBase, Cassandra, Hive, and any Hadoop InputFormat. It is designed to perform both batch processing (similar to MapReduce) and new workloads like streaming, interactive queries, and machine learning.

        Need advice about which tool to choose?Ask the StackShare community!

        What companies use Amazon Athena?
        What companies use Delta Lake?
        What companies use Apache Spark?

        Sign up to get full access to all the companiesMake informed product decisions

        What tools integrate with Amazon Athena?
        What tools integrate with Delta Lake?
        What tools integrate with Apache Spark?

        Sign up to get full access to all the tool integrationsMake informed product decisions

        Blog Posts

        Mar 24 2021 at 12:57PM

        Pinterest

        GitJenkinsKafka+7
        3
        2196
        MySQLKafkaApache Spark+6
        2
        2053
        Aug 28 2019 at 3:10AM

        Segment

        PythonJavaAmazon S3+16
        7
        2615
        Jul 2 2019 at 9:34PM

        Segment

        Google AnalyticsAmazon S3New Relic+25
        10
        6869
        What are some alternatives to Amazon Athena, Delta Lake, and Apache Spark?
        Presto
        Distributed SQL Query Engine for Big Data
        Amazon Redshift Spectrum
        With Redshift Spectrum, you can extend the analytic power of Amazon Redshift beyond data stored on local disks in your data warehouse to query vast amounts of unstructured data in your Amazon S3 “data lake” -- without having to load or transform any data.
        Amazon Redshift
        It is optimized for data sets ranging from a few hundred gigabytes to a petabyte or more and costs less than $1,000 per terabyte per year, a tenth the cost of most traditional data warehousing solutions.
        Cassandra
        Partitioning means that Cassandra can distribute your data across multiple machines in an application-transparent matter. Cassandra will automatically repartition as machines are added and removed from the cluster. Row store means that like relational databases, Cassandra organizes data by rows and columns. The Cassandra Query Language (CQL) is a close relative of SQL.
        Spectrum
        The community platform for the future.
        See all alternatives