Citus vs Datomic vs TimescaleDB

Need advice about which tool to choose?Ask the StackShare community!

Citus

49
93
+ 1
9
Datomic

53
64
+ 1
0
TimescaleDB

175
295
+ 1
41
Advice on Citus, Datomic, and TimescaleDB
Umair Iftikhar
Technical Architect at ERP Studio · | 3 upvotes · 213K views
Needs advice
on
TimescaleDBTimescaleDBDruidDruid
and
CassandraCassandra

Developing a solution that collects Telemetry Data from different devices, nearly 1000 devices minimum and maximum 12000. Each device is sending 2 packets in 1 second. This is time-series data, and this data definition and different reports are saved on PostgreSQL. Like Building information, maintenance records, etc. I want to know about the best solution. This data is required for Math and ML to run different algorithms. Also, data is raw without definitions and information stored in PostgreSQL. Initially, I went with TimescaleDB due to PostgreSQL support, but to increase in sites, I started facing many issues with timescale DB in terms of flexibility of storing data.

My major requirement is also the replication of the database for reporting and different purposes. You may also suggest other options other than Druid and Cassandra. But an open source solution is appreciated.

See more
Replies (1)
Recommends
MongoDBMongoDB

Hi Umair, Did you try MongoDB. We are using MongoDB on a production environment and collecting data from devices like your scenario. We have a MongoDB cluster with three replicas. Data from devices are being written to the master node and real-time dashboard UI is using the secondary nodes for read operations. With this setup write operations are not affected by read operations too.

See more
Needs advice
on
TimescaleDBTimescaleDBMongoDBMongoDB
and
InfluxDBInfluxDB

We are building an IOT service with heavy write throughput and fewer reads (we need downsampling records). We prefer to have good reliability when comes to data and prefer to have data retention based on policies.

So, we are looking for what is the best underlying DB for ingesting a lot of data and do queries easily

See more
Replies (3)
Yaron Lavi
Recommends
PostgreSQLPostgreSQL

We had a similar challenge. We started with DynamoDB, Timescale, and even InfluxDB and Mongo - to eventually settle with PostgreSQL. Assuming the inbound data pipeline in queued (for example, Kinesis/Kafka -> S3 -> and some Lambda functions), PostgreSQL gave us a We had a similar challenge. We started with DynamoDB, Timescale and even InfluxDB and Mongo - to eventually settle with PostgreSQL. Assuming the inbound data pipeline in queued (for example, Kinesis/Kafka -> S3 -> and some Lambda functions), PostgreSQL gave us better performance by far.

See more
Recommends
DruidDruid

Druid is amazing for this use case and is a cloud-native solution that can be deployed on any cloud infrastructure or on Kubernetes. - Easy to scale horizontally - Column Oriented Database - SQL to query data - Streaming and Batch Ingestion - Native search indexes It has feature to work as TimeSeriesDB, Datawarehouse, and has Time-optimized partitioning.

See more
Ankit Malik
Software Developer at CloudCover · | 3 upvotes · 147.2K views
Recommends
Google BigQueryGoogle BigQuery

if you want to find a serverless solution with capability of a lot of storage and SQL kind of capability then google bigquery is the best solution for that.

See more
Decisions about Citus, Datomic, and TimescaleDB
Benoit Larroque
Principal Engineer at Sqreen · | 2 upvotes · 76.6K views

I chose TimescaleDB because to be the backend system of our production monitoring system. We needed to be able to keep track of multiple high cardinality dimensions.

The drawbacks of this decision are our monitoring system is a bit more ad hoc than it used to (New Relic Insights)

We are combining this with Grafana for display and Telegraf for data collection

See more
Get Advice from developers at your company using Private StackShare. Sign up for Private StackShare.
Learn More
Pros of Citus
Pros of Datomic
Pros of TimescaleDB
  • 5
    Multi-core Parallel Processing
  • 2
    Drop-in PostgreSQL replacement
  • 2
    Distributed with Auto-Sharding
    Be the first to leave a pro
    • 8
      Open source
    • 7
      Easy Query Language
    • 6
      Time-series data analysis
    • 5
      Established postgresql API and support
    • 4
      Reliable
    • 2
      Postgres integration
    • 2
      Fast and scalable
    • 2
      High-performance
    • 2
      Chunk-based compression
    • 2
      Paid support for automatic Retention Policy
    • 1
      Case studies

    Sign up to add or upvote prosMake informed product decisions

    Cons of Citus
    Cons of Datomic
    Cons of TimescaleDB
      Be the first to leave a con
        Be the first to leave a con
        • 5
          Licensing issues when running on managed databases

        Sign up to add or upvote consMake informed product decisions

        - No public GitHub repository available -

        What is Citus?

        It's an extension to Postgres that distributes data and queries in a cluster of multiple machines. Its query engine parallelizes incoming SQL queries across these servers to enable human real-time (less than a second) responses on large datasets.

        What is Datomic?

        Build flexible, distributed systems that can leverage the entire history of your critical data, not just the most current state. Build them on your existing infrastructure or jump straight to the cloud.

        What is TimescaleDB?

        TimescaleDB: An open-source database built for analyzing time-series data with the power and convenience of SQL — on premise, at the edge, or in the cloud.

        Need advice about which tool to choose?Ask the StackShare community!

        What companies use Citus?
        What companies use Datomic?
        What companies use TimescaleDB?

        Sign up to get full access to all the companiesMake informed product decisions

        What tools integrate with Citus?
        What tools integrate with Datomic?
        What tools integrate with TimescaleDB?
          No integrations found

          Sign up to get full access to all the tool integrationsMake informed product decisions

          Blog Posts

          What are some alternatives to Citus, Datomic, and TimescaleDB?
          CockroachDB
          CockroachDB is distributed SQL database that can be deployed in serverless, dedicated, or on-prem. Elastic scale, multi-active availability for resilience, and low latency performance.
          Apache Aurora
          Apache Aurora is a service scheduler that runs on top of Mesos, enabling you to run long-running services that take advantage of Mesos' scalability, fault-tolerance, and resource isolation.
          Cassandra
          Partitioning means that Cassandra can distribute your data across multiple machines in an application-transparent matter. Cassandra will automatically repartition as machines are added and removed from the cluster. Row store means that like relational databases, Cassandra organizes data by rows and columns. The Cassandra Query Language (CQL) is a close relative of SQL.
          Vitess
          It is a database solution for deploying, scaling and managing large clusters of MySQL instances. It’s architected to run as effectively in a public or private cloud architecture as it does on dedicated hardware. It combines and extends many important MySQL features with the scalability of a NoSQL database.
          Clickhouse
          It allows analysis of data that is updated in real time. It offers instant results in most cases: the data is processed faster than it takes to create a query.
          See all alternatives