Need advice about which tool to choose?Ask the StackShare community!
The problem I have is - we need to process & change(update/insert) 55M Data every 2 min and this updated data to be available for Rest API for Filtering / Selection. Response time for Rest API should be less than 1 sec.
The most important factors for me are processing and storing time of 2 min. There need to be 2 views of Data One is for Selection & 2. Changed data.
ScyllaDBBy 55M do you mean 55 million entity changes per 2 minutes? It is relatively high, means almost 460k per second. If I had to choose between Scylla or Cassandra, I would opt for Scylla as it is promising better performance for simple operations. However, maybe it would be worth to consider yet another alternative technology. Take into consideration required consistency, reliability and high availability and you may realize that there are more suitable once. Rest API should not be the main driver, because you can always develop the API yourself, if not supported by given technology.
CassandraCassandra is quite capable of the task, in a highly available way, given appropriate scaling of the system. Remember that updates are only inserts, and that efficient retrieval is only by key (which can be a complex key). Talking of keys, make sure that the keys are well distributed.
Cassandrai love syclla for pet projects however it's license which is based on server model is an issue. thus i recommend cassandra
ScyllaDBScylla can handle 1M/s events with a simple data model quite easily. The api to query is CQL, we have REST api but that's for control/monitoring
Pros of Cassandra
- Distributed115
- High performance96
- High availability80
- Easy scalability74
- Replication52
- Reliable26
- Multi datacenter deployments26
- OLTP9
- Open source7
- Schema optional7
- Workload separation (via MDC)2
- Fast1
Pros of Solr
- Powerful35
- Indexing and searching22
- Scalable20
- Customizable19
- Enterprise Ready13
- Apache Software Foundation5
- Restful5
- Great Search engine4
- Security built-in2
Sign up to add or upvote prosMake informed product decisions
Cons of Cassandra
- Reliability of replication3
- Size1
- Updates1
Cons of Solr
Sign up to add or upvote consMake informed product decisions
What is Cassandra?
What is Solr?
Need advice about which tool to choose?Ask the StackShare community!
Sign up to get full access to all the companiesMake informed product decisions
What tools integrate with Solr?
Sign up to get full access to all the tool integrationsMake informed product decisions
Blog Posts
+5
+17
+42
+26