Head of Engineering ·
Needs advice
on
ScyllaScylla
and
CassandraCassandra

The problem I have is - we need to process & change(update/insert) 55M Data every 2 min and this updated data to be available for Rest API for Filtering / Selection. Response time for Rest API should be less than 1 sec.

The most important factors for me are processing and storing time of 2 min. There need to be 2 views of Data One is for Selection & 2. Changed data.

READ LESS
2 upvotes·63.6K views
Replies (4)
Data Architect ·
Recommends
Cassandra

Cassandra is quite capable of the task, in a highly available way, given appropriate scaling of the system. Remember that updates are only inserts, and that efficient retrieval is only by key (which can be a complex key). Talking of keys, make sure that the keys are well distributed.

READ MORE
2 upvotes·63.3K views
Recommends
Scylla

Scylla can handle 1M/s events with a simple data model quite easily. The api to query is CQL, we have REST api but that's for control/monitoring

READ MORE
2 upvotes·63.4K views
View all (4)
Avatar of Alex Peake

Alex Peake

Data Architect