Need advice about which tool to choose?Ask the StackShare community!

Celery

1.5K
1.5K
+ 1
279
Dask

87
126
+ 1
0
Add tool
Get Advice from developers at your company using StackShare Enterprise. Sign up for StackShare Enterprise.
Learn More
Pros of Celery
Pros of Dask
  • 98
    Task queue
  • 63
    Python integration
  • 40
    Django integration
  • 30
    Scheduled Task
  • 19
    Publish/subsribe
  • 8
    Various backend broker
  • 6
    Easy to use
  • 5
    Workflow
  • 5
    Great community
  • 4
    Free
  • 1
    Dynamic
    Be the first to leave a pro

    Sign up to add or upvote prosMake informed product decisions

    Cons of Celery
    Cons of Dask
    • 4
      Sometimes loses tasks
    • 1
      Depends on broker
      Be the first to leave a con

      Sign up to add or upvote consMake informed product decisions

      - No public GitHub repository available -

      What is Celery?

      Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well.

      What is Dask?

      It is a versatile tool that supports a variety of workloads. It is composed of two parts: Dynamic task scheduling optimized for computation. This is similar to Airflow, Luigi, Celery, or Make, but optimized for interactive computational workloads. Big Data collections like parallel arrays, dataframes, and lists that extend common interfaces like NumPy, Pandas, or Python iterators to larger-than-memory or distributed environments. These parallel collections run on top of dynamic task schedulers.

      Need advice about which tool to choose?Ask the StackShare community!

      Jobs that mention Celery and Dask as a desired skillset
      CBRE
      Philippines National Capital Region Makati City
      CBRE
      United Kingdom of Great Britain and Northern Ireland England London
      CBRE
      Philippines National Capital Region Makati City
      What companies use Celery?
      What companies use Dask?
      See which teams inside your own company are using Celery or Dask.
      Sign up for StackShare EnterpriseLearn More

      Sign up to get full access to all the companiesMake informed product decisions

      What tools integrate with Celery?
      What tools integrate with Dask?

      Sign up to get full access to all the tool integrationsMake informed product decisions

      Blog Posts

      GitHubPythonNode.js+47
      53
      70767
      JavaScriptGitHubPython+42
      52
      20639
      GitHubPythonSlack+25
      7
      2980
      GitHubPythonDocker+24
      13
      16831
      What are some alternatives to Celery and Dask?
      RabbitMQ
      RabbitMQ gives your applications a common platform to send and receive messages, and your messages a safe place to live until received.
      Kafka
      Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.
      Airflow
      Use Airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The Airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command lines utilities makes performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress and troubleshoot issues when needed.
      Cucumber
      Cucumber is a tool that supports Behaviour-Driven Development (BDD) - a software development process that aims to enhance software quality and reduce maintenance costs.
      Amazon SQS
      Transmit any volume of data, at any level of throughput, without losing messages or requiring other services to be always available. With SQS, you can offload the administrative burden of operating and scaling a highly available messaging cluster, while paying a low price for only what you use.
      See all alternatives