1

Hello,

We are currently using version 7 as legacy deployment and there we can easily add new celery workers in /etc/supervisor/conf.d/redash.conf and change the queues in redash metadata accordingly.

We are planning to move to version 8 docker deployment and was wondering how can we create multiple queues (celery workers) in this deployment. Also how can we set the celery worker parameters as in legacy deployment it is very easy to modify the celery worker parameters

Thanks

2

You can add more workers by defining additional services in docker-compose.yaml. Make sure the command is worker. Then you can configure the relevant ENV VARS using the environment key.

adhoc_worker:
    <<: *redash-service
    command: worker
    environment:
      QUEUES: "queries"
      WORKERS_COUNT: 2