Queries Stuck in queue for Longer period than expected

Issue Summary

Recently we have stumbled upon a use-case where due to high number of queries. Most of our queries are going into queued state. Currently we are at Redash v8.0.2 and we have 12 workers allotted to Celery along with 2 workers for adhoc_queries and 1 worker for scheduled_queries. (All mentioned in the docker setup)Want to get more insight in how we should firefight this scenario.

Technical details:

  • Redash Version: 8.0.2
  • Browser/OS: Ubuntu 16
  • How did you install Redash: Github Redash Repo(Docker builds)
1 Like

You need to add more workers to the adhoc_queries queue. If you have 12 celery workers but just two of them dedicated to the adhoc_queries queue then you can only run two queries at a time.