Redis Queue & Scheduling Monitoring / Visibility

Issue Summary

I was wondering what is the best way to get visibility into all the jobs being run, failures, etc. to make it easier to debug. In development environment I have been using RQ Dashboard: GitHub - Parallels/rq-dashboard: Flask-based web front-end for monitoring RQ queues and it shows me a UI of all the jobs that have run, their IDs, and failures which is super helpful. Does anyone know how to use RQ Dashboard in a production environment?

For example, if I have a query that runs every day, but I’m suspicious that for some reason something went wrong yesterday - maybe the query somehow got skipped, or it failed due to a timeout, or it ran but the result was unexpected - what is the best way to debug this? I know I can go into my box and look at all the logs but there’s a ton of logs so it’s not easy to get visibility. I know there’s some info if I go to /admin/status but still not enough to debug.

Thanks!

Technical details:

  • Redash Version: 9
  • Browser/OS: Mac
  • How did you install Redash: AWS AMI
1 Like