Scheduled queries not being executed

Support Self Hosted Redash Support
#1

Issue Summary

None of my scheduled queries are being executed in my installation. The scheduler container is running and I’m unable to find any errors in the scheduler container and in general.

What could be the issue?

This is what the scheduler logs at the startup:
scheduler_1 | Starting RQ scheduler…
scheduler_1 | [2020-09-11 13:27:56,653][PID:1][INFO][rq_scheduler.scheduler] Registering birth

Technical details:

  • Redash Version: 9.0.0-beta (2641562b)
  • Browser/OS: Ubuntu 16.04.6 LTS
  • How did you install Redash: docker
#2

No one has a clue?
With debug logging the following gets logged:

mym_new_scheduler_1  | [2020-10-15 10:48:11,408][PID:1][DEBUG][rq_scheduler.scheduler] Entering run loop
mym_new_scheduler_1  | [2020-10-15 10:48:11,408][PID:1][DEBUG][rq_scheduler.scheduler] Checking for scheduled jobs
mym_new_scheduler_1  | [2020-10-15 10:48:11,409][PID:1][DEBUG][rq_scheduler.scheduler] Sleeping 5.00 seconds
mym_new_scheduler_1  | [2020-10-15 10:48:16,413][PID:1][DEBUG][rq_scheduler.scheduler] Entering run loop
mym_new_scheduler_1  | [2020-10-15 10:48:16,414][PID:1][DEBUG][rq_scheduler.scheduler] Checking for scheduled jobs
mym_new_scheduler_1  | [2020-10-15 10:48:16,414][PID:1][DEBUG][rq_scheduler.scheduler] Pushing 372a63e24ac68e3028079685c6c1e8e1a38b9420 to periodic
mym_new_scheduler_1  | [2020-10-15 10:48:16,415][PID:1][DEBUG][rq_scheduler.scheduler] Pushing c33b2b69cac2aa765fa2d2eb42301a0fc1ae774c to periodic
mym_new_scheduler_1  | [2020-10-15 10:48:16,417][PID:1][DEBUG][rq_scheduler.scheduler] Sleeping 5.00 seconds
mym_new_scheduler_1  | [2020-10-15 10:48:21,418][PID:1][DEBUG][rq_scheduler.scheduler] Entering run loop
mym_new_scheduler_1  | [2020-10-15 10:48:21,419][PID:1][DEBUG][rq_scheduler.scheduler] Checking for scheduled jobs
mym_new_scheduler_1  | [2020-10-15 10:48:21,419][PID:1][DEBUG][rq_scheduler.scheduler] Sleeping 5.00 seconds
#3

Status.json after redis flushall:

{
  "dashboards_count": 3,
  "database_metrics": {
    "metrics": [
      [
        "Query Results Size",
        56147968
      ],
      [
        "Redash DB Size",
        64970924
      ]
    ]
  },
  "manager": {
    "queues": {
      "default": {
        "size": 49
      },
      "schemas": {
        "size": 0
      }
    }
  },
  "queries_count": 14,
  "query_results_count": 125,
  "redis_used_memory": 1206928,
  "redis_used_memory_human": "1.15M",
  "unused_query_results_count": 112,
  "version": "9.0.0-beta",
  "widgets_count": 10,
  "workers": []
}
#4

I was able to resolve it after creating a second worker only for scheduled queries and adding the autossh container as dependency.

1 Like