Non of the queries are auto refreshing. I am specifically referring to the queries and not the dashboards. The queries work and update if manually triggered. Restarting all the redash processes has no effect. In the system status page the Last Refresh row has not date of time. Both the ‘IN PROGRESS’ and ‘WAITING’ queues are empty. The ‘DONE’ page lists all the queries that were manually triggered.
Where do I start looking for the problem?
While troubleshooting the above-mentioned problem I stumbled upon the following error in the log files:
[2017-08-25 08:20:33,727: ERROR/Beat] Process Beat
Traceback (most recent call last):
File “/usr/local/lib/python2.7/dist-packages/billiard/process.py”, line 292, in _bootstrap
self.run()
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 553, in run
self.service.start(embedded_process=True)
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 470, in start
humanize_seconds(self.scheduler.max_interval))
File “/usr/local/lib/python2.7/dist-packages/kombu/utils/init.py”, line 325, in get
value = obj.dict[self.name] = self.__get(obj)
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 512, in scheduler
return self.get_scheduler()
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 507, in get_scheduler
lazy=lazy)
File “/usr/local/lib/python2.7/dist-packages/celery/utils/imports.py”, line 53, in instantiate
return symbol_by_name(name)(*args, **kwargs)
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 358, in init
Scheduler.init(self, *args, **kwargs)
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 185, in init
self.setup_schedule()
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 384, in setup_schedule
self._store = self._destroy_open_corrupted_schedule(exc)
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 372, in _destroy_open_corrupted_schedule
return self._open_schedule()
File “/usr/local/lib/python2.7/dist-packages/celery/beat.py”, line 366, in _open_schedule
return self.persistence.open(self.schedule_filename, writeback=True)
File “/usr/lib/python2.7/shelve.py”, line 243, in open
return DbfilenameShelf(filename, flag, protocol, writeback)
File “/usr/lib/python2.7/shelve.py”, line 227, in init
Shelf.init(self, anydbm.open(filename, flag), protocol, writeback)
File “/usr/lib/python2.7/anydbm.py”, line 85, in open
return mod.open(file, flag, mode)
File “/usr/lib/python2.7/dbhash.py”, line 18, in open
return bsddb.hashopen(file, flag, mode)
File “/usr/lib/python2.7/bsddb/init.py”, line 364, in hashopen
d.open(file, db.DB_HASH, flags, mode)
DBFileExistsError: (17, ‘File exists – BDB0002 __fop_file_setup: Retry limit (100) exceeded’)
boris
3
@HenroRitchie, I have the same problem and the same errors in /opt/redash/logs/celery_error.log.
Were you able to solve it?
lvxin
4
Hi, I solved the problem by removing the error celerybeat-schedule file :
sudo rm /opt/redash/__db.celerybeat-schedule
