Redash taking high disk space

Issue Summary

I see that Redash is taking a lot of space because of Query Result. Every day the new files size is around 80GB, even though i changed the default REDASH_QUERY_RESULTS_CLEANUP_MAX_AGE & REDASH_QUERY_RESULTS_CLEANUP_COUNT to remove any unused data still my DB size is increasing day by day. Is there a way to skip storing data in Query Result or cleaning of this data.

Technical details:

  • Redash Version:8
  • Browser/OS: Ubuntu
  • How did you install Redash: Docker

That’s a lot of disk space! You can’t root out the cache completely because the latest query result is always cached. How much data do you pull in your queries? If you routinely query 80GB of data then the cache is going to be that large.

By default, Postgres doesn’t return used space to the system but reuses it for future data. I believe you can run VACUUM FULL to return disk space, but you better check the docs.

A bit off topic, I think you need to rethink how redash is being used. This seems more like a raw data dump happening. (Assuming people are not running queries on a massive scale). Maybe have a limit on the number of rows returned? (Will have to fork to make your own changes here)

Redash is generally meant for 20-25 MB of aggregated which can be visualized.

1 Like