Sometimes 1 user refreshes manually multiple dashboards and that fills queue for a while. That means no one else can use Redash until these queries finish. Is there a way how to limit the number of queries concurrently run by 1 user?

This is an interesting feature but is not currently supported. Maybe you can enforce such a limit on the data source side?