Allow Queuing on a single view
Need to have a UI to request several backfill in a row on a single view
4
votes
GuillaumeFaure
shared this idea
-
kbobeck
commented
This would be very helpful for us. We sometimes need to backfill for a long period but, if we set it to update the data for the full period (e.g., Jan 1 2021 to Jan 1 2022), we get errors like
[-11148] Maximum number of concurrent bulk queries limit exceeded
[-10722] PINET: Timeout on PI RPC or System Call
That means instead breaking up the backfill into many smaller chunks (e.g., month-by-month) and monitoring the backfill to see when it ends, then queueing the next one. With many Views, this is quite time-intensive. It'd be much easier if we could instead queue all the backfills at once so they start when the previous one finishes.