Problem with API rate limit

Feature Requests
1

First off, thanks to the Parabola team for making such a great product, love it!

That said, I’m experiencing a problem with API limits. The API I’m pulling data from has a ridiculously low limit of 20 rows (and no premium version to upgrade to). I’ve gotten around this to some extent by using multiple versions of the API import step … but now have dozens of them and it’s making the flow really slow and clunky to change. I’m now importing hundreds of rows but ideally want to be importing thousands or tens of thousands and I don’t see my workaround as scaling that far. Which leads me to my feature request…!

  1. What is your feature/integration request?
    An ‘API Import Rate Limit Workaround Feature’

It’s similar to the existing API Import step but has some additional fields:

  • Offset start number
  • Offset number (probably equal to the rate limit)
  • Iterations

Once the user has specified the second two fields, another field called ‘Total rows’ might update which is the product of the two (Offset number * Iterations)

When you click ‘Show updated results’ it starts iterating through the offsets until it has received the total number of rows for you.

  1. What problem would this feature/integration solve?
    It would solve getting around an arbitrary rate limit imposed by the source API

  2. How do you solve/workaround this problem today?
    By using dozens of API Import steps which has made the flow really slow and clunky in terms of trying to amend it (it runs just fine)

Thanks