# Large data set handling

**URL:** <https://community.parabola.io/t/large-data-set-handling/3234>\
**Category:** Feature Requests\
**Tags:** Building-Flows, Integration\
**Created:** [March 1, 2025, 6:37am UTC](https://community.parabola.io/t/large-data-set-handling/3234 "2025-03-01T06:37:06Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![babak\_sanayei](https://avatars.discourse-cdn.com/v4/letter/b/ecd19e/32.png) [@babak\_sanayei](https://community.parabola.io/u/babak_sanayei)\
**Post date:** [March 1, 2025, 6:37am UTC](https://community.parabola.io/t/large-data-set-handling/3234/1 "2025-03-01T06:37:06Z")

</div>

1. What is your feature/integration request? A way to split rows by steps e.g. split in 4, split every 10,000 rows etc etc
2. What problem would this feature/integration solve? Processing and exporting large data sets
3. How do you solve/workaround this problem today? Large number of limit row nodes

---

<div class="post-metadata">

**Author:** ![babak\_sanayei](https://avatars.discourse-cdn.com/v4/letter/b/ecd19e/32.png) [@babak\_sanayei](https://community.parabola.io/u/babak_sanayei)\
**Post date:** [March 2, 2025, 2:40am UTC](https://community.parabola.io/t/large-data-set-handling/3234/2 "2025-03-02T02:40:28Z")

</div>

This is what it looks like when you try divide 400,000 rows into 20,000 row chunks!

 ![divide rows](https://us1.discourse-cdn.com/flex020/uploads/parabola/original/2X/6/69dbf0cc953b97e68e6444d9f7c27f18bcd0eff4.png)

---

<div class="post-metadata">

**Author:** ![Brian2](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@Brian2](https://community.parabola.io/u/Brian2)\
**Post date:** [March 3, 2025, 9:29pm UTC](https://community.parabola.io/t/large-data-set-handling/3234/3 "2025-03-03T21:29:40Z")

</div>

Dealing with the same issue but maxing out on the sends into Shopify… they only allow 5k rows… So I had to set up multiple inventory feeds…

---

<div class="post-metadata">

**Author:** ![Digital\_Marketing](https://avatars.discourse-cdn.com/v4/letter/d/4491bb/32.png) [@Digital\_Marketing](https://community.parabola.io/u/Digital_Marketing)\
**Post date:** [March 6, 2025, 5:40pm UTC](https://community.parabola.io/t/large-data-set-handling/3234/4 "2025-03-06T17:40:28Z")

</div>

Also dealing with this. We have to process a CSV with 7k rows through Enrich with API, but due to the API and Parabola flow timeouts I had to break the file down into separate 500 row files. Would be nice to have some solution