Not quite sure how to get started with Parabola - I have two main source csv files which get generated daily and uploaded to an AWS bucket. Each file can have. thousands of rows.
I want to build a flow that will grab the new files each day, check if anything has changed in either of them vs the previous day’s files, and if so then grab the newest file and run a moderately complicated series of transformations on the date.
I’ve already figured out how to tackle the transformations, but I’m not that sure how to manage automated daily file upload and check for changes.
Would appreciate a bit of help getting pointed in the right direction!