-
How to parse filename for file based datasets/partitions
Hi - I know pieces exist to do the following but after reading documentation, discussions, etc. I am not connecting the pieces. I have a folder on AWS S3 that will contain multiple files that start w…3 · -
Re: Spark Pipeline Initial Dataset Creation
Hi Dimitri, Thank you for your explanation and it is very helpful! When you say "you can then clear" what action is this that I would do to clear the dataset off storage? Thank you again! A…1 · -
Spark Pipeline Initial Dataset Creation
I just set up my first flow enabling Spark Pipeline and have a question on the initial setup of a dataset. When I am adding recipes I need to identify a dataset as output. I then go back and check th…1 · -
Re: Calling external API
Hi - thank you for your solution! I have marked it as accepted as well since it shows me how to identify the schema within it. Thanks again for your time! Anne1 · -
Re: Calling external API
Hi Andrew, This is great - thank you so much! I am waiting for the site to be put onto our whitelist but will mark this as a solution because I understand what you are doing and how it would work. Th…1 ·
