Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Hello!
I am a new dataiku user and I was wondering how I could use the dataiku flow for my project to automatically grab the newest data cut from a schema in Snowflake. I have the project setup and manually loaded in the newest data through a Snowflake connection.
Is there a way to
1. Write a code recipe (preferably in R or SQL) that will automatically grab the data I need from the Snowflake connection.
And
2. Have this code grab the newest data in a specific schema (data is named in the following way: data_202301, data_202302, etc).
I know if I was able to use an R script to load the data I could grab the last 6 characters of the data name and find the max of those numbers, but I am not sure if dataiku allows a recipe to be the first step in the flow, or what the R code would be to connect to the data in Snowflake.
Any help is much appreciated!