Application-as-recipes for Python script reusable for different connections
We have turned a flow of Python script recipe into an application-as-recipe we encountered some difficulties making it universal for new input tables that have a different connection/schema/tablename as the original input table. We are interested to learn how other users dealt with this and what best practices are according to the dataiku developers.
Specifics- Is there a way to write a custom python script that takes input table name from the user, or if we can change the connection and input table in the recipe. Also the schema of the table can be different as we take the column number from the user and use that column in our python algo and do not use any specific column.
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,226 DataikerHi @lavee44
In your case since you require a flexible schema, you can consider creating a custom recipe.
You can convert Python Recipe to a plugin and the user can choose the input datasets and output dataset including the connection when a new dataset is being created. See https://doc.dataiku.com/dss/latest/plugins/reference/recipes.html for more information.