-
Re: How to programmatically set the Spark Config
Hi @JH , Indeed it is the case that the spark-submit configurations come from the associated spark configuration, and not configuration parameters set in a code recipe, if you are using a PySpark rec…1 · -
Re: Create a SparkSQL Recipe With API
Hi @selchheb , You can use the type spark_sql_query for spark sql recipes! For example: from dataikuapi.dss.recipe import DSSRecipeCreatorrecipe_creator = DSSRecipeCreator("spark_sql_query"…1 · -
Re: Reading compressed pickled files from managed folder using joblib
Hi @pkansal , You can read objects from managed folders, including pickle files like so: import dataikufolder = dataiku.Folder("folder_name")with folder.get_download_stream(pickle_file) as …1 · -
Re: Queuing Scenarios with Webapp
Hi @chrisfeagles , I think that this might still lead to the same issues, because if the template scenario is paused waiting for the other scenarios to complete, then that template scenario won'…1 · -
Re: Apply preparation Script on dataiku api
Hi @Echternacht , There are two options that I see here. When you train a model using Visual ML, the preparation script will automatically be applied to the input dataset. If you want to simply run a…1 ·
