-
Re: How to programmatically set the Spark Config
Hi @JH , Indeed it is the case that the spark-submit configurations come from the associated spark configuration, and not configuration parameters set in a code recipe, if you are using a PySpark rec…1 · -
Re: Create a SparkSQL Recipe With API
Hi @selchheb , You can use the type spark_sql_query for spark sql recipes! For example: from dataikuapi.dss.recipe import DSSRecipeCreatorrecipe_creator = DSSRecipeCreator("spark_sql_query"…1 · -
Re: Reading compressed pickled files from managed folder using joblib
Hi @pkansal , You can read objects from managed folders, including pickle files like so: import dataikufolder = dataiku.Folder("folder_name")with folder.get_download_stream(pickle_file) as …1 · -
Re: Queuing Scenarios with Webapp
Hi @chrisfeagles , I think that this might still lead to the same issues, because if the template scenario is paused waiting for the other scenarios to complete, then that template scenario won't be …1 · -
Re: Apply preparation Script on dataiku api
Hi @Echternacht , There are two options that I see here. When you train a model using Visual ML, the preparation script will automatically be applied to the input dataset. If you want to simply run a…1 ·
