Pyspark Code to Spark Dataframe

verleger Partner, Registered Posts: 2 Partner

I am new to Dataiku. I have been going up and down all over the Dataiku document and trying to make sense of this documentation specially looking into the Dataiku Pyspark code recipe for my project, but I can not find anything useful !. Examples and syntax as simple as how to convert a Dataiku format to spark dataframe ! how to connect to multiple snowflake tables while working in the python notebook in spark recipe ? Details of the the methods of the Dataiku library and what is available , what they do and how to use them ? looks like this class is not even explained well with details on the methods it offers as if interfering unnecessarily with a standard spark libraries which makes the coding harder rather than easier ! if anyone can point out a better link to look at to get more info about all above that will be appreciated.


(Topic title edited by moderator to be more descriptive.)



Setup Info
      Help me…