Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Version: Spark v2.2
sc <- sparkR.session()
-Convert SparkR dataframe to R dataframe for various computations
-Generate Final result in R data-frame
-Generate Recipe output from R data-frame
Syntax used to convert SparkR dataframe to R dataframe:
df_r <- collect(df_s) # this seems to be working
Systax to convert R dataframe to SparkR
result_s <- createDataFrame(sc, df_r)
# Recipe outputsdkuSparkWriteDataset(result_s, "TestTransform")
But it seems this syntax does not work, It fails
What is the failure you are getting? Please post the error message you get.
Post a Question