SparkR in Cloudera cluster

larispardo
larispardo Registered Posts: 28 ✭✭✭✭✭
in Using Dataiku
Hello, I know this is not exactly a problem on Dataiku, but I was wondering if anybody knows how to make the SparkR integration on cloudera, I have configured everything else, but SparkR in dataiku and I am not sure if it is not supported, does anybody knows how to do this?
Tagged:
· Share on FacebookShare on Twitter

Best Answer

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker
    Answer ✓
    Unfortunately, Cloudera explicitely removes SparkR support from their Spark distribution, so your only option would be to do a custom Spark installation (by downloading, unzipping and configuring a Spark install, and then pointing DSS to it)
    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…