Discover all of the brand-new features and improvements to existing capabilities in the Dataiku 11.3 updateLET'S GO

Spark on Kubernetes

sjacob
Level 1
Spark on Kubernetes
In Install guide, it talks about Spark on Hadoop-YARN. Does DataIKU support spark on kubernetes cluster? if yes, then is hadoop install required? . Please link any doc or article in this matter if available.
0 Kudos
1 Reply
Omar
Dataiker

Hi,



DSS is capable of pushing computation to a Kubernetes cluster, you can find more information in this page. You don't need HDFS for it to work. 



Have Fun!

0 Kudos