Submit your innovative use case or inspiring success story to the 2023 Dataiku Frontrunner Awards! LET'S GO

Spark on Kubernetes

Level 1
Spark on Kubernetes
In Install guide, it talks about Spark on Hadoop-YARN. Does DataIKU support spark on kubernetes cluster? if yes, then is hadoop install required? . Please link any doc or article in this matter if available.
0 Kudos
1 Reply


DSS is capable of pushing computation to a Kubernetes cluster, you can find more information in this page. You don't need HDFS for it to work. 

Have Fun!

0 Kudos