Spark on Kubernetes

[sjacob]

In Install guide, it talks about Spark on Hadoop-YARN. Does DataIKU support spark on kubernetes cluster? if yes, then is hadoop install required? . Please link any doc or article in this matter if available.

[Omar]

Hi,

DSS is capable of pushing computation to a Kubernetes cluster, you can find more information in this page. You don't need HDFS for it to work. 

Have Fun!