Spark 3 in Kubernetes

Solved!
tomas
Level 5
Spark 3 in Kubernetes

Hi,

 what are the plans for supporting Spark3 in Kubernetes? My understanding is that as of version DSS8 supports Spark 2.4 on Kubernetes. Spark3 comes with a support for dynamic allocation on Kubernetes.

Thanks

0 Kudos
1 Solution
ATsao
Dataiker

Hi Tomas,

Support for Spark 3.x is currently in our backlog. With that being said, I will make a note of your request and forward it to our product team. 

Best,

Andrew

View solution in original post

1 Reply
ATsao
Dataiker

Hi Tomas,

Support for Spark 3.x is currently in our backlog. With that being said, I will make a note of your request and forward it to our product team. 

Best,

Andrew