what are the plans for supporting Spark3 in Kubernetes? My understanding is that as of version DSS8 supports Spark 2.4 on Kubernetes. Spark3 comes with a support for dynamic allocation on Kubernetes.
Support for Spark 3.x is currently in our backlog. With that being said, I will make a note of your request and forward it to our product team.
View solution in original post