Spark 3 in Kubernetes

Tomas
Tomas Registered, Neuron 2022 Posts: 121 ✭✭✭✭✭
in Setup & Configuration

Hi,

what are the plans for supporting Spark3 in Kubernetes? My understanding is that as of version DSS8 supports Spark 2.4 on Kubernetes. Spark3 comes with a support for dynamic allocation on Kubernetes.

Thanks

Tagged:
· Share on FacebookShare on Twitter

Best Answer

  • ATsao
    ATsao Dataiker Alumni, Registered Posts: 139 ✭✭✭✭✭✭✭✭
    Answer ✓

    Hi Tomas,

    Support for Spark 3.x is currently in our backlog. With that being said, I will make a note of your request and forward it to our product team.

    Best,

    Andrew

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…