DSS Container execution for other type of recipes than Python/R
Tomas
Registered, Neuron 2022 Posts: 121 ✭✭✭✭✭
Hi,
is there a plan to support container execution (i.e. pushing the job to Docker or Kubernetes) for DSS sync recipes (reading from S3 and writing to HDFS) and for Pyspark recipes? Some of these recipes can cause a significant load on the DSS node, and it would be nice to have a possibility to run it on the docker,
Thanks
is there a plan to support container execution (i.e. pushing the job to Docker or Kubernetes) for DSS sync recipes (reading from S3 and writing to HDFS) and for Pyspark recipes? Some of these recipes can cause a significant load on the DSS node, and it would be nice to have a possibility to run it on the docker,
Thanks
Answers
-
Hi,
This is not currently planned.