Running recipes on EKS

Options
sudheer_kumar
sudheer_kumar L2 Admin, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Core Concepts, Registered Posts: 11 ✭✭✭✭

Hello,

Could you please help me to understand how the data reach in EKS cluster while leveraging it through DATAIKU for a recipe.

Answers

  • sudheer_kumar
    sudheer_kumar L2 Admin, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Core Concepts, Registered Posts: 11 ✭✭✭✭
    Options

    I am waiting for the update, could you please help me on this.

  • lpkronek
    lpkronek Dataiker Posts: 13 Dataiker
    Options

    Hello,

    Generally speaking the data will be sent to the pod by the DSS server (design or automation node). The DSS server will itself recover the data from the connection.

    An exception is for spark recipe running on Kubernetes, containerized execution configuration can be configured to provide direct access from the pod to cloud storage connection (S3 for EKS).

Setup Info
    Tags
      Help me…