Recipe run on Spark from database table

Options
gnaldi62
gnaldi62 Partner, L2 Designer, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Frontrunner 2022 Participant, Neuron 2023 Posts: 79 Neuron

Hi,

my name is Giuseppe Naldi; I'm from Bergamo and I work for ICTeam,

(a company owned by Lutech) as Solution Architect, with an extensive experience

in subjects related to data analysis (from BI to data science and so on).

My question is rather general and is related to the way DSS performs a recipe

using Spark as engine on a dataset coming from a database table.

Namely, are the data from the table accessed by DSS and streamed from memory

to the Spark job or is the access performed directly by Spark ?

From the documentation I understand that it works as per the first way: correct ?

Thanks. Regards.

Giuseppe

Best Answer

Answers

  • gnaldi62
    gnaldi62 Partner, L2 Designer, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Frontrunner 2022 Participant, Neuron 2023 Posts: 79 Neuron
    Options

    OK, it's clear. Thank you.

    Giuseppe

Setup Info
    Tags
      Help me…