how we can achieve Data Lineage in DataIku

preetigupta15
preetigupta15 Registered Posts: 1

How we can achieve table and column decencies in recipes.

Answers

  • Elie
    Elie Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Product Ideas Manager Posts: 32 Dataiker

    Hello @preetigupta15
    ,

    It depends on your use case and what you're trying to do but a first level of answer could be :

    Currently, here are the different ways to do data lineage in Dataiku :

    - Dataset/table level lineage: directly from the flow

    - Column-level lineage: Dataiku 12.5.0 released in January 2024 added a new Flow view called “Column usage”, to see where some given columns appear in your flow

    We're currently working to improve the lineage capabilities. If you're interested in being part of the user test do not hesitate to come back to me.

    Have a nice day

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

    @ElieA
    ,

    Can you point to any knowledge base articles, tutorials or the like that would help us learn more about these features? That would be helpful to me to learn more.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,024 Neuron

    Column Usage is very cool.

  • me2
    me2 Registered Posts: 48 ✭✭✭✭✭

    Can't wait to try it! (our teams are working on upgrading so in a few days)

  • Elie
    Elie Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Product Ideas Manager Posts: 32 Dataiker

    Hello @me2 , Hello @tgb417 ,

    Hope you're doing well.

    Coming back to you on the data lineage topic: the feature has been released in 13.2!

    Please see here a video and all the explanations on the feature and here the ref doc.

    Have a nice day

Setup Info
    Tags
      Help me…