Does dataiku support transaction management such as rollback, commit and two-phase commit?

Options
Yone
Yone Registered Posts: 3

Does Dataiku support transaction management such as rollback, commit, and two-phase commit?

I would like to consider using Dataiku as an ETL tool. But to do that, transaction management is critical. However, I could not find any such functions through Dataiku documentation.

Answers

  • JordanB
    JordanB Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 293 Dataiker
    Options

    HI @Yone
    ,

    DSS comes builtin with Git-based version control. Each project is backed by a regular Git repository. Each change that you make in the DSS UI is automatically recorded in the Git repository. Please see here for more information: https://doc.dataiku.com/dss/latest/collaboration/version-control.html

    Apart from that, DSS integrates with most major databases, which include their own form of transaction management to an extent. Are there specific database that you plan on working with in DSS? Can you describe the critical functions that you need?

    Thanks!

    Jordan

  • Yone
    Yone Registered Posts: 3
    Options

    We would like to use Dataiku as an ETL tool with Greenplum launched by the job controller without close watch by humans, so transaction management is critical so that jobs can be re-run easily. Could you kindly tell me the link to the page that states Dataiku supports transaction management?

  • JordanB
    JordanB Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 293 Dataiker
    Options

    Hi @Yone
    ,

    We do not have specific documentation on transaction management, but again, that is available on the database side. For instance, Greenplum features concurrency control and transaction atomicity. DSS supports the full range of SQL features on Greenplum, here is our documentation regarding the integration: https://doc.dataiku.com/dss/latest/connecting/sql/greenplum.html

    Thanks,

    Jordan

  • Yone
    Yone Registered Posts: 3
    Options

    Thank you.

    So, we can control transaction scope by issuing SQL command.

Setup Info
    Tags
      Help me…