Does dataiku support transaction management such as rollback, commit and two-phase commit?

[Yone]

Does Dataiku support transaction management such as rollback, commit, and two-phase commit?

I would like to consider using Dataiku as an ETL tool. But to do that, transaction management is critical. However, I could not find any such functions through Dataiku documentation.

[JordanB]

HI @Yone,

DSS comes builtin with Git-based version control. Each project is backed by a regular Git repository. Each change that you make in the DSS UI is automatically recorded in the Git repository. Please see here for more information: https://doc.dataiku.com/dss/latest/collaboration/version-control.html

Apart from that, DSS integrates with most major databases, which include their own form of transaction management to an extent. Are there specific database that you plan on working with in DSS? Can you describe the critical functions that you need?

Thanks!

Jordan

[Yone]

We would like to use Dataiku as an ETL tool with Greenplum launched by the job controller without close watch by humans, so transaction management is critical so that jobs can be re-run easily. Could you kindly tell me the link to the page that states Dataiku supports transaction management?

[JordanB]

Hi @Yone,

We do not have specific documentation on transaction management, but again, that is available on the database side. For instance, Greenplum features concurrency control and transaction atomicity. DSS supports the full range of SQL features on Greenplum, here is our documentation regarding the integration: https://doc.dataiku.com/dss/latest/connecting/sql/greenplum.html

Thanks,

Jordan

[Yone]

Thank you.

So, we can control transaction scope by issuing SQL command.