Data Quality Checks in a flow

Options
unkxowx
unkxowx Registered Posts: 19

Hi everyone,

I have a quick question:

I am importing datasets from snowflake, in a proper flow i.e., source -> warehouse -> data mart.

1) can either create them again in dataiku (double work) OR is there a way that this whole staging process goes in a proper sequential manner within the dataiku?

2) In this whole flow i want to add a few data quality checks such as checking for nulls, mismatching of IDs from one stage to another and duplications based on a few keys.

How could I enable it here in dataiku?

Best Answer

Answers

Setup Info
    Tags
      Help me…