Select Columns Outside of Join Recipe

Registered Posts: 4 ✭✭✭
edited February 10 in Product Ideas
2
2 votes

Rejected · Last Updated

I would like to be able to select the columns of data outside of a join recipe. A couple of examples:

1 - Usage of "unmatched rows". The column selection occurs after the join does not apply to data that isn't joined. In this case I am using both sets of data so need the option to select columns from both sets.

2 - Removal of unneeded/unwanted columns after filtering. This is especially important when using sensitive HR data.

This enhances the automation of processing the data vs. adding to it by doing cleanup after the project has completed running. It also allows me to confirm that I have sensitive data removed before sharing the data with others rather than relying on a manual process to remove it.

Welcome!

It looks like you're new here. Sign in or register to get started.

Comments

  • Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,371 Neuron

    I am confused, can you not add a Prepare recipe and drop whatever columns you want to remove?

  • Registered Posts: 4 ✭✭✭

    Thank you, @Turribeach . I found it under "Filter data": Filter data > Delete/Keep columns by name. Although not related to standard filtering, it works very well.

  • Registered Posts: 1

    "Filter data" now that is intuitive. 😕

    I guess you could call it "filtering" only in the fact that it is removing data that is not wanted, but that's a first for me to have a filter that removes columns instead of values.

  • Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,371 Neuron

    While the "Delete/Keep columns by name" processor shows under the Filter data category you don't really need to use the categories to find processors. Just use the search box. Searching for "delete" or "columns" will show the "Delete/Keep columns by name" processor. You can also select the column heading and select delete. That will add the step for you.

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.