Select Columns Outside of Join Recipe

Laurie
Laurie Registered Posts: 4 ✭✭✭
edited February 10 in Product Ideas

I would like to be able to select the columns of data outside of a join recipe. A couple of examples:

1 - Usage of "unmatched rows". The column selection occurs after the join does not apply to data that isn't joined. In this case I am using both sets of data so need the option to select columns from both sets.

2 - Removal of unneeded/unwanted columns after filtering. This is especially important when using sensitive HR data.

This enhances the automation of processing the data vs. adding to it by doing cleanup after the project has completed running. It also allows me to confirm that I have sensitive data removed before sharing the data with others rather than relying on a manual process to remove it.

2
2 votes

Rejected · Last Updated

Comments

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,329 Neuron

    I am confused, can you not add a Prepare recipe and drop whatever columns you want to remove?

  • Laurie
    Laurie Registered Posts: 4 ✭✭✭

    Thank you, @Turribeach . I found it under "Filter data": Filter data > Delete/Keep columns by name. Although not related to standard filtering, it works very well.

  • Winston
    Winston Registered Posts: 1

    "Filter data" now that is intuitive. 😕

    I guess you could call it "filtering" only in the fact that it is removing data that is not wanted, but that's a first for me to have a filter that removes columns instead of values.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,329 Neuron

    While the "Delete/Keep columns by name" processor shows under the Filter data category you don't really need to use the categories to find processors. Just use the search box. Searching for "delete" or "columns" will show the "Delete/Keep columns by name" processor. You can also select the column heading and select delete. That will add the step for you.

Setup Info
    Tags
      Help me…