Submit your innovative use case or inspiring success story to the 2023 Dataiku Frontrunner Awards! LET'S GO

Rename columns with Regular Expressions in a Visual Prepare Recipe

0 Kudos

User Story:

As a Data Analyst or Subject Matter Expert I would like to be able to use a visual prepare recipe to bulk cleanup column names made by the Visual Group, Window, and Pivot recipes.  These recipes often and suffixes to column names like "_max", "_concat", "_min".  I would like to use a visual prepare recipe step to find a subset of columns with a regular expression like *._count and replace the _count with nothing.  

COS

* Don't change the default behavior of the Group by, Window, and, Pivot visual recipes.  If you want to attach these issues there dropping those column name suffixes should be an advanced optional parameter.
 * I would prefer to see this fixed by making the column re-name visual prepare recipe step smarter allowing the all of the usual, single, multiple, pattern, all options for column selection.
* I would prefer to have the renames be able to be done like the one time regular expression rename where you can find the substring in the column name you want to change and the constant you want to change it with.

Notes:

I recognize that this might be a big ask because of Schema Management.  I a recipe step can dynamically rename columns on the fly using patterns and not simply replace constant old with constant new as is currently offered might be challenging.

--Tom
1 Comment
ktgross15
Dataiker

Thanks for the feedback @tgb417 , we've logged this internally and will let you know of any updates.

Status changed to: Acknowledged

Thanks for the feedback @tgb417 , we've logged this internally and will let you know of any updates.