Reorder column list in a Prepare Recipe Move Step

Options
tgb417
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,595 Neuron

User Story:

As a data analyst who likes their columns in a certain order for easy data evaluation I would like to be able to reorder the column names in a move recipe step after initial recipie creation in the same way I can re-order text replacements in a text replacement step. This would save time when I don't get the order correct the first time.

COS:

  • The ability to create the step by dragging columns around and building the step on the fly should continue to work for the last steps in a visual recipe.

Notes

I create long move visual recipe steps sometime with dozens of columns listed in a single step. However, I don't always get the order of the columns correct the first time I create a move recipe step. This leads to having to delete the move step and recreate the move step every time I want to reorder. (I know that I can create another move step but that leads to a messy set of steps in a move recipes).

1
1 votes

New · Last Updated

Comments

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,595 Neuron
    Options

    My work around is to copy the step onto my computers clipboard. Paste the step into a program editor. Edit the json that is the visual recipe step. Then copy the step back into the clipboard. And then paste it into dataiku DSS. However, it would be SOOOO much nicer if I could just drag the column around within the visual recipie on the screen.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,727 Neuron
    Options

    Hi Tom, I am confused, you can already drag and drop columns in the Prepare recipe, just drag them from dots left to the column name. Also you can change to the Columns View you move columns around by drag and drop (again grab them by the dots). This even works if you have a filter so you can move filtered columns relative to each other.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,727 Neuron
    Options

    One solution to avoid having to recreate the Move steps is to group the multiple move steps together so they don't show up as single steps unless you expand the group.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,727 Neuron
    Options

    PS: I think I just figured out what you want, you want the Raw Text Edit mode used in the Text Replacement:

    Screenshot 2024-02-17 at 14.50.21.png

    to be used for Column moves. So you want a Column Text Edit Mode.

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,595 Neuron
    Options

    @Turribeach

    I'm not surprised that this was a bit confusing. Let me take a bit of an additional go on this.

    Once the Column moves get into a recipe step on the left hand side the order is mostly stuck. If you re-order the same column after it is in the move recipe step it typically creates another recipe step. In for example the replace recipe, once you have the ordered set of replaces in place you can then re-order the set of replaces.

    I do see that there is a bit more control when you have the recipe setup to position "at end", it will re-calculate a bit. However, I'm trying to not have multiple move steps at the end of a visual recipe. Even in a group.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,727 Neuron
    Options

    Yeah, I got it now. Having the Column Text Edit Mode will allow not only for multiple reordering actions to be done in a single step, future updates and also allow for multi-select, moving multiple columns at the same time or even taking the column list to an external tool to sort it by whatever condition. So really handy.

    PS: Didn't know about the Raw Text Edit mode in Text Replacements.

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,595 Neuron
    Options

    The Raw Text Edit by it's self would be OK to solve my problem.
    However, what I had envisioned was more like the replace recipe order changes.

    Image: Shows icons that can be used to change the order of items in a recipe step

    However, I did not want to be prescriptive as to method. Your suggestion would also get the same thing done well enough.

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,595 Neuron
    Options

    @Turribeach

    Regarding using groups, my visual recipes are complicated enough. I'd prefer not to have a group just to re-order a few columns. One action one step

Setup Info
    Tags
      Help me…