User Story:
As a data analyst that is trying to debug a flow with large datasets, I would like to be able to set a filter on datasets, And then when I get back to the flow use the preview to see the transformation that occurs to my selected set of records as it is transformed throughout the flow.
Conditions of Satisfaction:
- This needs to run similarly fast to the display of records when looking at just the one dataset by itself.
Nice to Items:
- It would be nice to have a toggle button in the flow preview that one could click to respect and not respect the filters.
Notes:
- Today to do this type of analysis you need to maintain lots of different tabs each looking at each step in the flow. Once filtered being able to go to the flow and click on each of the steps and see what happens without actually changing the steps of the flow would be nice
- I guess I could put a new step temporarily upstream in my flow that only allows the record I care about to get through the flow. However, in some cases of incrementally updates datasets that would not be possible because I would likely loose days of data processing. The looking at the results of the sample filters is less destructive of the underlying data sets.
--Tom