Exported Data Objects Represented in the Instance Data Calaloge
User Story:
As a data analyst who have found that my DSS design node has grown very large, I would like to see at least some reference to export folders in the data catalog. This would reduce confusion and make it a bit easier to manage a DSS Instance.
COS:
- All data or data like objects in a Dataiku Flow appear in the Data Catalog.
Nice to have:
- For exported file folders there is a way to gauge how large the folder has grown.
Background:
- I have some export recipes that export to a file folder. When I look into the data catalog I see no reference to these objects.
Comments
-
Thanks @tgb417
, acknowledged. To be clear - you are requesting to see managed folders in the data catalog, right?Katie
-
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,601 Neuron
Yes, I think so.
"filesystem_folders" is what is on the info tab. Icon is just a blue outline of a folder. No Back Blue Background of the folder icon. In some cases these may be on the local file system, but could also exist on google drive and other places.
And yes the challenges is that they show up on the flow as a data like object, but don't show up in the data catalog. Which was very confusing.
I'm using DSS 12.1.2 at the moment. I know that 12.1.3 is out a few days ago.
