Publishing Feature Groups in the Dataiku Feature Store from a Prod Node to a Dev Node
We've used a Dataiku project on the Design Node to produce a number of shared data assets. These are published as Feature Groups in the Feature Store where other users can bring them into their own projects. When the project producing the shared datasets is promoted through Test and Prod environments, is there a way the Feature Store on the Design Node can reference the project and datasets from Prod? We don't want users basing their work on a Dev project that doesn't have the same pull request and change request requirements as Prod.
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,161 Neuron
Feature Groups are basically shared datasets which appear in the Feature Store. Aside from their appearance in the Feature Store they are no different than other shared datasets. So if you want to expose your Production datasets in the Design node you will need to create a new Production connection and make sure your datasets in the Design Node use that connection to hit the prod data.