Integration with Microsoft Fabric and its OneLake
Hi,
Couldn't find anything on an integration with Microsoft Fabric through OneLake yet in the Dataiku docs/release notes. Is this coming soon?
As I read the Microsoft docs I understand we can't connect directly via ADLS, only via APIs or SDKs.
Thanks in advance,
Jonathyan
Operating system used: RHEL 8
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,160 Neuron
Microsoft has never been good with APIs. In particular they are pretty bad at supporting APIs on other languages than theirs. I don't believe there is any built-in features for OneLake but there seems to be a way of connecting via Python:
https://learn.microsoft.com/en-us/fabric/onelake/onelake-access-python
That's where I would start.
-
Shashank Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 28 Dataiker
Dataiku latest release has a built-in integration with OneLake SQL - you can learn more about it here:
https://doc.dataiku.com/dss/latest/connecting/sql/onelake.html -
Thank you Shashank for sharing, I already saw this in the updated docs indeed. This seems to be the solution, we’re currently testing it.