Manual importation of a bundle from the dev node to the auto node
Hello Everyone,
Line the title suggest i encountered an issue while importing a project bundle from the Development node to the Automation node, i have 2 datasets, one big query and one GCS like shown under.
It worked really well in the development node but while trying to launch the steps from the bundle in the automation mode, it failed due to a connection timeout.
which is weird cause the GCS connection works in the dev mode and it has been added in the automation mode and the test is positive.
I tried to rebundle again but this time while including the 2 datasets in the "configure content" section but i also got an failed error while trying to activate the datasets ("WARN_BUNDLE_ACTIVATE_DATASET_LOAD_FAILED").
Any help would be greatly appreciated.
Anyone knows how to resolve it
Answers
-
JordanB Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 296 Dataiker
Hi @gikeylian
,Are you using the Project Deployer to transfer the project bundle or are you manually importing the bundle zip file?
Can you please take a screenshot of the error that you see?
Have you set up connection remapping? https://knowledge.dataiku.com/latest/data-sourcing/connections/tutorial-remap-connections.html
Please make sure that you have write permissions on the connection you are using on the target instance.
Thanks,
Jordan -
hey @JordanB
,im using manually importing the bundle into the Automation node,
here is a screenshot of the error i encounter when im recieving when i try to activate the bundle.
Also i about the remapping i already made the connections to big query and GCS in the settings and the test is Good,
but i dont see any remapping options when im uploading the zipfile
do you think it would be a permissions issue, or is it totally different ? -
JordanB Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 296 Dataiker
Hi @gikeylian
,It's difficult to tell without seeing an instance diagnostic. If you will be using the same connection in the target instance, the permissions should remain the same. However, if you are remapping to a different connection definition, then yes, please check that you have write permissions as this could potentially be the issue.
My recommendation would be to remove these bigquery datasets from the configured content and rebundle (you can reconnect the datasets later in the target instance). You mentioned receiving some sort of connection time out error when doing it this way, can you please send me a screenshot of this error?
Thanks!
Jordan
-
Sure @JordanB
, i can provide you with an instance diagnosis,and i did rebundle the package without the datasets and here are the errors i got :
and im sorry the full diagnosis size is too big to be uploaded here
-
JordanB Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 296 Dataiker
Hi @gikeylian
,I would not recommend sending a diagnostic on the community forum - can you please send us a message at support@dataiku.com (https://doc.dataiku.com/dss/latest/troubleshooting/obtaining-support.html#editor-support-for-all-other-dataiku-customers)
Please attach a diagnostic of the TARGET DSS instance (the instance where you are importing the bundle), under (Administration > Maintenance > Diagnostic tool) and send the resulting file.If the resulting file is too large for mail (> 15 MB), you can use https://dl.dataiku.com to send it to us. Please don't forget to send the link that is generated when you upload the file.Thanks!Jordan