Announcing the winners & finalists of the Dataiku Frontrunner Awards 2021! Read their inspiring stories

Dataiku S3 storage

akshay
Level 1
Dataiku S3 storage

We have trained our own ML model stored on dataiku local filesystem. We want to keep our model over the S3 bucket and timely fetch and train our model. How can I upload our model over the S3 programmatically or using python?
We will follow following steps:

Retrieve the model -> train the model -> send the model again on the S3 

We can use a managed folder on S3 read operation but what about sending a file to s3 after it's trained?

0 Kudos
1 Reply
akshay
Level 1
Author

We have created a python API endpoint and we are trying to process ML using that.
within the API endpoint python function how can we read the write ML file on the S3 bucket?
We have created the S3 connection and IAM role within the dataiku.

0 Kudos
A banner prompting to get Dataiku DSS