Dataiku S3 storage

Options
akshay
akshay Partner, Registered Posts: 7 Partner

We have trained our own ML model stored on dataiku local filesystem. We want to keep our model over the S3 bucket and timely fetch and train our model. How can I upload our model over the S3 programmatically or using python?
We will follow following steps:

Retrieve the model -> train the model -> send the model again on the S3

We can use a managed folder on S3 read operation but what about sending a file to s3 after it's trained?

Answers

  • akshay
    akshay Partner, Registered Posts: 7 Partner
    Options

    We have created a python API endpoint and we are trying to process ML using that.
    within the API endpoint python function how can we read the write ML file on the S3 bucket?
    We have created the S3 connection and IAM role within the dataiku.

Setup Info
    Tags
      Help me…