Discover all of the brand-new features and improvements to existing capabilities in the Dataiku 11.3 updateLET'S GO

Coding the whole machine learning pipeline with custom python scripts

pafj
Level 2
Coding the whole machine learning pipeline with custom python scripts

Hi Dataiku Community,

We have an existing ML model sitting in our VM and we would like to move the entire pipeline (preprocessing, training, scoring, etc. which involves multiple python scripts including a main.py script to run all the remaining scripts in order) into the dataiku for automaton purposes. However, we don't want to use the visual interface. What is the best way to accomplish this approach? 

I went through the knowledge tutorial materials, but I was not able to find anything that shows how to customize the entire pipeline.

Thanks

1 Reply
rolaelsebai
Dataiker

Hi 👋. Thank you for reaching out pafj. This is a common use case! In short, you will be able to bring in the existing ML model into Dataiku. We'll be reaching out directly to understand what you are currently doing in greater detail to determine the best way to transfer such workloads into Dataiku.

Setup info

?
Tags (2)
A banner prompting to get Dataiku