Want to Stop Rebuilding "Expensive" Parts of your Flow? Explicit Builds are the Answer!READ MORE

Most optimized way to keep the libraries loaded ?

Mazenode
Level 1
Most optimized way to keep the libraries loaded ?

Hi,

I want to create a realtime API using Dataiku, the thing is that the API will be called a lot per day, but the libraries required for the treatment takes very long to load (about 20 seconds). Is there a way to keep the librairies permanently loaded in the DSS ? So that I only need to run my ML/ DL jobs without having to reload them everytime.

Thanks by advance 

0 Kudos
2 Replies
Clément_Stenac
Dataiker
Dataiker

Hi,

If you create a Python endpoint using the DSS API Designer / API node, the libraries will stay loaded between calls:

https://doc.dataiku.com/dss/latest/apinode/index.html 

 

Best,

 

Mazenode
Level 1
Author

Thank you for your answer, it simplifies a lot of things for me ! 😄

 

Best,

0 Kudos

Labels

?
Labels (3)

Setup info

?
Tags (2)
A banner prompting to get Dataiku