Life cycle of local hugging face model pod

Registered Posts: 6

hello

I now want to use Dataiku by deploying it as a pod on K8s using the local hugging face model.

However, when you deploy a model as a Pod, the Pod automatically exits after a certain time (gracefull exit).
And I know that I can change this time by adjusting the idle time in settings -> llm mesh -> huggingface, but I don't know how to make the pod permanently available.

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.