Life cycle of local hugging face model pod

성식
성식 Registered Posts: 4

hello

I now want to use Dataiku by deploying it as a pod on K8s using the local hugging face model.

However, when you deploy a model as a Pod, the Pod automatically exits after a certain time (gracefull exit).
And I know that I can change this time by adjusting the idle time in settings -> llm mesh -> huggingface, but I don't know how to make the pod permanently available.

Setup Info
    Tags
      Help me…