Part of my Architecture I have 2 Kubernetes Clusters which have internal load balancers for API Pre Prod and API Prod but now I wanted to know is it better to have an external load balancer? If so what are the pro and cons and how would it work?
Re architecture questions, we'll have to defer to your IT or cluster teams. Depending on the solution you're trying to build, how it will be accessed and expected load, different configurations might be more optimal than others.
It depends of what you are trying to do. Dataiku is generally not something you expose to the web so in general internal load balancers should be preferred.