Survey banner
The Dataiku Community is moving to a new home! We are temporary in read only mode: LEARN MORE

about ML

Level 2
about ML


I'm querious about performance using EC2 type.


I created DSS Instance using 'm5.4xlarge' machine type.


I understood this type is related running etl& training model performance and

normally when i choose stronger machine type, performance will get better.


Q1. if i want to use small machine type to run ETL and 

use powerful machine type to train model, how could i seperate machine type for each task?


Q2. I couldn't find GPU instance list in machine type when i create DSS Instance.

I think this question is related to Q1.

If i want to use GPU instance to train AI/ML model, how?



Daniel Lee

1 Reply

Hi @seungsulee,

We would recommend leveraging Elastic AI in other words containers orchestrated by Kubernetes instead of the DSS instances to perform model training and recipes, Spark, etc. 

You can use GPUs on your K8s clusters instead of the DSS Server itself.

In this case, you don't need a higher spec DSS machine but use ideally a managed Kubernetes cluster/s which you can scale according to your needs. 



0 Kudos