How can I utilize all my machine's cores for building a machine learning model?

okiriza
Level 2
How can I utilize all my machine's cores for building a machine learning model?
Jump to solution
This should correspond to n_jobs in sklearn models' fit method.
0 Kudos
1 Solution

Accepted Solutions
Highlighted
Clément_Stenac Dataiker
Dataiker
Re: How can I utilize all my machine's cores for building a machine learning model?
Jump to solution
Hi,

At the moment, this is only implemented for the RandomForest and SGD algorithms (go to Settings > Algorithms and set the Parallelism option).

Note that if you ask for several algorithms, up to 2 algorithms are trained in parallel (we don't go above that for memory reasons since each algorithm has its own copy of the data).

We'll be soon adding more options for parallelism, including for Grid searching.

View solution in original post

2 Replies
Highlighted
PGutierrez Dataiker
Dataiker
Re: How can I utilize all my machine's cores for building a machine learning model?
Jump to solution
Hi, this can be set in the "Parallelism" parameter. However this is available only for some models, such as Random Forest.
Highlighted
Clément_Stenac Dataiker
Dataiker
Re: How can I utilize all my machine's cores for building a machine learning model?
Jump to solution
Hi,

At the moment, this is only implemented for the RandomForest and SGD algorithms (go to Settings > Algorithms and set the Parallelism option).

Note that if you ask for several algorithms, up to 2 algorithms are trained in parallel (we don't go above that for memory reasons since each algorithm has its own copy of the data).

We'll be soon adding more options for parallelism, including for Grid searching.

View solution in original post

Labels (1)