Community Conundrum 28: News Engagement is live! Read More

How can I utilize all my machine's cores for building a machine learning model?

Level 2
How can I utilize all my machine's cores for building a machine learning model?
This should correspond to n_jobs in sklearn models' fit method.
0 Kudos
2 Replies
Dataiker
Dataiker
Hi, this can be set in the "Parallelism" parameter. However this is available only for some models, such as Random Forest.
Dataiker
Dataiker
Hi,

At the moment, this is only implemented for the RandomForest and SGD algorithms (go to Settings > Algorithms and set the Parallelism option).

Note that if you ask for several algorithms, up to 2 algorithms are trained in parallel (we don't go above that for memory reasons since each algorithm has its own copy of the data).

We'll be soon adding more options for parallelism, including for Grid searching.
Labels (1)
A banner prompting to get Dataiku DSS