How can I utilize all my machine's cores for building a machine learning model?

okiriza
okiriza Registered Posts: 5 ✭✭✭✭
This should correspond to n_jobs in sklearn models' fit method.

Best Answer

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker
    Answer ✓
    Hi,

    At the moment, this is only implemented for the RandomForest and SGD algorithms (go to Settings > Algorithms and set the Parallelism option).

    Note that if you ask for several algorithms, up to 2 algorithms are trained in parallel (we don't go above that for memory reasons since each algorithm has its own copy of the data).

    We'll be soon adding more options for parallelism, including for Grid searching.

Answers

Setup Info
    Tags
      Help me…