DSS installed on Mac M1

Antonius
Antonius Registered Posts: 4 ✭✭✭✭
edited July 16 in Setup & Configuration

I've got DSS running in my Mac mini M1; I hope this helps. My current system:

Mac mini M1 (macOS 11.2.3)
Java version 8 update 281
Python 3.7.9 (to run the installer)
Python 3.6.8 (for some plugins needing v3.6)
DSS 9.0.1

Installed DSS 9.0.1 (dmg file), ran the application and failed. Then I edited the following (after many trials and fatal failures though)...

Show the package contents and go to:
Contents/Resources/kit/installer.sh

I found this line in the file and edited like this:
BASE_PYTHON=/usr/local/bin/python3.7

After that, and following the documentation for Linux (link), and figuring out how to do the same in Mac I opened the Terminal and ran:

export DKUPYTHONBIN=/usr/local/bin/python3.7

I did a test to see if I did it right with:

echo $DKUPYTHONBIN

Ran DSS application and started in a flash . Not sure if one or both helped but I've got DSS running in my Mac mini M1. I am a happy man . Cheers.

Best Answer

Answers

  • CoreyS
    CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭

    Thanks for sharing your knowledge @Antonius
    ! I went ahead and shared this on the thread.

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

    @Antonius
    ,

    This is really cool. However, it brings up a bunch of questions for me.

    DSS is a really large system. Can you clarify what all you have gotten working and tested?

    Sounds like you have the UI up and running and have been able to log in. Is that correct?

    Are you able to get visual recipes, charting, Visual ML working?

    What data sources have you tried?

    Have you done any work with any of the plugins?

    My guess is that you may have Python Jupiter Notebooks working. Have you tried R, SQL?

    Is this code running natively on ARM or is it running through Rosetta 2? How is the performance?

  • evaie
    evaie Registered Posts: 1 ✭✭✭

    Awesome, It worked perfectly fine for me, thx a lot for the trick !

    (i tried with python3.8 just to see, and it failed, but python 3.7.9 is ok)

  • Alex_Combessie
    Alex_Combessie Alpha Tester, Dataiker Alumni Posts: 539 ✭✭✭✭✭✭✭✭✭
    edited July 17

    Hi @Antonius
    ,

    Congratulations on making it work! I am assuming you are running it with Rosetta (the emulation layer for x86 applications)?

    For other people who may visit this thread, there is an alternative for using python 3.7 as the base Python environment without changing the package content. Follow this tutorial and execute the installation script with this option:

    dataiku-dss-VERSION-osx/installer.sh -d /path/to/DATA_DIR -P python3.7 -p PORT

    Note that this procedure is only valid for new installs. If you have already installed DSS with the DMG file and it works, there is nothing more to do

    Hope it helps,

    Alex

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

    @Alex_Combessie
    ,

    Given the complexity of DSS and all of the integrations. Once installed what level of completeness of features, and level of performance should we currently expect. Are there areas of the system that are known not to be operational at this time? Are some of the special features of the M1 chip in particular available while using DSS. I'm thinking about the Neural Engines, GPUs and Digital Signal Processing components?

  • Alex_Combessie
    Alex_Combessie Alpha Tester, Dataiker Alumni Posts: 539 ✭✭✭✭✭✭✭✭✭

    Hi @tgb417
    ,

    At the moment it is "working" only in Rosetta mode, so M1 specific features cannot be used.

    DSS on Apple Silicon is unsupported and experimental. Visual recipes should work in theory. Python too, provided installed packages work with Rosetta. I haven't tested R. In general, there hasn't been any extensive automated testing of DSS on Apple Silicon.

    Data science on Apple Silicon is very new, and will require a lot of upstream changes to the likes of pandas, tensorflow et al. to become a seamless experience.

    Hope it helps,

    Alex

  • winglight
    winglight Registered Posts: 1 ✭✭✭

    Thanks a lot. I did install dss on mac m1 successfully.

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

    @Antonius
    , @winglight
    , @evaie

    How are things going for you using DSS on an Apple M1 Apple Silicone computer?

    Next Monday Apple is expected to release a number of new Laptops with "M1X" chips likely. I'm wondering about your experience with the viability of an Apple Silicon based computer with DSS to date?

    --Tom

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,049 Neuron

    Interested on this too. Ordered a new M1 Max MacBook Pro so I want to have Dataiku running there too!

    he-man.jpg

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

    @Antonius
    ,

    How is your Apple Silicon version of DSS working currently?

    I've recently started working on a new installation oof DSS11 on a M1 computer.

    How did you install the Python 3.7? This version seem to be Intel only in homebrew, However, it still seems to be required for some things like Visual Machine Learning. I'd guess that you are using Rosetta 2 in some way. Or has anyone found an Apple Silicon / ARM way to run Python 3.7? Folks here who have said that they are successful have not mentioned if you are using some kind of python environment manager like pyenv, or mini conda to support the two pythons you have on the computer.

    I'd appreciate any clues that you can share.

Setup Info
    Tags
      Help me…