Fully Port DSS to ARM / Apple Silicon

This may be too obvious : 

User Story: As a Macintosh user who has enjoyed using DSS on my local computer, it would be great to use Dataiku DSS on a New Apple Silicon Computer. 

Value Proposition: 

  1. Having DSS working on Macintosh Computers has been an excellent entry point for folks interested in using DSS.  Installing DSS has been easy.  In two or three years Dataiku will lose this advantage of the ease of entry if it only supports Intel Computers. (With Version 11.0.1 this seems to be the case.) 
  2. Given the significant CPU & GPU performance gains in the first generation of the Apple M1 chip, it is likely that Appleโ€™s Macintosh will be a performance leader in the laptop and desktop space for several years to come. However, to get those performance improvements DSS will need to support native Apple silicon (ARM64) instruction sets. 
  3. Give the custom Neural Network Processor in the Apple Silicon Chips it is likely that there will be development that can uniquely be done within the M1 Macintosh environment. 

 

--Tom
20 Comments

Here is a link to an eager person asking about DSS on Apple Silicon.  

 

https://community.dataiku.com/t5/Setup-Configuration/DSS-on-ARM-or-AMD-Ryzan-9-Processors/m-p/9795/h...

--Tom

Here is a link to an eager person asking about DSS on Apple Silicon.  

 

https://community.dataiku.com/t5/Setup-Configuration/DSS-on-ARM-or-AMD-Ryzan-9-Processors/m-p/9795/h...

fsergot
Dataiker

Hello,

this support is indeed in our radar since the announcement from Apple, As said in the link, this is far from trivial but we know the importance of the Mac users community around DSS

Status changed to: In Backlog

Hello,

this support is indeed in our radar since the announcement from Apple, As said in the link, this is far from trivial but we know the importance of the Mac users community around DSS

DMKnemeijer
Level 2

I support this! Not only would this enable Mac users to install Dataiku on their machines, but this will also allow us to migrate our Cloud Dataiku installation over to EC2 instances that are using the newer, ARM-based Graviton processors, which would lead to a much better price/performance 

I support this! Not only would this enable Mac users to install Dataiku on their machines, but this will also allow us to migrate our Cloud Dataiku installation over to EC2 instances that are using the newer, ARM-based Graviton processors, which would lead to a much better price/performance 

It would be great to be able to install Dataiku on ARM devices without Intel emulation.

Marvell and Ampere servers are rising in popularity in enterprise. Microsoft is also rumored to be working on ARM server hardware. ARM laptops are also becoming very popular, where users may like to install Dataiku locally for offline/local convenient data processing ability (I'm in that camp). This would be especially nice for mobility, especially when using limited mobile data plans. Running on locally on a Surface device or a Chromebook would be awesome for doing quick data exploration, validation, and processing on the go without needing to upload a large dataset to a server (e.g. field service type data analysis use-cases).

It would be great to be able to install Dataiku on ARM devices without Intel emulation.

Marvell and Ampere servers are rising in popularity in enterprise. Microsoft is also rumored to be working on ARM server hardware. ARM laptops are also becoming very popular, where users may like to install Dataiku locally for offline/local convenient data processing ability (I'm in that camp). This would be especially nice for mobility, especially when using limited mobile data plans. Running on locally on a Surface device or a Chromebook would be awesome for doing quick data exploration, validation, and processing on the go without needing to upload a large dataset to a server (e.g. field service type data analysis use-cases).

Baseltov
Level 2

Unfortunately still waiting on this. I have a new MacBook Pro with M1 Pro chip, but DSS does not run natively. 

Unfortunately still waiting on this. I have a new MacBook Pro with M1 Pro chip, but DSS does not run natively. 

@Baseltov 

+1 here.  I'm still hopeful.

There are some discussions here in the Dataiku Community of folks making attempts at this.  

https://community.dataiku.com/t5/Setup-Configuration/Dataiku-support-for-mac-m1/td-p/20772

https://community.dataiku.com/t5/Setup-Configuration/DSS-fail-to-install-on-Mac-M1/m-p/12295/highlig...

 

--Tom
Baseltov
Level 2

@tgb417 

Nice to see the community working on this, but there should be an official release compatibel with Apple Silicon.

@tgb417 

Nice to see the community working on this, but there should be an official release compatibel with Apple Silicon.

What's the latest on this? The market is quickly moving into this direction, PyTorch just announced support for Metal for native Apple Silicon GPU training of ML models. Also note this stat from Apple: "50% of Customers Purchasing a Mac in Q2 2022 Were New Mac Users". 

 

https://pytorch.org/blog/introducing-accelerated-pytorch-training-on-mac/

https://www.macrumors.com/2022/04/28/mac-users-q2-2022-new-to-mac/

 

 

What's the latest on this? The market is quickly moving into this direction, PyTorch just announced support for Metal for native Apple Silicon GPU training of ML models. Also note this stat from Apple: "50% of Customers Purchasing a Mac in Q2 2022 Were New Mac Users". 

 

https://pytorch.org/blog/introducing-accelerated-pytorch-training-on-mac/

https://www.macrumors.com/2022/04/28/mac-users-q2-2022-new-to-mac/

 

 

Baseltov
Level 2

The community page with the name โ€˜DSS on Mac with M1 chipโ€™ has been deleted. On that topic, @CoreyS gave a solution, that apple silicon was supported in DSS 11. But now that topic has been removed and I see no mention of Apple Silicon M1 chip support in the release notes of DSS 11.0. 
@CoreyS can you confirm this solution? Could you also make sure why there then is no mention in the release notes? Seems like a huge thing to announce there!

The community page with the name โ€˜DSS on Mac with M1 chipโ€™ has been deleted. On that topic, @CoreyS gave a solution, that apple silicon was supported in DSS 11. But now that topic has been removed and I see no mention of Apple Silicon M1 chip support in the release notes of DSS 11.0. 
@CoreyS can you confirm this solution? Could you also make sure why there then is no mention in the release notes? Seems like a huge thing to announce there!