Spark configurations per user group
NJ
Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 4 Partner
Hi,
we need to assign a Spark property for each user group, specifically the Yarn queue (spark.yarn.queue).
In the Spark section of the Dataiku configuration, we can create multiple Runtime Configurations, but we can't set permissions so that each user group has access only to the allowed ones.
1. Is it possible to use admin properties in the definition of Spark configurations?
2. Would the "Final" option prevent the user from being able to modify the value of this property?
See attached image
Any other suggestion to achieve our goal is welcome.
Thank you in advance
Best Regards