Spark configurations per user group

NJ
Level 2
Spark configurations per user group

Hi,
we need to assign a Spark property for each user group, specifically the Yarn queue (spark.yarn.queue).

In the Spark section of the Dataiku configuration, we can create multiple Runtime Configurations, but we can't set permissions so that each user group has access only to the allowed ones.

1. Is it possible to use admin properties in the definition of Spark configurations?

2. Would the "Final" option prevent the user from being able to modify the value of this property?

 

See attached image

Any other suggestion to achieve our goal is welcome.

 

Thank you in advance

Best Regards

 

0 Kudos
1 Reply
AlexT
Dataiker

Hi @NJ ,


This is not current, but this request has been recorded in the backlog.

Thanks

0 Kudos