We're excited to announce that we're launching the second installment of Dataiku Product Days Register Now

Automatic refresh of internal metrics

Solved!
MRvLuijpen
Neuron
Neuron
Automatic refresh of internal metrics

Hi, 

For a project concerning the usage of DSS, I am making use of the internal metrics (Jobs/Cluster/Commits).

With a scenario, I daily "Build" these metrics, however, it seems that they are not refreshed automatically.  

I come to this conclusion because if I do open the internal metrics and refresh the sample, the number of items have increased.

A second thing I noticed is that if I try to use the Metrics on this set, it seems not to be implemented (see screen shot below). Is this correct, or how do I solve this?

Thanks in advance

1 Solution
Clément_Stenac
Dataiker
Dataiker

Hi,

We confirm that metrics-on-the-metrics-datasets are not implemented.

However, if you have a recipe that uses one of these internal datasets, and build the target of this recipe (i.e. run this recipe) through a scenario that forces a build, the data will be updated in real time.

View solution in original post

0 Kudos
3 Replies
Clément_Stenac
Dataiker
Dataiker

Hi,

We confirm that metrics-on-the-metrics-datasets are not implemented.

However, if you have a recipe that uses one of these internal datasets, and build the target of this recipe (i.e. run this recipe) through a scenario that forces a build, the data will be updated in real time.

View solution in original post

0 Kudos
MRvLuijpen
Neuron
Neuron
Author
Thank you Clément for your response
0 Kudos
adamnieto
Neuron
Neuron

@Clément_Stenac , do you know if a "Trigger on dataset change" will work on internal stats datasets when creating a scenario? 

Additionally, are there any API endpoints or classes that can be used get all of the running tasks of DSS? I have used been trying to use the "dataikuapi.dss.future.DSSFuture" class but it doesn't retrieve all of the tasks shown in the /admin/monitoring/background-tasks/ page. This is even when the "all_users=True" parameter is set for "DSSFuture".

0 Kudos
A banner prompting to get Dataiku DSS