How can I compute an exponential moving average in a preparation script?

Highlighted
UserBird Dataiker
Dataiker
How can I compute an exponential moving average in a preparation script?
Jump to solution
 
1 Solution

Accepted Solutions
jrouquie Dataiker
Dataiker
Re: How can I compute an exponential moving average in a preparation script?
Jump to solution
Currently the visual preparation recipes are working line by line. This allows to work on very large datasets by streaming, potentially in parallel on Hadoop. The downside is that each line is processed independently, so, an exponential moving average cannot reliably be done in this type of recipe.

If the dataset fits in memory, I would go with a Python recipe and use the functions from Pandas.

View solution in original post

0 Kudos
1 Reply
jrouquie Dataiker
Dataiker
Re: How can I compute an exponential moving average in a preparation script?
Jump to solution
Currently the visual preparation recipes are working line by line. This allows to work on very large datasets by streaming, potentially in parallel on Hadoop. The downside is that each line is processed independently, so, an exponential moving average cannot reliably be done in this type of recipe.

If the dataset fits in memory, I would go with a Python recipe and use the functions from Pandas.

View solution in original post

0 Kudos
Labels (1)