Would you share a bit more about how you envision it being included in dataiku dss. With my limited knowledge of markov chains models it is my understanding that one needs to look at current and possibly prior records to get the prediction. (Sort of like time series forecasting.) In most cases dataiku models look at one record at a time (forecasting being an exception.)
One other thought is does sci-kit learn support markov models? If so you might be able to add a custom model to dataikuโs visual ml. That said it appears that markov models have been removed from sci-kit learn.
So some more detail might help the team at dataiku understand a bit better what you are looking for.
--Tom
โ11-30-202304:36 PM
Would you share a bit more about how you envision it being included in dataiku dss. With my limited knowledge of markov chains models it is my understanding that one needs to look at current and possibly prior records to get the prediction. (Sort of like time series forecasting.) In most cases dataiku models look at one record at a time (forecasting being an exception.)
One other thought is does sci-kit learn support markov models? If so you might be able to add a custom model to dataikuโs visual ml. That said it appears that markov models have been removed from sci-kit learn.
I would expect it to work indeed a bit like with Time Series Forecasting at the data level.
Markov needs an ordered series of events (states) per unique identifier (ie customer).
These states are structured into paths and the model calculates probabilities of going from one state to a given next state, taking into account one or more previous states.
These models can be used for example for channel attribution (how much did each state contribute to the desired end result) or calculating what the most probable path is to go from state A to state B.
Highly useful (still!) in all sorts of marketing contexts.
Markov was removed from sklearn, but it wouldn't have worked as a custom model in a regular prediction VisualML anyway due to the ordered series requirement of the underlying data.
โ12-14-202311:55 AM
I would expect it to work indeed a bit like with Time Series Forecasting at the data level.
Markov needs an ordered series of events (states) per unique identifier (ie customer).
These states are structured into paths and the model calculates probabilities of going from one state to a given next state, taking into account one or more previous states.
These models can be used for example for channel attribution (how much did each state contribute to the desired end result) or calculating what the most probable path is to go from state A to state B.
Highly useful (still!) in all sorts of marketing contexts.
Markov was removed from sklearn, but it wouldn't have worked as a custom model in a regular prediction VisualML anyway due to the ordered series requirement of the underlying data.
