"Markov process is a fixed set of states, fixed transition probabilities. You can get from any one state to any other, and then you get an equilbrium. So that equilibrium doesn't depend on where you start, it doesn't depend on interventions. And
"To explain this model its' best to give the example of countries. Countries that can be free, partly free or run by dictators (not free). Start from a 2 state democracy model -> 5% of democracies switch to dictatorship and 20% the
" Markov convergence theorem that says the process is going to go to a unique equilibrium. If you rule out simple cycles, and just assume finite states, fixed probabilities, can get from any state to any other, then you get an equilibrium.
"For example, in the case of the alert and bored students. People are moving from alert to bored. But if I think in terms of probabilities, that probability is staying fixed. That probability is staying fixed at 5/9. People are moving around,
"In probability theory, a Markov model is a stochastic model used to model randomly changing systems.[1] It is assumed that future states depend only on the current state, not on the events that occurred before it (that is, it assumes the Markov