Stochastic processes Markov chain¶ Markov chain - Wikipedia Stochastic matrix - Wikipedia It is also called a probability matrix, transition matrix, substitution matrix, or Markov matrix.