Discrete Markov Chains

  • Introduction
  • Transition matrix
  • Probability vector
  • Steady state
  • Ergodic Markov chain

Introduction

Transition matrix

Probability vector

Steady state

Ergodic Markov chain