by Ehrhard Behrends
The aims of this book are threefold: -- We start with a naive description of a Markov chain as a memoryless random walk on a finite set. This is complemented by a rigorous definition in the framewo…