For Book: See the link https://amzn.to/2NirzXT This video describes the basic concept and terms for the Stochastic process and Markov Chain Model. The Transition Probability Matrix is also described with Illustrative examples. #OptimizationProbStat Other videos https://www.youtube.com/channel/UC88rUhfKSa5uLYXjRn7H3QQ Lecture 1: Markov Chain & TPM: https://www.youtube.com/watch?v=sb4jo4P4ZLI Lecture 2: Problems using TPM Part 1: https://www.youtube.com/watch?v=arxmRnAdLy4 Lecture 3: Problems using TPM Part 2: https://www.youtube.com/watch?v=4s_FiYYnF4U Lecture 4: Problems using TPM Part 3: https://www.youtube.com/watch?v=XgoClgSEN4c Lecture 5: Stationary Probabilities: https://www.youtube.com/watch?v=zVCB49HYIxM Lecture 6: Chapman-Kolmogorov Equation & Theorem: https://www.youtube.com/watch?v=TptjhklRnqM