Suppose that a sequence is generated from a first-order stationary Markov model that has initial probabilities and transition probabilities as follows.
Initial probabilities:
Transition probabilities:
Note that is the probability that is true, and is the conditional probability that is true when is true.
Answer the following questions:
(1) Assume . Show the probability that is included as a continuous substring in . Show also the probability that is included as a continuous substring in .
(2) Assume . Show the expected number of 1s in when is included as a continuous substring in .
In the following questions, use the following transition probabilities.
(3) Calculate the expected proportion of 1s in when .
(4) Suppose that ( is a positive integer). When every two letters of is converted to a letter of using the following rule, calculate the expected proportions of in when .
To determine the probability of specific substrings occurring within a Markov sequence, we need to calculate the joint probabilities of these substrings appearing in the sequence.