Consider a particle moving on the coordinate plane, and denote the location of the particle at time by . The initial location of the particle is . Also, if , then with probability , with probability , and with probability . Here, it is assumed that , , and the movements of the particle at different time points are independent. Let denote the location of the particle such that for the first time. Answer the following questions.
(1) Show that the probability that is .
(2) For non-negative integers , find the probability that .
(3) For non-negative integers , let denote the probability that .
(a) Find .
(b) Express the probability that given the condition , using .
() Show that .
(4) Express the expectation of using and .
(5) Express the correlation coefficient between and
using and , where denotes the expectation of and denotes the expectation of .
To calculate the probability that , we consider the steps the particle must take to reach the position for the first time. The particle must take one step to the right and two steps up. Since each move is independent and the probability of moving right is , moving up is , and staying in the same place is , the possible sequences of moves that result in the particle reaching can be:
Move right, then move up twice.
Move up, move right, then move up again.
Move up twice, then move right.
The probability for each of these sequences is because the particle has to stay at least once before completing the sequence. There are 3 such sequences, so the total probability is:
To find the probability that , note that this sum represents the total number of steps taken by the particle (where each step is either to the right or upwards). The total number of steps can be distributed between (right steps) and (up steps). If , then , and the probability of taking steps to the right and steps up is:
To find , we need to calculate the probability that the particle never moves to the right, i.e., . This occurs if the particle only moves up or stays in place until it reaches a position where it never moves again. Therefore, is the sum of the probabilities of all possible scenarios where the particle stays in place or moves up any number of times and then stops:
(b) Express the probability that given the condition , using
The probability that given that is the probability that the particle does not stop after steps, given that it hasn't stopped at steps:
To find , we note that and count the number of steps taken in the horizontal and vertical directions, respectively. Since and are dependent (given that they are both influenced by the same random walk process), we calculate the expected value of their product as follows:
First, recognize that and are determined by the number of right steps and up steps, respectively, until the first time the particle stops moving. This stopping is determined by the geometric distribution of taking either a right or up step.
Given that the probability of moving right is , and moving up is , the expected value considers both:
To simplify, we first express as:
Given the symmetry of and :
Recognizing that the series sum over is a known result of the second moment of a geometric distribution: