## (Solved) 2. Let X1,X2, . .. be independent random variables such taht P(X,- = j) = 04,-, for 0 S j S J. Say that a record occurs at time n 2 1 if Xn > maX{X1,...

2. Let X1,X2, . .. be independent random variables such taht P(X,- = j) = 04,-, for 0 S j S J. Say that a record occurs at time n 2 1 if Xn > maX{X1, . . . ,X,,_1}, Where X0 2 â€”00, and if a record occurs at time n, call Xn the record value. Let R,- denote the i â€” th record value. (a) Argue that {R,- : i 2 1} is a Markov chain and compute its transition probabilâ€” ities. Classify the states of the chain in transient, recurrent (positive or null), absorbing, etc. Is there a stationary distribution for the chain? Is there a limiting distribution? Are these unique? Consider two cases: J 2 00 and J < 00. (b) Let T,- denote the time between the ith and (i + 1)th record. Is {T,-,i 2 1} a Markov chain? What about {(R,,T,-),i 2 1}? Where appropriate, compute transition probabilities and classify the states of the chain.
This text was automatically generated from the attachment. Please refer to the attachment to view this question.
This question was created from Final Exam https://www.coursehero.com/file/11595603/Final-Exam/?focusQaId=10508993

Solution details:
STATUS
QUALITY
Approved

This question was answered on: Sep 05, 2019

Solution~000200235156.zip (25.37 KB)

This attachment is locked

We have a ready expert answer for this paper which you can use for in-depth understanding, research editing or paraphrasing. You can buy it or order for a fresh, original and plagiarism-free solution (Deadline assured. Flexible pricing. TurnItIn Report provided)

STATUS

QUALITY

Approved

Sep 05, 2019

EXPERT

Tutor