subject
Mathematics, 24.03.2021 16:50 Hcalhoun21

During any period, a potential customer arrives at a certain facility with probability 1/2. If there aretwo people in the facility (including the one being served) the potential customer leaves the facilityimmediately and never returns. However, if there is one or fewer people, he enters the facility andbecomes an actual customer. The manager of the facility has two types of service rates available. Ifshe uses her slow service rate at a cost of $3 during a period, a customer will be served and leave thefacility with probability 3/5. If she uses her fast service rate at a cost of $9 during a period, a customerwill be served and leave the facility with probability 4/5. Note that the probability of more than onecustomer arriving or more than one customer being served in a period is 0. A profit of $50 is earnedwhen a customer is served. The manager wants to minimize the expected discounted cost of service over an infinite horizon β=0.9). Required:
a. Formulate the problem as a Markov decision process (e. g. specify the state space, decision set, transition probabilities, expected rewards) Hint: In computing the costs for services, do not forget the opportunity cost of losing a potential customer – e. g. 50$ is lost.
b. Formulate the problem as a linear program to determine the optimal stationary policy.
c. Implement the policy iteration algorithm starting with the stationary policy that always uses slow service. Iterate either until you find the optimal policy or implement 3 iterations.
d. Implement the value iteration algorithm for 3 iterations.
e. In the value iteration algorithm, what is the number of iterations necessary to achieve a desired precision of ε=0.1?

ansver
Answers: 2

Another question on Mathematics

question
Mathematics, 21.06.2019 20:00
Aquadratic equation in standard from is written ax^2= bx+c, where a,b and c are real numbers and a is not zero?
Answers: 1
question
Mathematics, 21.06.2019 21:30
Over the course of the school year, you keep track of how much snow falls on a given day and whether it was a snow day. your data indicates that of twenty-one days with less than three inches of snow, five were snow days, while of the eight days with more than three inches of snow, six were snow days. if all you know about a day is that it is snowing, what is the probability that it will be a snow day?
Answers: 1
question
Mathematics, 22.06.2019 00:10
Write the slope intercept equation for line ab.
Answers: 2
question
Mathematics, 22.06.2019 02:40
Scarlett stopped at a campground along the appalachian trail. the campground had a 12 acre area for tents, divided into 6 equal campsites. scarlett picked one of the sections to pitch her tent. which expression would give you the size of scarlett’s campsite? (more than one answer
Answers: 1
You know the right answer?
During any period, a potential customer arrives at a certain facility with probability 1/2. If there...
Questions
Questions on the website: 13722367