Q2 Solving MDPs 6 Points Consider the gridworld MDP for which \text{Left}Left and \text{Right}Right actions are 100% successful. Specifically, the available actions in each state are to move to the neighboring grid squares. From state aa, there is also an exit action available, which results in going to the terminal state and collecting a reward of 10. Similarly, in state ee, the reward for the exit action is 1. Exit actions are successful 100% of the time.

Determine the time of the day and month of the year at which the peak sensible cooling load occurs for a top floor, north-eastern corner room of an office building in durban for the following conditions: floor area: 8 x 8 x 3 m east and north walls: 115 mm face brick (outside), 20 mm air space, 115 mm ordinary brick (inside) with 15 mm plaster roof construction: suspended plasterboard ceiling, 450 mm air space, 150 mm concrete, 75mm screed, waterproofing no heat transfer across other surfaces window area 3x 1,5 m high in north wall only. ordinary glass with venetian blinds. lights and occupants : from 07: 00 to 18: 00 average light density: 25 w/m2 number of occupants : 5 seated, light office work room temperature 24°c