Consider the following problem through the lens of a Markov Decision Process (MDP), and answer questions 1 - 3 accordingly. Damilola is a soccer player for the ML United under-15s who is debating whether to sign for the NLP Albion youth team or the Computer Vision Wanderers youth team. After three years, signing for NLP Albion has two possibilities: He will still be in the youth team, earning 10,000 (60% chance), or he will make the senior team and earn 70,000 (40% chance). Lastly, he is assured of making the Computer Vision Wanderers senior team after three years, with a salary of 37,000. Q1. Given that Damilola only cares about having the highest expected salary after three years, V* (ML United under-15s) is achieved through the action of signing for Computer Vision Wanderers.
A. True
B. False
Let us now assume that Damilola cares about the utility derived from the salary as opposed to the salary S itself. And his utility function, which baffles economists, is given by Utility, U = 192 + 5 where 1,5 > 0, and t & 5 are constants. In this scenario, the optimal policy 7* (ML United under-15s) would be to sign for NLP Albion.
A. True
B. False
3. There are 3 unique states defined in total in this setting.
A. True
B. False