Hospitalization admission control of emergency patients using markovian decision processes and discrete event simulation

Abstract : This paper addresses the hospitalization admission control policies of patients from an emergency department that should be admitted shortly or transferred. When an emergency patient arrives, depending on his/her health condition, a physician may decide to hospitalize him/her in a specific department. Patient admission depends on the availability of beds, the length of stay (LOS) and the reward of hospitalization which are both patient-class specific. The problem consists in determining patient admission policies in order to maximize the overall gain. We first propose a Markov Decision Process (MDP) Model for determination of the optimal patient admission policy under some restrictive and necessary assumptions such as exponentially distributed LOS. A simulation model is then built to assess MDP admission policies under realistic conditions. We show that MDP policies significantly improve the overall gain for different types of facilities.