Inpatient observation is important for providing care and assistance to patients. AI and IoT can use gesture recognition, a method that identifies and interprets human gestures from images or videos, to monitor patient activities and detect crucial gestures. The proposed gesture recognition system is capable of monitoring patient activities and differentiating important gestures from regular actions to improve convergence. The system can then provide feedback and alerts to the caregivers or medical staff, who can then respond accordingly.