Interactive Board Writing On Board Using Pointer Finger

Abstract

Human-Computer Interaction (HCI) between a human and a computer can be used to develop a user-friendly interface. Gestures are one of the ways to interact non-verbally in HCI. Gesture recognition is used to convey information to a system or to control it; therefore it can replace some of the hardware devices used to control computer activities. Recognizing gestures in real-time became more feasible due to the advancements in the fields of pattern recognition and Image Processing.

This is a documentation of a project that implements an algorithm that can be used to track and recognize hand gestures for drawing on a board. This algorithm depends on three

steps: hand tracking, hand detection, and fingertip detection. For hand tracking the Mean- Shift algorithm is used, which is used to track non-rigid objects based on their histogram.

For the hand segmentation, a simple background subtraction and threshold is used and it is also used to detect the fingertip of the pointer finger.