Abstract:
Human-Computer Interaction (HCI) between a human and a computer can be used to
develop a user-friendly interface. Gestures are one of the ways to interact non-verbally in
HCI. Gesture recognition is used to convey information to a system or to control it;
therefore it can replace some of the hardware devices used to control computer activities.
Recognizing gestures in real-time became more feasible due to the advancements in the
fields of pattern recognition and Image Processing.
This is a documentation of a project that implements an algorithm that can be used to
track and recognize hand gestures for drawing on a board. This algorithm depends on three
steps: hand tracking, hand detection, and fingertip detection. For hand tracking the Mean-
Shift algorithm is used, which is used to track non-rigid objects based on their histogram.
For the hand segmentation, a simple background subtraction and threshold is used and it is
also used to detect the fingertip of the pointer finger.