Gesture controlled interactive environment using a Webcam (P-0630) (MFN 6776)

Abstract

This report describes the working of a "Gesture Controlled Interactive Environment using a Webcam". It is a perceptive user interface that lets user to interact with a computer using hand gestures. Gesture Controlled Interactive Environment is a desktop application based on python programming language and it runs on windows operating system which detects user's hand movements from a simple webcam and allows user to interact with the system (PC or laptops) without any external hardware or sensors. The system will detect multiple color points (yellow, red and blue) on the user's body enabling a seamless human computer interaction. The yellow red and blue color on user's fingertips is captured by a simple webcam and converted into HSV format. User needs to calibrate the colors by adjusting hue, saturation and value according to the requirement. After calibrating the colors, the application can detect the color and by the help of color detection our application is able to recognize user's hand movements. The main goal of our system is to track and recognize basic human hand gestures and process them to playa game on personal computers without using any external device. Other than playing games, this program can be implemented further for medical systems and assistive devices, automation systems and for smartphones in the future. The main priority of this system is to create a simple, easy and user-friendly environment without making any special hardware