Digital Beethoven An Android Based Virtual Piano

Abstract

Smart phones with high resolution cameras have enabled innovative computer vision applications that apply techniques like real-time image processing and virtual reality to provide a close approximation of reality. In this paper, we present an Android application that allows users to play a virtual piano by using a keyboard drawn on a piece of paper. The application allows the user to point the camera of a hand held device towards the keyboard, and process image of the paper keyboard in real time. The application then detects fingers placed on a key and after key detection plays the corresponding sounds. Initial results demonstrate the potential of such an application in providing a viable replacement for heavy and expensive instruments.