Digital Beethoven : An Android Based Virtual Piano

Abstract

With the passage of time, Mobile Application Development is growing rapidly because of the market demand by users. Mobile application developers are attempting to use various methods to make these applications diverse and user friendly. Therefore, mobile applications are becoming cheaper and profit popularity. Use of real time processing and virtual reality in android development is very less. Therefore, our project is mainly focus on real time processing using image processing techniques. The main objective of this project is to build up an android application that uses hand drawn or printed piano keys on paper to give the feel of playing real piano to the user.Now a days, every modern piano consists of total 88 keys with seven octaves plus a minor third. All the keys on the piano keyboard have a letter name. Each key is named from the letters of the musical alphabets which are A,B,C,D,E,F,G. These letters are assigned to white keys and black keys also have specific letter names. Black keys are called sharp or flat keys because the specific letter name is accompanied by a sharp or flat. Our application consists of first full octave with half of the second octave. A piano console with maximum 17 keys with the pattern of C, C#, D, D#, E, F, F#, G, G#, A, A#, B, C, C#, D, D#, E is drawn utilized a dark black thick pen on paper, and is set in a blessed messenger that gives the ideal perspective of the piano console when the camera turned on. The application begins with a camera shot of the piano, without fingers in the view. The user can then begins playing on the drawn piano, like playing on a real piano. The application performs detection of piano keys, finger and keystrokes and then plays the sound accordingly. The necessary functionality is provided using OpenCV Manager which focuses on real-time image processing and computer vision.