Coloring Book with Augmented Reality

Abstract

Coloring books are one of the earliest opportunities for the children to enhance their creativity in the early growing stages. Unfortunately, the proliferation and popularity of the advanced digital devices has affected the real life activities like coloring the books and children are more attracted towards using and playing with the digital devices. However, given the advantages of digital devices, one cannot stop the children from using the digital devices rather giving the right directions to using these devices. Augmented reality is a relatively new technology which holds great potential to attract users due to its interactivity and can be used to bridge the gap between real-life activities and digital devices. In this project, we present the Coloring Book with Augmented Reality in which children color the provided sketches of different drawn characters and examine their drawings through the developed application. The drawing is detected in real-time and the corresponding 3D model is augmented in the video stream with the same colors provided by the children accompanied with related animations. This has become possible after researching and employing different novel techniques. 3D-model textures are mapped first according to the corresponding image targets which is termed as as UV-mapping. In UV-mapping, we define which part of the 3D-model’s mesh would get the texture from which part of the image target i.e. defining 2D coordinates in 3D coordinates. Live image processing is also employed in which the video frames are processed to extract the image target area to generate the colors defined by the children and then apply that textured image through the mesh renderer to the 3D-model before augmenting it. Finally, the application experience is validated by a user study during the testing procedure and examined through different perspectives.