AR (augmented reality) coloring book App by Disney Research Lab, color characters in a printed coloring book and inspect using a mobile device. The drawing is detected and tracked, and the video stream is augmented with an animated 3-D version of the character that is textured according to the child’s coloring.
It presents a texturing process that applies the captured texture from a 2-D colored drawing to both the visible and occluded regions of a 3-D character in real time. Developed a deformable surface tracking method designed for colored drawings that uses a new outlier rejection algorithm for real-time tracking and surface deformation recovery.
Content creation pipeline to efficiently create the 2-D and 3-D content. The work has been validated with two user studies that examine the quality of our texturing algorithm and the overall App experience.