Texturing of AR Characters from Colored Drawings

Coloring books capture the imagination of children and provide them with one of their earliest opportunities for creative expression. However, given the proliferation and popularity of digital devices, real-world activities like coloring can seem unexciting, and children become less engaged in them. Augmented reality holds unique potential to impact this situation by providing a bridge between real-world activities and digital enhancements. In this paper, we present an augmented reality coloring book App in which children color characters in a printed coloring book and inspect their work using a mobile device. The drawing is detected and tracked, and the video stream is augmented with an animated 3-D version of the character that is textured according to the child’s coloring. This is possible thanks to several novel technical contributions. We present a texturing process that applies the captured texture from a 2-D colored drawing to both the visible and occluded regions of a 3-D character in real time. We develop a deformable surface tracking method designed for colored drawings that uses a new outlier rejection algorithm for real-time tracking and surface deformation recovery. We present a content creation pipeline to efficiently create the 2-D and 3-D content. And, finally, we validate our work with two user studies that examine the quality of our texturing algorithm and the overall App experience.

Polar interactive augmented table

Polar interactive augmented table is the first iteration of an interactive content presenter designed for the young and tech savvy audience of Hellospace Brussels.

For the tabletop interaction it was clear we could not use traditional input methods and UI conventions, as the table is not a computerscreen. Likewise, the depth and amount of content would be different than for example on a kiosk touchscreen. In this environment the main use case instead would be brief explorations of basic content on the programme in the venue and the different product features of Hello Bank.

NOXX² Augmented Sculpture. Projection Mapping installation - Club NOXX² Antwerp - Augmented Sculpture. noxxantwerp.com Source