Intelligent Systems

Real-Time Pixel Luminance Optimization for Dynamic Multi-Projection Mapping

2015

Article

ncs


Using projection mapping enables us to bring virtual worlds into shared physical spaces. In this paper, we present a novel, adaptable and real-time projection mapping system, which supports multiple projectors and high quality rendering of dynamic content on surfaces of complex geometrical shape. Our system allows for smooth blending across multiple projectors using a new optimization framework that simulates the diffuse direct light transport of the physical world to continuously adapt the color output of each projector pixel. We present a real-time solution to this optimization problem using off-the-shelf graphics hardware, depth cameras and projectors. Our approach enables us to move projectors, depth camera or objects while maintaining the correct illumination, in realtime, without the need for markers on the object. It also allows for projectors to be removed or dynamically added, and provides compelling results with only commodity hardware.

Author(s): Siegl, Christian and Colaianni, Matteo and Thies, Lucas and Thies, Justus and Zollhöfer, Michael and Izadi, Sharam and Stamminger, Marc and Frank, Bauer
Journal: ACM Transactions on Graphics (TOG)
Volume: 34
Number (issue): 6
Year: 2015
Publisher: ACM

Department(s): Neural Capture and Synthesis
Bibtex Type: Article (article)

URL: https://justusthies.github.io/posts/projection-mapping/

Links: Paper
Video

BibTex

@article{siegl2015,
  title = {Real-Time Pixel Luminance Optimization for Dynamic Multi-Projection Mapping},
  author = {Siegl, Christian and Colaianni, Matteo and Thies, Lucas and Thies, Justus and Zollh{\"o}fer, Michael and Izadi, Sharam and Stamminger, Marc and Frank, Bauer},
  journal = {ACM Transactions on Graphics (TOG)},
  volume = {34},
  number = {6},
  publisher = {ACM},
  year = {2015},
  doi = {},
  url = {https://justusthies.github.io/posts/projection-mapping/}
}