FaceForge: Markerless Non-Rigid Face Multi-Projection Mapping

2017

Conference Paper

ncs

Recent publications and art performances demonstrate amazing results using projection mapping. To our knowledge, there exists no multi-projection system that can project onto non-rigid target geometries. This constrains the applicability and quality for live performances with multiple spectators. Given the cost and complexity of current systems, we present a low-cost easy-to-use markerless non-rigid face multi-projection system. It is based on a non-rigid, dense face tracker and a real-time multi-projection solver adapted to imprecise tracking, geometry and calibration. Using this novel system we produce compelling results with only consumer-grade hardware.

@inproceedings{siegl2017faceforge,
  title = {FaceForge: Markerless Non-Rigid Face Multi-Projection Mapping},
  author = {Siegl, Christian and Lange, Vanessa and Stamminger, Marc and Bauer, Frank and Thies, Justus},
  booktitle = {IEEE Transactions on Visualization & Computer Graphics},
  year = {2017},
  doi = {},
  url = {https://justusthies.github.io/posts/faceforge/}
}