Abstract

Recreating the appearance of humans in virtual environments for the purpose of movie, video game, or other types of production involves the acquisition of a geometric representation of the human body and its scattering parameters which express the interaction between the geometry and light propagated throughout the scene. Teeth appearance is defined not only by the light and surface interaction, but also by its internal geometry and the intra-oral environment, posing its own unique set of challenges. Therefore, we present a system specifically designed for capturing the optical properties of live human teeth such that they can be realistically re-rendered in computer graphics. We acquire our data in vivo in a conventional multiple camera and light source setup and use exact geometry segmented from intra-oral scans. To simulate the complex interaction of light in the oral cavity during inverse rendering we employ a novel pipeline based on derivative path tracing with respect to both optical properties and geometry of the inner dentin surface. The resulting estimates of the global derivatives are used to extract parameters in a joint numerical optimization. The final appearance faithfully recreates the acquired data and can be directly used in conventional path tracing frameworks for rendering virtual humans.

@article{Velinov:2018:ACM:3272127.3275098,
 author = {Velinov, Zdravko and Papas, Marios and Bradley, Derek and Gotardo, Paulo and Mirdehghan, Parsa and Marschner, Steve and Nov\'{a}k, Jan and Beeler, Thabo},
 title = {Appearance Capture and Modeling of Human Teeth},
 journal = {ACM Trans. Graph.},
 issue_date = {November 2018},
 volume = {37},
 number = {6},
 month = dec,
 year = {2018},
 issn = {0730-0301},
 pages = {207:1--207:13},
 articleno = {207},
 numpages = {13},
 url = {http://doi.acm.org/10.1145/3272127.3275098},
 doi = {10.1145/3272127.3275098},
 acmid = {3275098},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {differentiable programming, inverse rendering, material appearance, ray tracing, shape modeling},
}

Zdravko Velinov

Graphics Research Person

My research interests cover physically based rendering and digital material acquisition and modeling.