Arts & Sciences Events
[PAST EVENT] James Bieron, Computer Science - Thesis Defense
Abstract: Creating realistic computer generated imagery is essential for modern movies and video games. Recreating the appearance of materials is integral to generating such photo-realistic images. While the problem of how to model materials is well studied, here we will focus on the question of how to recreate the appearance of specific materials found in the real world.
In this dissertation we will begin with a short introduction to rendering, followed by a discussion of various material models, techniques for measuring reflectance, and strategies for fitting these models to reflectance data. We will then introduce a novel two-stage process for fitting, and demonstrate the efficacy of our fitting technique both quantitatively using perceptual metrics, as well as qualitatively with a user study. Then we will investigate how our fitting strategy might be adapted to work without dense measurements, instead relying on an image as input.
In the second part of this dissertation, we will look at a deep-learning based material relighting strategy that bypasses the need for an explicit reflectance model altogether. By directly transforming an image of a material under one lighting to an image of the same material under another lighting, we avoid the ambiguity inherent in moving from the image domain to the higher-dimensional space of materials. We demonstrate that not only does this relighting network faithfully reproduce the appearance of spatially varying materials, but those synthetic relightings can be used as inputs to material estimation networks such that they give higher quality results than when given a single real input image.
Bio: James Bieron has been at William & Mary since he began his undergraduate studies in 2011. He received his B.S. in Computer Science and Mathematics in 2015 and his Masters in Computer Science in 2016. He has studied under the direction of Professor Pieter Peers since doing an undergraduate Honors Thesis in 2015.