IPAB Workshop-01/03/2024

Speaker: Tzu-Mao Li

Title: Differentiable Rendering and Beyond

Abstract: Computing the gradients of computer graphics models has become increasingly crucial for computer vision and machine learning in solving inverse problems, inference, or synthesizing images. When differentiating a light simulator/renderer, several challenges arise. Firstly, object boundaries and occlusion introduce discontinuities. Naive automatic differentiation would fail to account for the resulting Dirac delta signals from the differentiation of discontinuities, leading to incorrect results. Secondly, light transport simulation and its differentiation require solving a high-dimensional integral using stochastic estimators. Naive estimators of derivatives may exhibit high variance and cause divergence in gradient-based optimization. In this talk, I will discuss our recent work on new numerical methods and programming languages for addressing these challenges, and how we can generalize these algorithms to tasks beyond differentiating light simulators.

Bio: Tzu-Mao Li is an assistant professor at the CSE department of University of California, San Diego. He is a member of the Center for Visual Computing at UCSD. His research explores the connections between visual computing algorithms and modern data-driven methods and develops programming languages and systems for facilitating the exploration. He did a 2-year postdoc with Jonathan Ragan-Kelley at both MIT CSAIL and UC Berkeley. He did his Ph.D. in the computer graphics group at MIT CSAIL, advised by Frédo Durand. He received his B.S. and M.S. degrees in computer science and information engineering from National Taiwan University in 2011 and 2013, respectively, where I worked with Yung-Yu Chuang at the Communication and Multimedia Lab. His Ph.D. thesis "Differentiable Visual Computing" has received the ACM SIGGRAPH 2020 Outstanding Doctoral Dissertation Award. He also received the NSF CAREER Award in 2023.