April 2004
Barus & Holley, Rm. 190 - Eng. bldg.
Stereo vision is a widely used, mature technology for 3D surface reconstruction. However, there are still situations where stereo vision is difficult to apply. For example: surfaces with spatially slowly varying intensity; semi-transparent surfaces; and mirror-like surface. For these surfaces, making the necessary surface correspondences across multiple images is difficult if not impossible in a general setting. In these cases, there is often high contrast between object surface and background which enables 2D object boundaries to be more reliably detected. These 2D boundaries (silhouettes), often referred to as apparent contours, observed in 2D image, have complicated relations with the 3D object surface we want to reconstruct. These relations have been studied for the past three decades and several algorithms, which I will discuss in my talk, have been developed. However all these algorithms have various significant limitations. In this talk, we propose a powerful and innovative mathematical framework for recovering the 3D shape from silhouettes observed in a sequence of 2D images. The approach involves estimating the geometry of a surface dual to the 3D object to be reconstructed. The dual surface represents the family of 3D planes, in the scene being observed, that are tangent to the object to be reconstructed. This approach is very attractive because each tangent plane in the original space is directly measurable from an image and becomes a point in the dual space. The resulting object reconstruction algorithm is computationally fast, accurate, and robust.
In this talk, I will first briefly review work of the past few decades on 3D reconstruction from silhouettes in multiple images, then present my very different framework with details, and then show experimental results.
Last Updated: April 23, 2004