B05 | Efficient Large Scale Variational 3D Reconstruction

Prof. Bastian Goldlücke, Universität Konstanz
Email | Website

Bastian Goldlücke

Prof. Andrés Bruhn, Universität Stuttgart
Email | Website

Andres Bruhn

Nico Marniok, Universität Konstanz – Website

The central goal of the project is to research and develop high-performance variational methods for large scale 3D reconstruction problems, which are general and accurate while meeting computation time constraints imposed by visual computing applications. Key abilities will be that

  • a variety of possible sources of 3D information can be integrated,
  • accuracy can be locally improved at the cost of run-time, and
  • for a given allowed total run-time, global accuracy is maximized according to application-specific metrics.

Research Questions

What is the best geometric representation to implement locally adaptive geometry optimization?

Which variational models efficiently allow local refinement of the scene structure in a mathematically consistent manner?

Which models in shape reconstruction best translate to the adaptive shape representation?

How can the local refinement of surface properties (e.g., texture) be modeled and optimized—ideally together with the geometry?

What are natural, ideally convex priors on adaptive grids?

What are optimal local accuracy measures for different applications?

How can an ideal trade-off between accuracy and run-time be determined?

Results on synthetic data with semi-reflective statue of Warrior. Top images depict center views of corresponding input light fields. Bottom resulting geometry.

Publications

  1. O. Johannsen, A. Sulc, N. Marniok, and B. Goldluecke, “Layered scene reconstruction from multiple light field camera views,” 2016.
  2. J. Iseringhausen, B. Goldlücke, N. Pesheva, S. Iliev, A. Wender, M. Fuchs, and M. B. Hullin, “4D Imaging through Spray-On Optics,” ACM Transactions on Graphics (SIGGRAPH 2017), vol. 36, no. 4, pp. 35:1–35:11, 2017.