Proactive 3D Scanning of Inaccessible Parts

Proceedings of SIGGRAPH 2014

Feilong Yan1    Andrei Sharf2    Wenzhen Lin1    Hui Huang1*    Baoquan Chen3,1

1Shenzhen VisuCA Key Lab / SIAT    2Ben Gurion University    3Shandong University

 

Figure 1: Proactive scanning of a tangled Banana tree. We freely move the scanner around to capture the scene while physically moving aside occluding leaves to scan the trunk and branches (a). In (b) we zoom on the interactive modification. Our algorithm reconstructs a 3D scene, including its interior parts (c) and generate a plausible mesh (d).


Abstract

The evolution of 3D scanning technologies have revolutionized the way real-world object are digitally acquired. Nowadays, high-definition and high-speed scanners can capture even large scale scenes with very high accuracy. Nevertheless, the acquisition of complete 3D objects remains a bottleneck, requiring to carefully sample the whole object’s surface, similar to a coverage process. Holes and undersampled regions are common in 3D scans of complex-shaped objects with self-occlusions and hidden interiors. In this paper we introduce the novel paradigm of proactive scanning, in which the user actively modifies the scene while scanning it, in order to reveal and access occluded regions. We take a holistic approach and integrate the user interaction into the continuous scanning process.

Our algorithm allows for dynamic modifications of the scene as part of a global 3D scanning process. We utilize a scan registration algorithm to compute motion trajectories and separate between user modifications and other motions such as (hand-held) camera movements and small deformations. Thus, we reconstruct together the static parts into a complete unified 3D model. We evaluate our technique by scanning and reconstructing 3D objects and scenes consisting of inaccessible regions such as interiors, entangled plants and clutter.


Results



Figure 2: Several results of proactive 3D scanning 


Acknoledgements

We thank Prof. Daniel Cohen-Or for insightful discussions and all the reviewers for their valuable comments. This work is supported in part by the NSFC (61379090, 61025012, 61161160567), National 863 Program (2013AA01A604), CAS Young Scientists Plan (2013Y1GA0007), Shenzhen Innovation & Technology Program (CXB201104220029A, ZD201111080115A, KC2012JSJS0019A, JSGG20130624154940238) and the Israel Science Foundation.

BibTex

@ARTICLE{Proactive Scan},

  title = {Proactive 3D Scanning of Inaccessible Parts},

  author = {Feilong Yan and Andrei Sharf and Wenzhen Lin and Hui Huang and Baoquan Chen},

  journal = {Proceedings of SIGGRAPH 2014},

  volume = {33},

  number = {4},

  page = {157:1--157:8},

  year = 2014

}

Copyright © 1998-2018 Visual Computing Research Center