Can I use the Structure Sensor to capture 3D scans of shiny, reflective surfaces?
Black objects and reflective objects pose a particular difficulty for our sensors.
In order to capture depth, our sensors project an IR speckle pattern to the object the user intends to scan. This pattern is then reflected back to the sensor, and the depth is calculated based on how long it takes for the light to be reflected. For more in-depth information on how Structure Sensor (and all of our sensors work), please check out this video: https://youtu.be/vGDzqKWQ6Kg
Black objects absorb the IR lasers, causing the objects to “disappear” to the sensor, as the light never reflects back.
Reflective objects scatter the IR lasers in an erratic fashion, causing the sensor to lose tracking and producing random artifacts.
Some users have mitigated these problems by applying a temporary paint or powder to the objects in question assist the sensor in capturing depth information.