DEPTH DATA: MAPPING REALITY
Depth cameras take millions of measurements to create a moving model or point cloud—of a real person, object, or place. Currently, most digital models in virtual reality must be designed in a computer and then added to the virtual world. Depth cameras offer new ways to capture real physical forms and project them into virtual reality environments.
Like two eyes, two sensors on a depth camera record different views. Using trigonometry to compare them, it determines the 3D location of each point.
TRY THIS!
EXPLORE A 3-D VIRTUAL MODEL
Use your mouse to interact with this Statue of Liberty depth model. Try tipping her upside down and turning her around.
Observe It
What do you notice?
Where do you think the depth camera was positioned?
Photo courtesy of MYND Workshop - Creative Reality Capture Studio
Statue of Liberty replica, Brooklyn Museum / Public domain
WHAT'S GOING ON?
There are different technologies that can measure depth. MYND Workshop used cutting edge scanning technology to create a precise point cloud of the Statue of Liberty replica at the Brooklyn Museum. Their laser scanner is comparable to a depth camera. It bounces a laser beam off the surface of the statue and measures the time it takes to return to calculate the distance. It does this millions of times per second. A computer then assembles the data into a recognizable “cloud” of dots to create a 3D virtual model.
Another way of measuring depth is by using a depth camera, like in our exhibit, "Reinventing Reality." Like two eyes, two sensors on a depth camera record different views. Using trigonometry to compare them, it determines the 3D location of each point.
Depth camera exhibit in Reinventing Reality: Explore the Science of Virtual Reality.
WANT TO LEARN MORE?
The latest iPhones include depth cameras
Photo courtesy of ifixit.com
Depth information is transforming augmented reality and enables Face ID, as well as exciting new photo and video effects, such as background blur.
The diagrams above highlight the three features that make this possible in an iPhone. The dot projector throws tens of thousands of dots onto a person or object. This dotted light pattern is seen by the infrared camera, and the phone is then able to calculate the depth between the different objects and surfaces.