Apple introduced its latest flagship iPhone models, the iPhone 12 Pro and 12 Pro Max, at its iPhone event on Tuesday. Among other things, the devices sport a new LiDAR Scanner designed to allow for more immersive augmented reality (AR) experiences. Snapchat today confirms it will be among the first to put the new technology to use in its iOS app for a lidar-powered Lens.
As Apple explained during the event, the LiDAR (Light Detection And Ranging) Scanner measures how long it takes for light to reach an object and reflect back.
Along with iPhone’s machine learning capabilities and dev frameworks, lidar helps the iPhone understand the world around you.
Apple adapted this technology for its iPhone 12 Pro models, where it’s helping to improve low-light photography, thanks to its ability to “see in the dark.”
The technology can also be used by app developers to build a precise depth map of the scene, and help speed up AR so it feels more instantaneous, while enabling new app experiences that use AR.
In practice, what this means for app developers is the ability to use lidar to enable things like object and room scanning — think, better AR shopping apps, home design tools or AR games, for example.
It also can enable photo and video effects and a more exact placement of AR objects, as the iPhone is actually able to “see” a depth map of the room.
That can lead to new AR experiences like what Snapchat is prepared to introduce. Already known for some best-in-class AR photo filters, the company says it will soon launch a lidar-powered lens specifically for the iPhone 12 Pro models.
Apple gave a brief peek at Snapchat’s lidar-powered feature during the lidar portion of the iPhone event today.
Here, you can see an AR Lens in the Snapchat app where flowers and grasses cover the table and floor, and birds fly toward the user’s face. The grasses toward the back of the room looked as if they were further away than those closer to the user, and vegetation was even climbing up and around the kitchen cabinets — an indication that it saw where those objects were in the physical space.
The birds in the Snapchat Lens disappear as they move behind the person, out of view, and even land precisely in the person’s hand.
We understand this is the exact Lens Snapchat has in the works.
You can see the Snapchat filter in action at 59:41 in the Apple iPhone Event video.
Snap on Wednesday (after publication) also announced it will launch an update to Lens Studio, the company’s free AR creation tool that lets any creator or developer build their own Lenses and publish them directly into Snapchat. This version, Lens Studio 3.2, will allow AR creators and developers to build LiDAR-powered Lenses for the new iPhone 12 Pro models so their lenses will be ready when the new phones ship to consumers. The update is available as of today.
“The addition of the LiDAR Scanner to iPhone 12 Pro models enables a new level of creativity for augmented reality,” said Eitan Pilipski, Snap’s SVP of Camera Platform, in a statement. “We’re excited to collaborate with Apple to bring this sophisticated technology to our Lens Creator community.”
Updated, 10/13/20, 4:47 PM ET with confirmation that the Lens shown during the event is the one that will launch; 10/14/20, 12 PM ET Updated with new info about Lens Studio.