The Matrix Live

• Cost of development: N/A
• Communities: Lens Studio
• Categories: Lenses & Masks

Screenshots & Video

Description

This is an experiment and showcase of great combination: Lens Studio and LiDAR sensor on iPhone 12 Pro.



LiDAR gives us a possibility to scan surrounding space, read it's geometry, and build a corresponding 3D mesh.



The hardest part was texturing: LiDAR mesh doesn't have any UV so it's impossible to just apply a texture to it. So I had to generate UV on-the-fly using projections.



The lens also has a fallback for older devices: if there is no LiDAR support, it uses ML-based floor tracking and segmentation.

Target Images

Scan these images to discover AR content