Google AR
Lens
Google Lens is an app that lets you “search what you see”. It combines computer vision and a host of ML models to convert your smartphone camera’s view into a search query and deliver useful information about the scene you’re looking at.
I led a team which brought AR capabilities including 3D tracking and photo-realistic rendering to Lens.
Playground
Playground is an AR app that let users to place and interact with animated characters in their environment. These characters were driven by several ML models spanning object detection, sentiment analysis, scene understanding, and more.
I led a team of 5 developers and a designer to extend the engine’s capabilities and bring in new content types such as animated GIFs and text (shown here).