The video app TikTok has introduced the first augmented reality filter that uses the lidar sensor of the iPhone 12 Pro. Using Lidar (Light Detection and Ranging), the camera system can detect distances by laser and thus reproduce the immediate surroundings three-dimensionally – this allows superimposed virtual objects to react to physical objects.

Bridge between the virtual and the physical world The lidar technology in the iPhone enables effects that interact with the environment instead of just overlaying it, as TikTok explains. The sensor makes it possible to “build a visual bridge between the digital and the physical world”. In a video provided by the service, a virtual glitter bomb empties its contents, which land both in real time on a person’s outstretched arms and on the couch. According to TikTok, this is just the beginning, further AR effects of this kind are to follow Depth interface of Apple’s augmented reality framework ARKit 4, making it available to a wide range of users. Other social media platforms are now also experimenting with it: Snapchat integrated the option into its Lens Studio last fall in order to enable artists and developers to use the technology for their own “lenses” or filters.

Lidar so far only in a few model series Currently Apple only uses lidar sensors in iPhone 12 Pro, Pro Max and the iPad Pro 2020. According to rumors, however, the group plans to equip all model series of the iPhone 12 with lidar, which would make the technology available to an even larger audience from autumn. Lidar also supports the camera’s autofocus in the iPhone and, as an operating aid, allows you to determine the distance to people in the vicinity.

(lbe)