| CPC H04N 5/268 (2013.01) [G06T 7/20 (2013.01); H04N 23/56 (2023.01); H04N 23/74 (2023.01); H04N 23/76 (2023.01); G02B 5/208 (2013.01); G06T 2200/24 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01)] | 18 Claims |
|
1. A method comprising:
accessing, by a messaging application, an infrared and visible light capture system for controlling placement of a plurality of filters configured to block IR light and visible light;
receiving, by the messaging application, a request to generate an augmented reality (AR) experience;
based on the request to generate the AR experience by the messaging application, causing the infrared and visible light capture system to place a first filter configured to block infrared (IR) light in a light path from light emitted by a real-world environment to an image sensor of a camera of a device via one or more lenses;
capturing, by the camera of the device, a first image comprising visible light representing a real-world environment;
receiving a strobe signal for capturing an IR image by the camera; and
in response to receiving the strobe signal:
instructing an IR illumination device to temporarily turn ON;
while the IR illumination device is instructed to temporarily turn ON, placing a second filter in the light path associated with the one or more lenses of the camera to pass IR light to an image sensor of the camera and block visible light, the one or more lenses of the camera being positioned between the first filter configured to block infrared light and the second filter configured to block visible light;
capturing a second image comprising IR illumination of the real-world environment;
after the second image comprising the IR illumination of the real-world environment has been captured, instructing, by the infrared and visible light capture system, the IR illumination device to turn OFF;
based on the request to generate the AR experience by the messaging application, causing the infrared and visible light capture system to place the first filter in the light path after the second image is captured to allow visible light to pass through to the image sensor of the camera;
processing the first image to determine one or more visible properties of the real-world environment; and
processing the second image to detect one or more objects depicted in the first image of the real-world environment, the second image being processed by a trained neural network.
|