US 12,293,474 B2
Video pass-through computing system
Robert Warren Gruen, Seattle, WA (US); Weige Chen, Redmond, WA (US); Michael George Boulton, Seattle, WA (US); and Roberta Rene Moeur, North Bend, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Appl. No. 18/001,211
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
PCT Filed Apr. 19, 2021, PCT No. PCT/US2021/027948
§ 371(c)(1), (2) Date Dec. 8, 2022,
PCT Pub. No. WO2021/257172, PCT Pub. Date Dec. 23, 2021.
Claims priority of application No. 2025869 (NL), filed on Jun. 19, 2020.
Prior Publication US 2023/0222741 A1, Jul. 13, 2023
Int. Cl. G06T 19/00 (2011.01); G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06T 1/20 (2006.01); G06T 5/80 (2024.01); H04N 13/344 (2018.01); H04N 23/73 (2023.01)
CPC G06T 19/006 (2013.01) [G02B 27/0172 (2013.01); G06F 3/012 (2013.01); G06T 1/20 (2013.01); G06T 5/80 (2024.01); H04N 13/344 (2018.05); H04N 23/73 (2023.01); G02B 2027/0138 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A video pass-through computing system, comprising:
a host computer configured to render a virtual image pixel stream; and
a head-mounted display device including:
a camera configured to image a physical scene according to an exposure timing, the exposure timing defining when the camera initiates image capture of an image frame;
an augmented reality control circuit configured to:
receive a camera image pixel stream from the camera;
receive the virtual image pixel stream from the host computer;
composite, via a hardware compositor of the augmented reality control circuit, the camera image pixel stream with the virtual image pixel stream to generate a display image pixel stream; and
for one or more pixels of the virtual image pixel stream received at the hardware compositor, if the camera image pixel stream is not in temporal synchronization with a pixel of the one or more pixels of the virtual image pixel stream, send a command signal to the camera to adjust the exposure timing of the camera; and
a display configured to present the display image pixel stream.