US 12,432,330 B2
Head-mounted electronic device with reliable passthrough video fallback capability
Michael C Friedman, Nederland, CO (US); Russell L Jones, Westminster, CO (US); Kaushik Raghunath, Pleasanton, CA (US); Venu M Duggineni, San Jose, CA (US); Ranjit Desai, Cupertino, CA (US); Manjunath M Venkatesh, San Fransisco, CA (US); Michael J Rockwell, Palo Alto, CA (US); Arun Kannan, Mountain View, CA (US); and Saul H Weiss, Parker, CO (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Sep. 6, 2023, as Appl. No. 18/462,161.
Claims priority of provisional application 63/408,043, filed on Sep. 19, 2022.
Prior Publication US 2024/0098234 A1, Mar. 21, 2024
Int. Cl. H04N 13/133 (2018.01); H04N 13/344 (2018.01); H04N 13/383 (2018.01)
CPC H04N 13/133 (2018.05) [H04N 13/344 (2018.05); H04N 13/383 (2018.05)] 22 Claims
OG exemplary drawing
 
1. A method of operating an electronic device having at least one image sensor, a first set of compute blocks, and a second set of compute blocks, the method comprising:
acquiring a video feed using the at least one image sensor;
identifying a condition of the first set of compute blocks;
determining whether to operate in a first video passthrough mode or a second video passthrough mode based on the identified condition of the first set of compute blocks;
identifying first processing functions to be performed by the first set of compute blocks on the video feed;
while operating in the first video passthrough mode, processing the video feed for display by using the first set of compute blocks to perform the first processing functions and using the second set of compute blocks to perform second processing functions, different than the first processing functions, on the video feed, wherein the first set of compute blocks is configured to output one or more parameters to the second set of compute blocks during the first video passthrough mode; and
while operating in the second video passthrough mode, processing the video feed for display by using the first set of compute blocks to perform a subset of the first processing functions based on the one or more parameters and using the second set of compute blocks to perform the second processing functions on the video feed.