US 12,190,016 B2
Virtual and real object recording in mixed reality device
Ziqiang Huang, Parkland, FL (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Apr. 17, 2023, as Appl. No. 18/301,890.
Application 18/301,890 is a continuation of application No. 17/517,625, filed on Nov. 2, 2021, granted, now 11,669,298.
Application 17/517,625 is a continuation of application No. 16/902,650, filed on Jun. 16, 2020, granted, now 11,194,543, issued on Dec. 7, 2021.
Application 16/902,650 is a continuation of application No. 15/907,115, filed on Feb. 27, 2018, granted, now 10,725,729, issued on Jul. 28, 2020.
Claims priority of provisional application 62/464,757, filed on Feb. 28, 2017.
Prior Publication US 2023/0251823 A1, Aug. 10, 2023
Int. Cl. G06F 3/16 (2006.01); A63F 13/00 (2014.01); A63F 13/424 (2014.01); A63F 13/5255 (2014.01); A63F 13/5372 (2014.01); A63F 13/54 (2014.01); A63F 13/65 (2014.01); G02B 27/00 (2006.01); G02B 27/01 (2006.01); G06F 3/0481 (2022.01); G06F 3/04815 (2022.01); G06F 3/0484 (2022.01); G06F 3/04842 (2022.01); G06T 19/00 (2011.01); H04R 1/32 (2006.01); H04R 1/40 (2006.01); G06F 3/01 (2006.01); H04R 1/10 (2006.01); H04R 3/00 (2006.01); H04R 5/02 (2006.01)
CPC G06F 3/165 (2013.01) [A63F 13/00 (2013.01); A63F 13/424 (2014.09); A63F 13/5255 (2014.09); A63F 13/5372 (2014.09); A63F 13/54 (2014.09); A63F 13/65 (2014.09); G02B 27/0093 (2013.01); G02B 27/0172 (2013.01); G06F 3/04815 (2013.01); G06F 3/04842 (2013.01); G06T 19/006 (2013.01); H04R 1/32 (2013.01); H04R 1/403 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/014 (2013.01); G06F 3/012 (2013.01); G06F 3/017 (2013.01); G06F 3/167 (2013.01); G06T 2200/24 (2013.01); H04R 1/1075 (2013.01); H04R 3/005 (2013.01); H04R 5/02 (2013.01); H04S 2400/11 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A method of operating a virtual image generation system by an end user, comprising:
persistently selecting at least one object from a field of view of the end user that includes both virtual and real objects;
generating video data originating from the at least one selected object;
rendering a plurality of image frames in a three-dimensional scene from the generated video data;
displaying the image frames to the end user;
generating audio data originating from the at least one selected object; and
storing the audio data originating from the at least one selected object in synchronization with stored video data, within memory.