US 11,868,526 B2
Method and device for debugging program execution and content playback
Michael J. Gutensohn, Rodeo, CA (US); Payal Jotwani, Santa Clara, CA (US); Mark E. Drummond, Palo Alto, CA (US); and Daniel L. Kovacs, Santa Clara, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Mar. 24, 2022, as Appl. No. 17/703,278.
Claims priority of provisional application 63/183,188, filed on May 3, 2021.
Prior Publication US 2022/0350401 A1, Nov. 3, 2022
Int. Cl. G06F 3/01 (2006.01)
CPC G06F 3/013 (2013.01) 22 Claims
OG exemplary drawing
 
1. A method comprising:
at a computing system including non-transitory memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices:
presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment;
detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents;
in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent,
detecting, via the one or more input devices, a subsequent user input that selecting one or more layers associated with the plurality of data streams; and
in response to detecting the subsequent user input, recording the one or more layers for the plurality of data streams, wherein the one or more layers correspond to one of a texture map layer, a point cloud layer, a markup layer, a skeletal rigging layer, or an application-specific layer.