US 11,688,147 B2
Augmented reality collaboration system
Avi Bar-Zeev, San Mateo, CA (US); Alexander Tyurin, San Mateo, CA (US); and Gerald V. Wright, Jr., San Mateo, CA (US)
Assigned to Campfire 3D, Inc., San Mateo, CA (US)
Filed by Campfire 3D, Inc., San Mateo, CA (US)
Filed on Dec. 14, 2021, as Appl. No. 17/551,009.
Application 17/551,009 is a continuation of application No. 17/494,256, filed on Oct. 5, 2021, granted, now 11,587,295.
Application 17/494,256 is a continuation of application No. 17/023,220, filed on Sep. 16, 2020, granted, now 11,176,756, issued on Nov. 16, 2020.
Prior Publication US 2022/0108537 A1, Apr. 7, 2022
Int. Cl. G06T 19/00 (2011.01); G01S 5/16 (2006.01); G06T 15/20 (2011.01); G06F 3/01 (2006.01)
CPC G06T 19/006 (2013.01) [G01S 5/16 (2013.01); G06F 3/011 (2013.01); G06T 15/20 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A virtual content system configured to display virtual content, comprising:
a first user device, comprising:
one or more sensors configured to sense data related to a physical environment of the user device, and
one or more displays;
one or more hardware processors; and
a non-transitory machine-readable storage medium encoded with instructions executable by the one or more hardware processors to:
generate an image representing the physical environment of the first user device,
place a virtual marker in a first location in the image corresponding to a first physical location in the physical environment of the first user device responsive to first user input received by the first user device,
determine a pose of the first user device with respect to the first physical location based on the data sensed by the one or more sensors,
select a second physical location in the physical environment of the first user device relative to the first physical location,
place the virtual content in a location in the image corresponding to the second physical location in the physical environment of the first user device with a predetermined orientation relative to the virtual marker,
generate an image of the virtual content based on the determined pose of the first user device with respect to the physical location,
add the image of the virtual content to the image representing the physical environment of the first user device,
generate a virtual proxy of a second user device that is viewing a second image of the virtual content in the second user device, with a position of the virtual proxy based on a pose of the second user device with respect to a second physical location in a physical environment of the second user device,
add the virtual proxy to the image representing the physical environment of the first user device, and
cause the one or more displays of the first user device to render the image representing the physical environment of the first user device with the image of the virtual content and the virtual proxy.