US 11,057,612 B1
Generating composite stereoscopic images usually visually-demarked regions of surfaces
Nancy L. Clemens, Scotts Valley, CA (US); and Michael A. Vesely, Scotts Valley, CA (US)
Assigned to Tanzle, Inc., Scotts Valley, CA (US)
Filed by Tanzle, Inc., Scotts Valley, CA (US)
Filed on Dec. 17, 2020, as Appl. No. 17/125,798.
Application 17/125,798 is a continuation of application No. 17/092,172, filed on Nov. 6, 2020.
Claims priority of provisional application 62/932,873, filed on Nov. 8, 2019.
Claims priority of provisional application 62/933,269, filed on Nov. 8, 2019.
Claims priority of provisional application 62/933,214, filed on Nov. 8, 2019.
Int. Cl. H04N 13/361 (2018.01); G06T 19/00 (2011.01); H04N 13/204 (2018.01); G06T 7/73 (2017.01); H04N 13/275 (2018.01); G06F 3/0346 (2013.01); H04N 13/00 (2018.01); G06F 3/041 (2006.01)
CPC H04N 13/361 (2018.05) [G06F 3/0346 (2013.01); G06T 7/73 (2017.01); G06T 19/003 (2013.01); H04N 13/204 (2018.05); H04N 13/275 (2018.05); G06F 3/041 (2013.01); G06T 2200/24 (2013.01); G06T 2207/10012 (2013.01); G06T 2207/30244 (2013.01); G06T 2219/028 (2013.01); H04N 2013/0074 (2013.01)] 23 Claims
OG exemplary drawing
 
1. A system comprising:
a first stereoscopic viewing device configured for a first user to view a first pair of views of a first physical environment from a first perspective;
a second stereoscopic viewing device configured for a second user to view a second pair of views of the first physical environment from a second perspective;
a third stereoscopic viewing device configured for a third user to view a third pair of views of a second physical environment from a third perspective, wherein the second physical environment is physically separate from the first physical environment; and
one or more storage devices storing instructions that are operable, when executed by one or more processors of the system, to cause the one or more processors to:
obtain first data representing a first three-dimensional virtual object, obtain second data representing a second three-dimensional virtual object, wherein the second three-dimensional virtual object is for overlaying the first three-dimensional virtual object,
based on a sensor data received from a sensor, identify a first physically visually-demarked region of a first surface in the first physical environment, wherein the first physically visually-demarked region is smaller than the first surface,
identify spatial characteristics of the first physically visually-demarked region on the first surface within the first physical environment,
determine, using the spatial characteristics of the first physically visually-demarked region, spatial characteristics of a first virtual volume within the first physical environment;
generate a first rendered image pair from the first perspective, including generating a depiction of (i) the first three-dimensional virtual object and (ii) the second three-dimensional virtual object overlaid on the first three-dimensional virtual object, wherein a location of the first three-dimensional virtual object in the first rendered image pair is based on the spatial characteristics of the first virtual volume, such that the first virtual object is depicted to be exclusively within the first virtual volume,
at a first viewing surface positioned between the first physically visually-demarked region and the first perspective, overlay the first rendered image pair onto the first pair of views of the first stereoscopic viewing device,
generate a second rendered image pair from the second perspective, including generating a second perspective depiction of the first three-dimensional virtual object, wherein a location of the first three-dimensional virtual object in the second rendered image pair is based on the spatial characteristics of the first virtual volume, such that the first virtual object is depicted to be exclusively within the first virtual volume,
at a second viewing surface positioned between the first physically visually-demarked region and the second perspective, overlay the second rendered image pair onto the second pair of views of the second stereoscopic viewing device,
based on data received from a second sensor, identify a third physically visually-demarked region of a second surface within the second physical environment,
identify spatial characteristics of the third physically visually-demarked region on the second surface within the second physical environment,
determine, using the spatial characteristics of the third physically visually demarked region, spatial characteristics of a second virtual volume within the second physical environment,
generate a third rendered image pair from the third perspective, including generating a third perspective depiction of the first three-dimensional virtual object, wherein a location of the first three-dimensional virtual object in the third rendered image pair is based on the spatial characteristics of the second virtual volume, such that the first virtual object is depicted to be exclusively within the second virtual volume, and
at a third viewing surface positioned between the third physically visually-demarked region and the third perspective, overlay the third rendered image pair onto the third pair of views of the third stereoscopic viewing device.