US 11,691,080 B2
Reconfiguring reality using a reality overlay device
Chris Kalaboukis, Los Gatos, CA (US); Stephan Douris, San Jose, CA (US); Marc Perry, San Francisco, CA (US); and Barry Crane, Menlo Park, CA (US)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Gyeonggi-do (KR)
Filed on Oct. 27, 2016, as Appl. No. 15/335,503.
Application 15/335,503 is a continuation of application No. 12/257,832, filed on Oct. 24, 2008, granted, now 9,480,919.
Prior Publication US 2017/0043252 A1, Feb. 16, 2017
Int. Cl. H04N 5/222 (2006.01); G06F 3/03 (2006.01); G03B 17/00 (2021.01); G06K 9/00 (2022.01); G09G 5/00 (2006.01); A63F 13/53 (2014.01); A63F 13/90 (2014.01); A63F 13/65 (2014.01); G06F 3/01 (2006.01); G06F 3/04815 (2022.01); G06T 19/00 (2011.01); A63F 13/335 (2014.01); G02B 27/01 (2006.01); G06T 19/20 (2011.01); A63F 13/213 (2014.01); G09G 3/00 (2006.01)
CPC A63F 13/53 (2014.09) [A63F 13/335 (2014.09); A63F 13/65 (2014.09); A63F 13/90 (2014.09); G02B 27/0172 (2013.01); G06F 3/011 (2013.01); G06F 3/012 (2013.01); G06F 3/04815 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); A63F 13/213 (2014.09); A63F 2300/105 (2013.01); A63F 2300/1043 (2013.01); A63F 2300/1093 (2013.01); A63F 2300/205 (2013.01); A63F 2300/303 (2013.01); A63F 2300/69 (2013.01); A63F 2300/8082 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0178 (2013.01); G06T 2219/2004 (2013.01); G06T 2219/2016 (2013.01); G09G 3/001 (2013.01); G09G 5/003 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method comprising:
determining, by at least one processing unit, information related to a movable physical entity among a plurality of physical entities located in an area viewable through a wearable device;
acquiring, by the at least one processing unit, image information representative of a virtual entity, the image information representative of the virtual entity being based on the information related to the movable physical entity, the information related to the movable physical entity comprising a position of the movable physical entity;
generating, by the at least one processing unit, an image of the virtual entity based on the image information representative of the virtual entity in order to enable the virtual entity to appear to be present in a same area;
tracking, by the at least one processing unit, the position of the movable physical entity in the area, wherein the movable physical entity is visible through the wearable device, and wherein the tracking comprises:
capturing an image of the movable physical entity by a camera of the wearable device; and
processing the captured image to determine the position of the movable physical entity in the area, wherein the position of the movable physical entity comprises a distance between the movable physical entity and the wearable device; and
displaying the virtual entity to be overlaid on at least a portion of the movable physical entity in the same area to overlay, with the virtual entity, the at least the portion of the movable physical entity that would be visible through the wearable device by scaling a size of the virtual entity to be overlaid on the at least the portion of the movable physical entity based on the distance between the movable physical entity and the wearable device,
wherein the virtual entity is displayed on a lens of the wearable device optically aligned with the movable physical entity.