US 12,147,034 B2
Systems and methods for relative representation of spatial objects and disambiguation in an interface
Patrick S. Piemonte, San Francisco, CA (US); Wolf Kienzle, Seattle, WA (US); Douglas Bowman, Blacksburg, VA (US); Shaun D. Budhram, San Jose, CA (US); Madhurani R. Sapre, San Jose, CA (US); Vyacheslav Leizerovich, San Jose, CA (US); and Daniel De Rocha Rosario, San Francisco, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Feb. 10, 2020, as Appl. No. 16/786,754.
Application 16/786,754 is a continuation of application No. 15/710,397, filed on Sep. 20, 2017, granted, now 10,558,037.
Claims priority of provisional application 62/398,579, filed on Sep. 23, 2016.
Prior Publication US 2020/0233212 A1, Jul. 23, 2020
This patent is subject to a terminal disclaimer.
Int. Cl. G02B 27/01 (2006.01); G06F 3/01 (2006.01); G06F 3/0481 (2022.01); G06F 3/04817 (2022.01); G06F 16/58 (2019.01); H04W 4/02 (2018.01); G06F 16/00 (2019.01); G10L 15/00 (2013.01)
CPC G02B 27/01 (2013.01) [G06F 3/017 (2013.01); G06F 3/04817 (2013.01); G06F 16/58 (2019.01); H04W 4/027 (2013.01); G02B 2027/014 (2013.01); G06F 16/00 (2019.01); G10L 15/00 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A method for interaction between a user and a device, the method comprising:
receiving a request from the user through an input system, the request including a reference to an object type in an external environment;
obtaining a subset of real world object indicators from a database of known real world object indicators, the subset of real world object indicators being identified based on the reference to the object type and an estimated geographic location of the device, the subset of real world object indicators corresponding to at least one potential match to the request;
determining a position of each of one or more objects in a three-dimensional space of the external environment, the one or more objects corresponding to the subset of real world object indicators;
determining a current spatial relationship between a user interface of the device and the position of each of the one or more objects by spatially orienting the one or more objects in the three-dimensional space of the external environment relative to the user interface of the device according to a measured movement of the device through the external environment;
displaying a representation of each real world object indicator in the subset of real world object indicators, each of the representations of the real world object indicators in the subset of real world object indicators displayed at a display location according to the current spatial relationship between the user interface of the device and the one or more objects corresponding to the subset of real world object indicators;
receiving a non-tactile selection of one of the representations of the real world object indicators in the subset of real world object indicators from the user through the input system, the non-tactile selection being different than the request; and
determining an object corresponding to the request by disambiguating the non-tactile selection.