US 12,405,661 B2
Devices and methods for controlling electronic devices or systems with physical objects
Shem Nguyen, Oakland, CA (US); and Soravis Prakkamakul, Emeryville, CA (US)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jan. 6, 2023, as Appl. No. 18/151,206.
Claims priority of provisional application 63/266,626, filed on Jan. 10, 2022.
Prior Publication US 2023/0221799 A1, Jul. 13, 2023
Int. Cl. G06F 3/01 (2006.01); G06F 3/04842 (2022.01); G10H 1/00 (2006.01)
CPC G06F 3/013 (2013.01) [G06F 3/017 (2013.01); G10H 1/0008 (2013.01); G06F 3/04842 (2013.01); G10H 2210/375 (2013.01); G10H 2220/455 (2013.01)] 10 Claims
OG exemplary drawing
 
1. A method comprising:
at a first electronic device in communication with a display and one or more input devices:
detecting a change in a physical environment of the first electronic device due to a movement of one or more physical objects, different from a hand of a user and different from a writing implement, in the physical environment indicative of a user input including detecting movement of a first physical object, of the one or more physical objects relative to a second physical object, from a first location in the physical environment of the first electronic device to a second location in the physical environment, wherein the first physical object is less than a threshold distance from the second physical object before detecting the change in the physical environment;
after detecting the change in the physical environment, in accordance with a determination that the first physical object is more than the threshold distance from the second physical object, performing a first action at the first electronic device or at a second electronic device in communication with the first electronic device in accordance with the change in the physical environment due to the movement of the one or more physical objects in the physical environment; and
in accordance with a determination that the first physical object is not more than the threshold distance from the second physical object, forgoing performing the first action at the first electronic device or the second electronic device.