US 12,455,641 B2
Method and device for dynamically selecting an operation modality for an object
Aaron M. Burns, Sunnyvale, CA (US); Anette L. Freiin von Kapri, Mountain View, CA (US); Arun Rakesh Yoganandan, San Francisco, CA (US); Benjamin R. Blachnitzky, San Francisco, CA (US); Christopher L. Nolet, San Francisco, CA (US); David M. Schattel, Santa Clara, CA (US); and Samantha Koire, Sacramento, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Appl. No. 18/576,654
Filed by Apple Inc., Cupertino, CA (US)
PCT Filed Jul. 1, 2022, PCT No. PCT/US2022/036027
§ 371(c)(1), (2) Date Jan. 4, 2024,
PCT Pub. No. WO2023/283145, PCT Pub. Date Jan. 12, 2023.
Claims priority of provisional application 63/218,471, filed on Jul. 5, 2021.
Prior Publication US 2025/0004581 A1, Jan. 2, 2025
Int. Cl. G06F 3/00 (2006.01); G06F 3/01 (2006.01); G06F 3/0346 (2013.01); G06F 3/038 (2013.01); G06V 20/20 (2022.01)
CPC G06F 3/038 (2013.01) [G06F 3/012 (2013.01); G06F 3/0346 (2013.01); G06V 20/20 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
at a computing system including non-transitory memory and one or more processors, wherein the computing system is communicatively coupled to a display device:
obtaining a user input vector that includes at least one user input indicator value associated with one of a plurality of different input modalities;
obtaining tracking data associated with a physical object;
generating a first characterization vector for the physical object, including a pose value and a user grip value, based on the user input vector and the tracking data, wherein the pose value characterizes a position of the physical object relative to a user of the computing system and the user grip value characterizes a manner in which the physical object is being held by the user; and
selecting, based on the first characterization vector, a first operation modality as a current operation modality for the physical object.