US 12,346,961 B2
Financial management using augmented reality systems
Stephen R. Gay, Redwood City, CA (US); and Tony Chang, Hillsboro, OR (US)
Assigned to Intuit Inc., Mountain View, CA (US)
Filed by INTUIT INC., Mountain View, CA (US)
Filed on Apr. 4, 2022, as Appl. No. 17/657,823.
Application 17/657,823 is a continuation of application No. 14/183,266, filed on Feb. 18, 2014, granted, now 11,328,349.
Prior Publication US 2022/0230235 A1, Jul. 21, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 40/00 (2023.01); G06T 19/00 (2011.01)
CPC G06Q 40/00 (2013.01) [G06T 19/006 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for using an augmented reality system, comprising:
displaying an image of an augmented reality environment including a physical document on a display device of the augmented reality system based on image data captured by a camera of the augmented reality system;
overlaying on the display device, while displaying the image of the augmented reality environment including the physical document, a first user interface element comprising a set of command options for interacting with the physical document in the augmented reality environment;
receiving a gesture via the display device, wherein:
the display device is a touch-sensitive display device, and
the gesture is received via the touch-sensitive display device;
associating the gesture with a command option of the set of command options overlaid on the display device; and
in response to receiving the gesture:
determining, by a processor of the augmented reality system, a digital representation of one or more parts of the physical document based on the image of the physical document displayed in the augmented reality environment;
performing, by the processor, an operation related to the digital representation based on the command option; and
displaying a result of the operation on the display device.