US 11,899,908 B2
Image template-based AR form experiences
Molly Beth Davis, San Francisco, CA (US); Timothy Joseph Mueller, San Diego, CA (US); Mark Anders Holmberg, Mountain View, CA (US); Jessica Jaiyeon Cho, Burbank, CA (US); and Anoop Pratap Singh Tomar, Fremont, CA (US)
Assigned to Intuit, Inc., Mountain View, CA (US)
Filed by INTUIT INC., Mountain View, CA (US)
Filed on Sep. 26, 2022, as Appl. No. 17/935,231.
Application 17/935,231 is a continuation of application No. 16/178,482, filed on Nov. 1, 2018, granted, now 11,494,051.
Prior Publication US 2023/0012805 A1, Jan. 19, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/20 (2022.01); G06V 30/418 (2022.01); G06F 3/0482 (2013.01); G06F 3/04886 (2022.01); G06F 40/186 (2020.01)
CPC G06F 3/0482 (2013.01) [G06F 3/04886 (2013.01); G06F 40/186 (2020.01); G06V 20/20 (2022.01); G06V 30/418 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method of providing an augmented reality user interface, comprising:
receiving, by an image sensor of an electronic device, an image of a physical document;
determining an augmented reality template to display on a display of the electronic device;
displaying the augmented reality template on the display of the electronic device, wherein the augmented reality template is aligned in three dimensions with the physical document;
determining a distance between the physical document and the electronic device;
determining the distance satisfies a threshold distance;
based on the distance between the physical document and the electronic device satisfying the threshold distance;
performing a template detection to determine a document template for the physical document, the document template defining a location and a type of information on the physical document and defining an interactivity rule;
defining an overlay including one or more structures aligned with the location and the type of the information on the physical document and displaying one or more interactive user interface elements;
enabling the one or more interactive user interface elements within the augmented reality template displayed on the display of the electronic device; and
changing a display of a particular text box of the physical document according to the interactivity rule and in response to receiving a user interaction associated by the interactivity rule with the particular text box;
determining that the distance between the physical document and the electronic device no longer satisfies the threshold distance; and
based on the distance between the physical document and the electronic device no longer satisfying the threshold distance, disabling the one or more interactive user interface elements.