US 11,997,427 B2
Position-based visual interpretation of device interfaces
William Glaser, Berkeley, CA (US); and Brian Van Osdol, Piedmont, CA (US)
Assigned to Grabango Co., Berkeley, CA (US)
Filed by Grabango Co., Berkeley, CA (US)
Filed on Mar. 1, 2022, as Appl. No. 17/684,318.
Application 17/684,318 is a continuation of application No. 16/803,556, filed on Feb. 27, 2020, granted, now 11,295,552.
Application 16/803,556 is a continuation of application No. 15/644,801, filed on Jul. 9, 2017, granted, now 10,659,247, issued on May 19, 2020.
Claims priority of provisional application 62/360,369, filed on Jul. 9, 2016.
Claims priority of provisional application 62/360,366, filed on Jul. 9, 2016.
Prior Publication US 2022/0301350 A1, Sep. 22, 2022
Int. Cl. H04N 7/18 (2006.01); G06F 18/213 (2023.01); G06V 10/24 (2022.01); G06V 20/52 (2022.01); G06V 20/62 (2022.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01); G08B 13/196 (2006.01); H04L 12/28 (2006.01); H04L 67/12 (2022.01); H04N 23/51 (2023.01); H04N 23/57 (2023.01); H05B 47/105 (2020.01); H05B 47/125 (2020.01); H05B 47/19 (2020.01)
CPC H04N 7/18 (2013.01) [G06F 18/213 (2023.01); G06V 10/245 (2022.01); G06V 20/52 (2022.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01); G08B 13/196 (2013.01); H04L 12/2809 (2013.01); H04L 12/2814 (2013.01); H04L 12/282 (2013.01); H04L 67/12 (2013.01); H04N 7/183 (2013.01); H04N 23/51 (2023.01); H04N 23/57 (2023.01); H05B 47/105 (2020.01); H05B 47/125 (2020.01); H05B 47/19 (2020.01); G06V 20/63 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method for establishing uncoupled information extraction from a user interface output comprising:
collecting image data from a movable imaging device;
setting extraction configuration of a device interface source identifiable in the image data and associated with a device position;
tracking image collection position of the movable imaging device;
when the image collection position corresponds to the device position of the device interface source, processing the image data associated with the device interface source into an extracted interface representation according to the extraction configuration.