US 12,393,876 B2
Systems and methods for autonomously executing computer programs
Curtis Ray Robinson, Jr., Rochester, NY (US)
Filed by Curtis Ray Robinson, Jr., Rochester, NY (US)
Filed on Nov. 6, 2023, as Appl. No. 18/502,231.
Application 18/502,231 is a continuation of application No. 17/233,421, filed on Apr. 16, 2021, granted, now 11,809,971.
Application 17/233,421 is a continuation of application No. 16/912,695, filed on Jun. 25, 2020, granted, now 11,010,679, issued on May 18, 2021.
Claims priority of provisional application 63/007,009, filed on Apr. 8, 2020.
Prior Publication US 2024/0070547 A1, Feb. 29, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06N 5/04 (2023.01); G06N 3/08 (2023.01); G06N 3/09 (2023.01); G06N 20/00 (2019.01); G06V 30/10 (2022.01); G06V 30/19 (2022.01)
CPC G06N 20/00 (2019.01) [G06N 3/09 (2023.01); G06N 5/04 (2013.01); G06V 30/19173 (2022.01); G06V 30/10 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving labeled menu options of a computer program, wherein the labels comprise general identities of the menu options of the computer program;
using the labeled menu options, training a classifier to receive a first image frame from the computer program and output general identities and positions of the menu options in the first image frame;
receiving a second image frame from the computer program;
using the trained classifier, determining the general identities of the menu options and positions of the menu options in the second image frame;
determining, based at least in part on the general identities and the positions, precise identities of the menu options in the second image frame; and
providing input commands to the computer program, based at least in part on the precise identities of the menu options in the second image frame.