US 12,217,025 B2
Visual programming methods and systems for intent dispatch
Joseph Kessler, Grayslake, IL (US); Suresh Bellam, Vernon Hills, IL (US); Andre Coetzee, Cary, IL (US); and Dan Verdeyen, Glenview, IL (US)
Assigned to CDW LLC, Vernon Hills, IL (US)
Filed by CDW LLC, Vernon Hills, IL (US)
Filed on Jan. 27, 2022, as Appl. No. 17/585,972.
Application 17/585,972 is a continuation of application No. 16/519,649, filed on Jul. 23, 2019, granted, now 11,269,599.
Prior Publication US 2022/0147324 A1, May 12, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 8/34 (2018.01); G10L 15/22 (2006.01)
CPC G06F 8/34 (2013.01) [G10L 15/22 (2013.01); G10L 2015/223 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A computing system, comprising:
one or more processors;
an input device; and
a memory containing instructions that, when executed, cause the computing system to:
receive, from a user via the input device, a command phrase;
process the command phrase to determine an entity name;
identify a graphical user interface control corresponding to the entity name by analyzing a screen capture of a graphical user interface using a trained convolutional neural network; and
responsive to identifying the graphical user interface control, display, on the graphical user interface, an action palette relating to a palette intent wherein the action palette includes a plurality of different action types.