US 10,892,907 B2
Home automation system including user interface operation according to user cognitive level and related methods
Jonathan Andrew Gould, Raleigh, NC (US); Richard Clancy, Pittsboro, NC (US); and Robert Shannon Smith, Raleigh, NC (US)
Assigned to K4CONNECT INC., Raleigh, NC (US)
Filed by K4CONNECT INC., Raleigh, NC (US)
Filed on Oct. 31, 2018, as Appl. No. 16/176,315.
Claims priority of provisional application 62/595,810, filed on Dec. 7, 2017.
Prior Publication US 2019/0182071 A1, Jun. 13, 2019
Int. Cl. H04L 12/28 (2006.01); G06F 3/0484 (2013.01); G06F 3/0488 (2013.01); A61B 5/00 (2006.01); A61B 5/11 (2006.01); A63F 13/23 (2014.01); H04L 29/08 (2006.01); G06T 7/50 (2017.01); A63F 13/25 (2014.01); A61B 5/16 (2006.01)
CPC H04L 12/2803 (2013.01) [A61B 5/0022 (2013.01); A61B 5/1113 (2013.01); A61B 5/4088 (2013.01); A61B 5/4842 (2013.01); G06F 3/0484 (2013.01); G06F 3/0488 (2013.01); A61B 5/1101 (2013.01); A61B 5/16 (2013.01); A61B 5/746 (2013.01); A61B 2503/08 (2013.01); A61B 2505/07 (2013.01); A63F 13/23 (2014.09); A63F 13/25 (2014.09); A63F 2300/308 (2013.01); G06T 7/50 (2017.01); H04L 67/12 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A home automation (HA) system comprising:
a cloud server;
a plurality of HA operation devices;
a plurality of HA user interface devices for respective users and each comprising a user audio input device, a touch display defining a user interface (UI), and a controller coupled to the user audio input device and the touch display, the controller of each HA user interface device being switchable between a voice input mode for receiving user input based upon the user audio input device and a touch input mode for receiving user input based upon the touch display; and
a plurality of HA hub devices to provide communications for the cloud server, the plurality of HA user interface devices and the plurality of HA operation devices;
the controller of each HA user interface device configured to send user interaction data to the cloud server and operate the UI according to a user cognitive level, the user interaction data comprising a current touch display user contact location and historical touch display user contact locations; and
the cloud server configured to
determine the user cognitive level based upon the user interaction data received from a given HA user interface device,
decrease the user cognitive level based upon the current touch display user contact location being outside a touch location threshold relative to the historical touch display user contact locations, and
send the user cognitive level to the given HA user interface device; and
the controller of each HA user interface device being configured to switch from the touch input mode to the voice input mode based upon the decreased user cognitive level.