US 12,347,201 B2
Interacting with visitors of a connected home environment
William Alexander Finlayson, San Francisco, CA (US); Liana Kong, Redwood City, CA (US); John Jordan Nold, Longmont, CO (US); Sahana Mysore, Menlo Park, CA (US); and Ruiyi Song, Sunnyvale, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Dec. 11, 2023, as Appl. No. 18/535,779.
Application 18/535,779 is a continuation of application No. 17/116,662, filed on Dec. 9, 2020, granted, now 11,893,795.
Claims priority of provisional application 62/945,724, filed on Dec. 9, 2019.
Prior Publication US 2024/0104930 A1, Mar. 28, 2024
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/52 (2022.01); G06F 3/16 (2006.01); G06V 20/40 (2022.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01); G08B 13/196 (2006.01)
CPC G06V 20/52 (2022.01) [G06F 3/165 (2013.01); G06V 20/41 (2022.01); G06V 40/10 (2022.01); G06V 40/20 (2022.01); G08B 13/196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
maintaining a plurality of response models for a plurality of predefined visitor groups, one or more response models of the plurality of response models being modifiable based on user input or previous visitor interactions;
obtaining sensor data captured by one or more sensors of a visitor interaction system;
determining an approach of a person toward the visitor interaction system;
collecting contextual information related to the person;
determining, based on the contextual information related to the person, that the person belongs to a respective predefined visitor group of the plurality of predefined visitor groups, each of the plurality of predefined visitor groups corresponding to a respective predefined response model of the plurality of predefined response models, one or more predefined response models of the plurality of predefined response models including at least one response action of a plurality of response actions, a respective response action of the plurality of response actions being executable by the visitor interaction system without requiring intervention of a user of the visitor interaction system;
identifying a respective predefined response model of the plurality of predefined response models corresponding to the respective predefined visitor group of the plurality of predefined visitor groups, the respective predefined response model being specific to the person based on the contextual information; and
initiating, by the visitor interaction system, a first autonomous action of a plurality of respective autonomous actions based on the respective predefined response model.