US 11,721,186 B2
Systems and methods for categorizing motion events
Jason N. Laska, San Francisco, CA (US); Wei Hua, Palo Alto, CA (US); Prateek Reddy, San Francisco, CA (US); Akshay R. Bapat, Mountain View, CA (US); and Lawrence W. Neal, Oakland, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Dec. 28, 2021, as Appl. No. 17/564,051.
Application 17/564,051 is a continuation of application No. 15/613,013, filed on Jun. 2, 2017, granted, now 11,250,679.
Application 15/613,013 is a continuation of application No. 15/334,172, filed on Oct. 25, 2016, granted, now 9,672,427, issued on Jun. 6, 2017.
Application 15/334,172 is a continuation of application No. 14/737,963, filed on Jun. 12, 2015, granted, now 9,501,915, issued on Nov. 22, 2016.
Application 14/737,963 is a continuation in part of application No. 14/510,042, filed on Oct. 8, 2014, granted, now 9,420,331, issued on Aug. 16, 2016.
Claims priority of provisional application 62/057,991, filed on Sep. 30, 2014.
Claims priority of provisional application 62/021,620, filed on Jul. 7, 2014.
Prior Publication US 2022/0122435 A1, Apr. 21, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G08B 13/196 (2006.01); H04N 7/18 (2006.01); H04N 5/14 (2006.01); H04W 4/80 (2018.01); G06F 3/0488 (2022.01); G06F 3/0481 (2022.01); G06F 3/0482 (2013.01); G06F 3/04845 (2022.01); G06F 3/0485 (2022.01); G06F 3/04855 (2022.01); G11B 27/031 (2006.01); G11B 27/10 (2006.01); G11B 27/34 (2006.01); H04N 5/93 (2006.01); G06F 3/04883 (2022.01); G06F 3/04847 (2022.01); G06F 3/04842 (2022.01); H04N 21/234 (2011.01); H04N 21/658 (2011.01); H04N 21/845 (2011.01); G11B 27/28 (2006.01); H04N 5/92 (2006.01); H04N 7/52 (2011.01); G06V 20/40 (2022.01); G06V 20/52 (2022.01); G06V 40/20 (2022.01); G06V 40/16 (2022.01); G06F 18/24 (2023.01); G06F 18/20 (2023.01); G06F 18/2321 (2023.01); G06V 10/762 (2022.01); G11B 27/00 (2006.01); G11B 27/028 (2006.01); G11B 27/30 (2006.01); G06T 7/20 (2017.01); H04N 21/422 (2011.01); H04N 21/431 (2011.01); H04L 12/28 (2006.01)
CPC G08B 13/19615 (2013.01) [G06F 3/0481 (2013.01); G06F 3/0482 (2013.01); G06F 3/0485 (2013.01); G06F 3/0488 (2013.01); G06F 3/04842 (2013.01); G06F 3/04845 (2013.01); G06F 3/04847 (2013.01); G06F 3/04855 (2013.01); G06F 3/04883 (2013.01); G06F 18/2321 (2023.01); G06F 18/24 (2023.01); G06F 18/285 (2023.01); G06T 7/20 (2013.01); G06V 10/763 (2022.01); G06V 20/40 (2022.01); G06V 20/41 (2022.01); G06V 20/49 (2022.01); G06V 20/52 (2022.01); G06V 40/172 (2022.01); G06V 40/20 (2022.01); G08B 13/196 (2013.01); G08B 13/19608 (2013.01); G08B 13/19613 (2013.01); G08B 13/19663 (2013.01); G08B 13/19669 (2013.01); G08B 13/19671 (2013.01); G08B 13/19682 (2013.01); G08B 13/19691 (2013.01); G11B 27/005 (2013.01); G11B 27/028 (2013.01); G11B 27/031 (2013.01); G11B 27/105 (2013.01); G11B 27/28 (2013.01); G11B 27/30 (2013.01); G11B 27/34 (2013.01); H04N 5/144 (2013.01); H04N 5/145 (2013.01); H04N 5/9201 (2013.01); H04N 5/93 (2013.01); H04N 7/18 (2013.01); H04N 7/181 (2013.01); H04N 7/183 (2013.01); H04N 7/52 (2013.01); H04N 21/23418 (2013.01); H04N 21/6581 (2013.01); H04N 21/8456 (2013.01); H04W 4/80 (2018.02); G06T 2207/10016 (2013.01); G06T 2207/30232 (2013.01); G06V 20/44 (2022.01); H04L 12/2803 (2013.01); H04N 21/42204 (2013.01); H04N 21/4314 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method for categorizing motion events by a computing system, the method comprising:
obtaining a plurality of video frames from a camera, the plurality of video frames corresponding to a scene and a motion event candidate;
obtaining user information from a user of the camera;
identifying one or more visual characteristics of the scene; obtaining one or more background factors for the scene;
utilizing the obtained background factors to identify one or more motion entities;
for each identified motion entity:
classifying the motion entity by performing object recognition on the motion entity; and
obtaining one or more representative motion vectors based on a motion track of the motion entity; and
assigning a motion event category of a plurality of motion event categories to the motion event candidate based on the identified one or more visual characteristics, the obtained background factors, the classified motion entities, the obtained representative motion vectors, and the obtained user information.