US 12,437,539 B2
System and method for identifying activity in an area using a video camera and an audio sensor
Hisao Chang, Medina, MN (US)
Assigned to HONEYWELL INTERNATIONAL INC., Charlotte, NC (US)
Filed by Honeywell International Inc., Charlotte, NC (US)
Filed on Mar. 17, 2023, as Appl. No. 18/122,956.
Application 18/122,956 is a continuation of application No. 17/208,542, filed on Mar. 22, 2021, granted, now 11,620,827.
Prior Publication US 2023/0222799 A1, Jul. 13, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06V 20/40 (2022.01); G06F 16/632 (2019.01); G06F 16/635 (2019.01); G06V 10/12 (2022.01); G06V 20/10 (2022.01); G06V 20/52 (2022.01); G10L 25/51 (2013.01); G10L 25/72 (2013.01)
CPC G06V 20/46 (2022.01) [G06F 16/634 (2019.01); G06F 16/635 (2019.01); G06V 10/12 (2022.01); G06V 20/10 (2022.01); G06V 20/41 (2022.01); G06V 20/53 (2022.01); G10L 25/51 (2013.01); G10L 25/72 (2013.01); G06V 20/44 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A method for identifying activity in an area, the method comprising:
identifying a sound event in an audio stream captured by an audio sensor;
comparing one or more sound characteristics of the sound event with one or more predetermined sound profiles stored in an audio library, wherein each of the one or more predetermined sound profiles is associated with one or more events of interest, and when there is a match, identifying a matching event of interest;
removing from the audio stream one or more sound characteristics associated with the matching event of interest, including filtering out one or more spectral components from the audio stream that are associated with the matching event of interest while passing the remaining spectral components, resulting in a modified audio stream to determine whether one or more abnormal sounds are present in the audio stream now that the one or more sound characteristics associated with the matching event of interest are removed;
analyzing the modified audio stream for an abnormal sound remaining in the modified audio stream; and
issuing an alert when the abnormal sound is detected in the modified audio stream.