US 12,190,691 B2
Method for determining a noteworthy sub-sequence of a monitoring image sequence
Christian Neumann, Hildesheim (DE); Christian Stresing, Berlin (DE); Gregor Blott, Salzgitter (DE); and Masato Takami, Hildesheim (DE)
Assigned to ROBERT BOSCH GMBH, Stuttgart (DE)
Appl. No. 17/915,668
Filed by Robert Bosch GmbH, Stuttgart (DE)
PCT Filed Jun. 21, 2021, PCT No. PCT/EP2021/066765
§ 371(c)(1), (2) Date Sep. 29, 2022,
PCT Pub. No. WO2022/017702, PCT Pub. Date Jan. 27, 2022.
Claims priority of application No. 10 2020 209 025.4 (DE), filed on Jul. 20, 2020.
Prior Publication US 2023/0114524 A1, Apr. 13, 2023
Int. Cl. G08B 13/196 (2006.01); G08B 13/16 (2006.01); G08B 29/18 (2006.01)
CPC G08B 13/19613 (2013.01) [G08B 13/1672 (2013.01); G08B 13/19669 (2013.01); G08B 29/186 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A method for determining a noteworthy sub-sequence of a monitoring image sequence of a monitoring area of a monitored environment that has been generated by an imaging system, comprising the following steps:
providing an audio signal from the monitoring area, which at least partially corresponds to a time period of the monitoring image sequence;
providing the monitoring image sequence;
determining at least one segment of the audio signal from the provided audio signal, which has unusual noises that have one or more audio characteristics predefined as being unusual;
determining at least one segment of the monitoring image sequence having, within the monitored environment, unusual movements that have one or more image characteristics predefined as being unusual; and
determining a correlation between the at least one segment of the audio signal having the unusual noises and the at least one segment of the monitoring image sequence having the unusual movement to determine the noteworthy sub-sequence of the monitoring image sequence;
wherein the method includes at least one of the following two features (I)-(II):
(I) the at least one noteworthy sub-sequence of the monitoring image sequence is determined by subtracting from the monitoring image sequence at least one sub-sequence in which an expression of the correlation between the at least one segment of the monitoring image sequence having the unusual movements and the at least one segment of the audio signal having the unusual noises below a limit value is determined; and
(II) the unusual movements in the monitoring area are determined based on a change in an amount of effort required to compress successive images of the monitoring image sequence.