US 11,893,805 B1
Service system and method for detecting number of in-vehicle persons of vehicle in high occupancy vehicle lane
Heedon Yoon, Seoul (KR); Yujeong Choe, Incheon (KR); Sangcheol Kang, Seoul (KR); and Inwon Yeon, Seoul (KR)
Assigned to G&T Solutions, Inc., Seoul (KR)
Filed by G&T Solutions, Inc., Seoul (KR)
Filed on Oct. 24, 2023, as Appl. No. 18/383,413.
Claims priority of application No. 10-2023-0035477 (KR), filed on Mar. 17, 2023.
Int. Cl. G06V 20/59 (2022.01); G06V 20/62 (2022.01); G06V 20/70 (2022.01); H04N 7/18 (2006.01)
CPC G06V 20/593 (2022.01) [G06V 20/625 (2022.01); G06V 20/70 (2022.01); H04N 7/181 (2013.01)] 9 Claims
OG exemplary drawing
 
1. A service system for detecting the number of in-vehicle persons of a vehicle in a high occupancy vehicle lane, the service system comprising:
a first camera unit disposed diagonally to a traveling direction of the vehicle and configured to transmit first image information composed of a plurality of frame images by continuously photographing the vehicle;
a second camera unit disposed orthogonally to the traveling direction of the vehicle and configured to transmit second image information composed of a plurality of frame images by continuously photographing the vehicle; and
a control device configured to detect an object corresponding to an in-vehicle person of the vehicle for each of a plurality of seat regions respectively corresponding to a plurality of seats, which is separated for the in-vehicle persons sit, by performing image analysis on each of the plurality of frame images constituting the first image information, and then label each of seat regions in which an object is detected with a preset seat number corresponding to the seat region, thereby creating first labeling information including one or more frame images labeled with seat numbers,
configured to create second labeling information based on the second image information in the way of creating the first labeling information based on the first image information,
configured to total the number of seat numbers such that seat numbers are not repeatedly totaled based on the first labeling information and the second labeling information, and calculate a final number of in-vehicle persons as the totaled number of seat numbers, and
configured to determine whether the vehicle violates a law about use of a high occupancy vehicle lane based on the final number of in-vehicle persons,
wherein the control device:
extracts feature information of an object detected in a seat region for each of seat regions in which an object is detected based on the first image information;
creates in-vehicle person information including the seat information of the object and a preset seat number corresponding to the seat region in which the object is detected, and matches and stores the feature information with the first labeling information created to correspond to the first image information;
creates one or more items of in-vehicle person information in the same way as creating the in-vehicle person information based on the first image information, and matches and stores the one or more items of in-vehicle person information with the second labeling information;
compares feature information of one or more items of in-vehicle person information matched to the first labeling information or the second labeling information in accordance with a preset similarity algorithm, and when there is a plurality of items of in-vehicle person information in which similarity of feature information is a preset reference value or more and that has different seat numbers, determines the in-vehicle person information as repeated in-vehicle person information;
sets and deletes the other in-vehicle person information excluding in-vehicle person information corresponding to a most repeated seat number as deletion target in-vehicle person information by comparing the plurality of items of repeated in-vehicle person information;
checks one or more seat numbers based on one or more items of in-vehicle person information matched to the first labeling information or the second labeling information after the deletion target in-vehicle person information is deleted; and
totals the number of seat numbers such that same numbers are not repeatedly totaled for the checked one or more seat numbers, and calculates the totaled number of seat numbers as the final number of in-vehicle persons.