US 12,142,080 B2
Data processing system and data processing method
Tatsuya Okano, Kanagawa (JP); Teppei Oguni, Kanagawa (JP); and Kengo Akimoto, Kanagawa (JP)
Assigned to Semiconductor Energy Laboratory Co., Ltd., Atsugi (JP)
Appl. No. 17/778,623
Filed by SEMICONDUCTOR ENERGY LABORATORY CO., LTD., Atsugi (JP)
PCT Filed Nov. 20, 2020, PCT No. PCT/IB2020/060947
§ 371(c)(1), (2) Date May 20, 2022,
PCT Pub. No. WO2021/111234, PCT Pub. Date Jun. 10, 2021.
Claims priority of application No. 2019-221620 (JP), filed on Dec. 6, 2019.
Prior Publication US 2022/0415089 A1, Dec. 29, 2022
Int. Cl. G06V 10/74 (2022.01); G06V 10/762 (2022.01); G06V 10/82 (2022.01); G06V 40/16 (2022.01); G06V 40/20 (2022.01)
CPC G06V 40/20 (2022.01) [G06V 10/761 (2022.01); G06V 10/762 (2022.01); G06V 10/82 (2022.01); G06V 40/178 (2022.01)] 3 Claims
OG exemplary drawing
 
1. A data processing system comprising:
an imaging portion;
a first processing portion;
a second processing portion;
a third processing portion; and
a fourth processing portion,
wherein the imaging portion is configured to obtain first to n-th images (n is an integer greater than or equal to 2) each comprising an image of a person's face, and a query image,
wherein the first processing portion is configured to obtain a reference image on the basis of the first to n-th images,
wherein the second processing portion comprises a neural network comprising an input layer, an intermediate layer, and an output layer,
wherein the second processing portion is configured to output first to n-th estimated ages or a reference estimated age from the output layer and output first to n-th data or reference data from the intermediate layer in the case where the first to n-th images or the reference image is input to the input layer,
wherein the second processing portion is configured to output a query estimated age from the output layer and output query data from the intermediate layer in the case where the query image is input to the input layer,
wherein the third processing portion is configured to obtain first to n-th coordinates in each of which an x-coordinate is a value of a difference between the reference estimated age and corresponding one of the first to n-th estimated ages and a y-coordinate is a value of a degree of similarity between the reference data and corresponding one of the first to n-th data,
wherein the third processing portion is configured to obtain query coordinates in which an x-coordinate is a value of a difference between the query estimated age and the reference estimated age and a y-coordinate is a value of a degree of similarity between the query data and the reference data, and
wherein the fourth processing portion is configured to perform clustering on the basis of the first to n-th coordinates and determine whether the person included in the query image feels fatigue on the basis of a result of the clustering and the query coordinates.