US 12,277,709 B2
Portable electronic device and wound-size measuring method using the same
Wen Hsin Hu, New Taipei (TW); Ji-Yi Yang, New Taipei (TW); Zhe-Yu Lin, New Taipei (TW); Hui Chi Hsieh, New Taipei (TW); Yin Chi Lin, New Taipei (TW); and Chi Lun Huang, New Taipei (TW)
Assigned to WISTRON CORP., New Taipei (TW)
Filed by Wistron Corp., New Taipei (TW)
Filed on Nov. 25, 2021, as Appl. No. 17/535,622.
Claims priority of application No. 110130445 (TW), filed on Aug. 18, 2021.
Prior Publication US 2023/0058754 A1, Feb. 23, 2023
Int. Cl. G06K 9/00 (2022.01); G06F 18/23 (2023.01); G06N 3/08 (2023.01); G06T 7/00 (2017.01); G06T 7/11 (2017.01); G06T 7/62 (2017.01); G06T 7/73 (2017.01); G06T 7/80 (2017.01); G06V 10/22 (2022.01); G06V 10/75 (2022.01); G06V 10/94 (2022.01); G16H 30/40 (2018.01); H04N 17/00 (2006.01); H04N 23/63 (2023.01); H04N 23/80 (2023.01)
CPC G06T 7/0016 (2013.01) [G06F 18/23 (2023.01); G06N 3/08 (2013.01); G06T 7/11 (2017.01); G06T 7/62 (2017.01); G06T 7/74 (2017.01); G06T 7/80 (2017.01); G06V 10/225 (2022.01); G06V 10/751 (2022.01); G06V 10/95 (2022.01); G16H 30/40 (2018.01); H04N 17/002 (2013.01); H04N 23/63 (2023.01); H04N 23/80 (2023.01); G06T 2207/10024 (2013.01); G06T 2207/20076 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30004 (2013.01); G06T 2207/30244 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A portable electronic device, comprising:
an inertial-measurement unit, configured to detect a pitch angle of the portable electronic device;
a camera device, configured to obtain an input image;
a storage device, configured to store an operating system, a wound-measuring program, a CNN (convolutional neural network) model, and an RPN (regional proposal network) model; and
a processor, configured to execute the wound-size measuring program to perform the following steps:
using the CNN model to recognize the input image, and to select a part of the input image with the highest probability of containing a wound as an output wound image; and
calculating an actual height and an actual width of the output wound image according to a lens-focal-length parameter reported by the operating system, a plurality of reference calibration parameters corresponding to the pitch angle, and a pixel-height ratio and a pixel-width ratio of the output wound image;
wherein the processor further performs a machine-learning clustering algorithm to divide the output wound image into a wound region and a normal-skin region,
wherein the processor further calculates a first pixel number in the output wound image and a second pixel number in the wound region, and divides the second pixel number by the first pixel number to obtain a wound-region pixel ratio,
wherein the processor further multiplies the actual height of the output wound image by the actual width of the output wound image to obtain an actual area of the output wound image, and multiplies the actual area by the wound-region pixel ratio to obtain an actual area of the wound region.