US 11,967,063 B2
Automatic bio-specimen inspection system and inspection method thereof
Shang-Kun Li, Taichung (TW); and Shu Huang, Zhudong Township (TW)
Assigned to INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE, Hsinchu (TW)
Filed by INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE, Hsinchu (TW)
Filed on Feb. 23, 2021, as Appl. No. 17/182,740.
Claims priority of provisional application 63/001,588, filed on Mar. 30, 2020.
Claims priority of application No. 109144987 (TW), filed on Dec. 18, 2020.
Prior Publication US 2021/0304404 A1, Sep. 30, 2021
Int. Cl. G06T 7/00 (2017.01); A61B 10/00 (2006.01); G06N 3/0475 (2023.01); G06N 3/094 (2023.01)
CPC G06T 7/0012 (2013.01) [A61B 10/0045 (2013.01); G06N 3/0475 (2023.01); G06N 3/094 (2023.01); A61B 2562/0247 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30004 (2013.01)] 15 Claims
OG exemplary drawing
 
1. An automatic bio-specimen inspection system comprising:
an inspection device, used to approach an inspection site for performing a bio-specimens collection and/or inspection;
an image processing module, used to capture and process a plurality of two-dimensional (2D) images of the inspection site;
a spatial learning module, used to generate a three-dimensional (3D) spatial information of the inspection site according to the plurality of 2D images;
a path generation module, comprising an inspection path generation network and a discrimination network used to generate an inspection path information based on the 3D spatial information; wherein the generation of the inspection path information comprises:
performing a plurality of manual operations to capture the plurality of 2D images;
using the spatial learning module to generate the 3D spatial information;
recording a plurality of manual inspection paths of the inspection device and the 3D spatial information corresponding to each of the plurality of manual inspection paths;
establishing the inspection path generation network of the path generation module based on the plurality of manual inspection paths and the 3D spatial information;
using the inspection path generation network to generate a virtual inspection path based on the 3D spatial information; and
applying the discrimination network to compare the virtual inspection path with the manual inspection paths and providing a comparison feedback to the inspection path generation network based on a comparison result; and
a motion device, used to move the inspection device to the inspection site according to the inspection path information for performing the bio-specimens collection and/or inspection.