US 11,854,236 B2
Fastening tool system and control method thereof
Tae Mun Hwang, Jeonju-si (KR); DongHa Jeong, Uiwang-si (KR); Byung Cheol Song, Seoul (KR); and Dong Yoon Choi, Seosan-si (KR)
Assigned to HYUNDAI MOTOR COMPANY, Seoul (KR); KIA MOTORS CORPORATION, Seoul (KR); and INHA UNIVERSITY RESEARCH AND BUSINESS FOUNDATION, Incheon (KR)
Filed by HYUNDAI MOTOR COMPANY, Seoul (KR); KIA MOTORS CORPORATION, Seoul (KR); and INHA UNIVERSITY RESEARCH AND BUSINESS FOUNDATION, Incheon (KR)
Filed on Aug. 27, 2020, as Appl. No. 17/004,659.
Claims priority of application No. 10-2019-0123901 (KR), filed on Oct. 7, 2019.
Prior Publication US 2021/0101263 A1, Apr. 8, 2021
Int. Cl. G06V 10/10 (2022.01); B25B 21/00 (2006.01); G01C 3/02 (2006.01); G01J 5/00 (2022.01); G06T 5/40 (2006.01); G06T 3/60 (2006.01); G06T 7/00 (2017.01); B25B 23/147 (2006.01); G06V 20/10 (2022.01); G06V 20/40 (2022.01); G06F 18/21 (2023.01); G06F 18/22 (2023.01); G06F 18/24 (2023.01); H04N 23/54 (2023.01); H04N 23/56 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 10/32 (2022.01); G06V 10/24 (2022.01); G06V 20/20 (2022.01); G06K 7/14 (2006.01); G06V 10/50 (2022.01)
CPC G06V 10/17 (2022.01) [B25B 21/002 (2013.01); B25B 23/147 (2013.01); G01C 3/02 (2013.01); G01J 5/00 (2013.01); G06F 18/21 (2023.01); G06F 18/22 (2023.01); G06F 18/24 (2023.01); G06T 3/60 (2013.01); G06T 5/40 (2013.01); G06T 7/0004 (2013.01); G06V 10/242 (2022.01); G06V 10/32 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/41 (2022.01); H04N 23/54 (2023.01); H04N 23/56 (2023.01); G01J 2005/0077 (2013.01); G06K 7/1413 (2013.01); G06K 7/1417 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30164 (2013.01); G06V 10/50 (2022.01)] 14 Claims
OG exemplary drawing
 
1. A fastening tool system for fastening a component part by using a supplied power, the fastening tool system comprising:
a camera portion mounted on a fastening tool to photograph a fastening portion of the component part;
an image input portion for inputting an image photographed from the camera portion when a distance with the fastening portion measured through a distance measurement sensor is within a predetermined distance;
a communication portion for transmitting data by wireless communication; and
a fastening portion determining portion that recognizes the fastening portion through machine learning algorithm-based image classification work for an input image of the camera portion and sets a torque value matched with the recognized fastening portion,
wherein, as pre-processing work for utilizing the input image for the image classification work, the fastening portion determining portion performs:
image rotation matching work that matches the input image having various angles with a representative model image;
brightness adjust work that adjusts brightness of the input image through histogram equalization work; and
tool image masking work that masks a tool socket image existing in the input image.