US 11,655,576 B2
Operating mode determining method and operating mode determining device
Suk Kyoung So, Seongnam-si (KR)
Assigned to LG ELECTRONICS INC., Seoul (KR)
Filed by LG ELECTRONICS INC., Seoul (KR)
Filed on Sep. 23, 2019, as Appl. No. 16/579,741.
Claims priority of application No. 10-2019-0103063 (KR), filed on Aug. 22, 2019.
Prior Publication US 2020/0018006 A1, Jan. 16, 2020
Int. Cl. D06F 33/32 (2020.01); G06N 3/08 (2023.01); G05B 13/02 (2006.01); G06T 7/00 (2017.01); D06F 34/18 (2020.01); G06V 30/413 (2022.01); G06F 18/21 (2023.01); G06N 3/045 (2023.01); H04N 23/90 (2023.01); G06V 30/19 (2022.01); G06V 10/80 (2022.01); G06V 10/82 (2022.01); D06F 103/00 (2020.01); D06F 103/02 (2020.01); D06F 103/06 (2020.01); D06F 103/38 (2020.01); D06F 105/00 (2020.01); D06F 105/54 (2020.01); D06F 105/58 (2020.01); D06F 105/60 (2020.01); D06F 33/36 (2020.01)
CPC D06F 33/32 (2020.02) [D06F 34/18 (2020.02); G05B 13/0265 (2013.01); G06F 18/21 (2023.01); G06N 3/045 (2023.01); G06N 3/08 (2013.01); G06T 7/97 (2017.01); G06V 10/803 (2022.01); G06V 10/82 (2022.01); G06V 30/19173 (2022.01); G06V 30/413 (2022.01); H04N 23/90 (2023.01); D06F 33/36 (2020.02); D06F 2103/00 (2020.02); D06F 2103/02 (2020.02); D06F 2103/06 (2020.02); D06F 2103/38 (2020.02); D06F 2105/00 (2020.02); D06F 2105/54 (2020.02); D06F 2105/58 (2020.02); D06F 2105/60 (2020.02); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01)] 13 Claims
OG exemplary drawing
 
1. A method of controlling an operation of a clothing treatment apparatus installed indoors, the method comprising:
obtaining first image information obtained by photographing clothing through a camera of the clothing treatment apparatus;
obtaining second image information obtained by photographing an entrance and exit of a user wearing the clothing through a camera for monitoring an entrance and exit of a room of a home; and
determining an operating mode of the clothing treatment apparatus according to an analysis result of both the first image information of the clothing in the clothing treatment apparatus and the second image information of the user wearing the clothing outside of the clothing treatment apparatus when the user enters and exits the home while wearing the clothing,
wherein the first image information and the second image information are obtained from images of identical clothing by different cameras at different times, and
wherein the determining of the operating mode comprises:
determining a clothing material from the first image information by using a first deep neural network that is pre-trained to determine a clothing material from a clothing image;
extracting management guide information of the clothing based on a database in which a management guide according to a clothing material type is stored in advance;
predicting a state of the clothing by extracting weather information between a going out time and a returning time of the user wearing the clothing outside of the home that are included in the second image information; and
determining the operating mode of the clothing treatment apparatus by combining the determined clothing material, the management guide information of the clothing, and the predicted state of the clothing.