US 12,079,856 B2
Method for providing shopping information for individual products and electronic device performing same
Lok Won Kim, Seongnam-si (KR)
Assigned to DEEPX CO., LTD., Seongnam-si (KR)
Filed by DEEPX CO., LTD., Seongnam-si (KR)
Filed on Dec. 22, 2020, as Appl. No. 17/129,955.
Application 17/129,955 is a continuation of application No. PCT/KR2019/012373, filed on Sep. 24, 2019.
Claims priority of application No. 10-2018-0172937 (KR), filed on Dec. 28, 2018.
Prior Publication US 2021/0110454 A1, Apr. 15, 2021
Int. Cl. G06Q 30/00 (2023.01); G06F 16/9538 (2019.01); G06F 18/214 (2023.01); G06F 18/40 (2023.01); G06N 3/04 (2023.01); G06N 3/08 (2023.01); G06Q 30/0601 (2023.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 10/94 (2022.01); G06V 20/20 (2022.01); H04N 23/63 (2023.01); G06F 3/0481 (2022.01)
CPC G06Q 30/0633 (2013.01) [G06F 16/9538 (2019.01); G06F 18/214 (2023.01); G06F 18/40 (2023.01); G06N 3/04 (2013.01); G06N 3/08 (2013.01); G06Q 30/0623 (2013.01); G06Q 30/0643 (2013.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 10/95 (2022.01); G06V 20/20 (2022.01); H04N 23/63 (2023.01); G06F 3/0481 (2013.01)] 5 Claims
OG exemplary drawing
 
1. A method for providing shopping information by product, the method comprising:
an image acquisition step in which a camera-associated app linked to a camera module acquires a product image through the camera module, the camera-associated app acquiring the product image when a product is displayed on a camera-working screen;
a recognition step in which an AI recognition model obtained by machine learning of an artificial neural network receives the product image and recognizes product information, the product information recognized by the AI recognition model including a trademark of the product of the product image and a product information label corresponding to the product of the product image;
a processing step in which the product information is converted into information forming a query upon the product information being recognized by the AI recognition model;
a transmission step in which a communication module transmits the query to a server;
a first receiving step in which the communication module receives, from the server, shopping information corresponding to the product information for each of a plurality of shopping malls;
a display step in which a display module displays the shopping information for each of the plurality of shopping malls on a screen, the display step enabling a user to select a desired shopping mall among the plurality of shopping malls;
a second receiving step in which the communication module receives, from the server, update information for updating the AI recognition model; and
an updating step in which a parameter including at least one of a weight and a bias of the artificial neural network of the AI recognition model is updated based on the update information,
wherein, in the first receiving step and the display step, the shopping information includes lowest price information,
wherein the AI recognition model is processed by a neural processing unit configured physically separate from a processor for performing the processing step,
wherein the product image is not stored in a photo library, and
wherein the recognition step includes
displaying on the screen a user input mode including a virtual keyboard or voice input together with recognition failure information, if the AI recognition model does not recognize the product information, and
recognizing the product information that is input through the user input mode as the product information of the recognition step.