US 12,444,159 B2
Commodity image information acquisition system, method and apparatus
Sheng Huang, Shanghai (CN); Yitang Zhuang, Shanghai (CN); and Xiaoping Jin, Shanghai (CN)
Assigned to SHANGHAI HANSHI INFORMATION TECHNOLOGY CO., LTD., Shanghai (CN)
Filed by SHANGHAI HANSHI INFORMATION TECHNOLOGY CO., LTD., Shanghai (CN)
Filed on Jul. 26, 2024, as Appl. No. 18/785,841.
Claims priority of application No. 202311747373.0 (CN), filed on Dec. 18, 2023.
Prior Publication US 2025/0200929 A1, Jun. 19, 2025
Int. Cl. G06V 10/26 (2022.01); G06V 10/24 (2022.01)
CPC G06V 10/26 (2022.01) [G06V 10/245 (2022.01)] 10 Claims
OG exemplary drawing
 
1. A commodity image information acquisition system, comprising:
an AIoT management server configured to transmit a commodity information list to a shelf label management server, and to transmit a notification of starting to take photos to an AI vision system;
a shelf label management server configured to determine an electronic shelf label to be notified based on a binding information between the electronic shelf label and a commodity, and the received commodity information list, and to transmit an information display notification to the electronic shelf label to be notified; when the electronic shelf label to be notified performs an information display action based on the information display notification, to generate matching relationship between the information display action and the barcode of the commodity and transmit the matching relationship to the AI vision system;
the AI vision system comprising a vision sensor device, a first processor and at least one first memory which comprises computer program instructions for execution by the first processor, wherein the vision sensor device is configured to shoot the information display action and obtain a shot content after receiving the notification of starting to take photos; and the instructions in the at least one first memory are configured to perform parse and obtain a recognition result comprising spatial information of the electronic shelf label and spatial information and recognition information of the commodity based on the shot content and the received matching relationship, and to transmit the shot content and the recognition result to a commodity information management system; and
the commodity information management system comprising a second processor and at least one second memory which comprises computer program instructions for execution by the second processor, wherein the instructions in the at least one second memory are configured to determine associated commodities for the electronic shelf label based on the shot content and the recognition result, and assign electronic shelf label-bound commodity information to each of the associated commodities; and wherein
the spatial information is a location boundary frame; and
the instructions in the at least one first memory of the AI vision system are specifically configured to:
discard the shot content without information display action;
detect the electronic shelf label in the remaining shot content, to obtain the location boundary frame of each electronic shelf label:
recognize the information display action for each detected electronic shelf label;
parse the information display action and obtain the recognition information based on the matching relationship between the information display action and the barcode of the commodity, wherein the recognition information is the barcode of the corresponding commodity of each electronic shelf label; and
detect the commodity in the shot content, to obtain the location boundary frame of each commodity.