US 11,861,584 B2
Self-service settlement method, apparatus and storage medium
Hailin Shi, Beijing (CN); He Zhao, Beijing (CN); Wu Liu, Beijing (CN); Tao Mei, Beijing (CN); and Bowen Zhou, Beijing (CN)
Assigned to BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO, LTD., Beijing (CN); and BEIJING JINGDONG CENTURY TRADING CO., LTD., Beijing (CN)
Appl. No. 17/291,187
Filed by BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO, LTD., Beijing (CN); and BEIJING JINGDONG CENTURY TRADING CO., LTD., Beijing (CN)
PCT Filed Jul. 26, 2019, PCT No. PCT/CN2019/097950
§ 371(c)(1), (2) Date May 4, 2021,
PCT Pub. No. WO2020/103487, PCT Pub. Date May 28, 2020.
Claims priority of application No. 201811380178.8 (CN), filed on Nov. 20, 2018.
Prior Publication US 2022/0076227 A1, Mar. 10, 2022
Int. Cl. G06Q 20/20 (2012.01); G06Q 20/18 (2012.01); G06Q 30/0601 (2023.01); G06F 18/00 (2023.01)
CPC G06Q 20/208 (2013.01) [G06F 18/00 (2023.01); G06Q 20/18 (2013.01); G06Q 20/201 (2013.01); G06Q 30/0631 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A self-service settlement method, comprising:
obtaining, by processing circuitry, a monitoring image captured by an image capture device, wherein the monitoring image corresponds to commodities to be settled which are placed on a settlement counter;
recognizing, by the processing circuitry, the monitoring image to obtain information of the commodities to be settled, wherein the information of the commodities to be settled comprises a category and quantity of the commodities to be settled, wherein the recognizing step further comprises
determining a first position corresponding to the commodities to be settled and a second position corresponding to a coordinate scale on the settlement counter in the monitoring image using an object detection model;
intercepting an image of the commodities to be settled and a coordinate scale image according to the first position and the second position in the monitoring image;
recognizing the commodities to be settled in the image of the commodities to be settled and the coordinate scale in the coordinate scale image with the use of an neural network model, and determining size information of the commodities to be settled according to a corresponding relation between the coordinate scale and the size of the commodities to be settled;
recognizing a commodity type to which the commodities to be settled in the image of the commodities to be settled belong, and obtaining a quantity corresponding to each type of commodity to be settled; and
determining the category of the commodities to be settled based on the size information of the commodities to be settled and the commodity type to which the commodities to be settled belong;
obtaining, by the processing circuitry, a first weight corresponding to the commodities to be settled, captured by a weight detection device arranged on the settlement counter, and obtaining a second weight corresponding to the commodities to be settled based on the information of the commodities to be settled;
judging, by the processing circuitry, whether the information of the commodities to be settled is matched with commodities to be confirmed according to a preset matching judgment rule and a comparison result of the first weight and the second weight; and
obtaining, by the processing circuitry, purchased commodity settlement information based on the information of the commodities to be settled under a condition that the information of the commodities to be settled is matched with the commodities to be confirmed, and performing checkout processing according to the purchased commodity settlement information,
wherein the purchased commodity settlement information comprises the category, quantity, and settlement price of the commodities to be settled, and
wherein the performing checkout processing according to the purchased commodity settlement information comprises:
sending the purchased commodity settlement information to a first display device and a second display device, respectively, to display the purchased commodity settlement information to a customer and a clerk, respectively;
receiving cost payment information sent by a customer terminal and generated according to the purchased commodity settlement information;
sending cost payment completion information to the first display device and the second display device under the condition that it is determined that the cost payment information is correct, and setting the commodities to be settled to a paid status, so as to enable the commodities to be settled to pass the detection of a safety detection device; and
sending cost payment failure information to the first display device and the second display device under the condition that it is determined that the cost payment information is incorrect.