| CPC G06Q 30/04 (2013.01) [G06Q 20/207 (2013.01); G06Q 40/10 (2013.01); G06Q 40/12 (2013.12); G06Q 40/123 (2013.12)] | 18 Claims |
|
1. A method comprising:
at a computer system comprising at least one processor and memory:
receiving, from a computing device associated with a shopper, an image of a receipt for an order that has been fulfilled;
applying an image processing algorithm to identify a tax item in the image of the receipt, wherein applying the image processing algorithm comprises:
determining a location of an instance of text that is related to the tax item in the image;
applying a bounding box around the instance of text in the image at the determined location; and
applying an optical character recognition (OCR) to the image within the bounding box to extract text that is related to the tax item from the image;
identifying, using the extracted text, a tax amount associated with the tax item in the image, the tax amount representing an amount of tax paid at a point-of-sale (POS) system, wherein identifying the tax amount comprises:
generating, using the extracted text, an input to a machine learning model by segmenting the extracted text into one or more tokens, wherein the machine learning model is trained with training data comprising tokens segmented from extracted text that are associated with actual tax paid,
applying the machine learning model to the one or more tokens, and
receiving, from the machine learning model, the tax amount associated with the tax item in the image;
determining a confidence score of the identified tax amount, the confidence score indicating a level of accuracy of the identified tax amount; and
performing an automated tax reconciliation process based on the tax amount and the confidence score.
|