US 12,456,455 B2
Natural-language based order processing
Emma Marie Chadwick, Atlanta, GA (US); Trisha Bhandary, Atlanta, GA (US); Vishal Bilagi, Atlanta, GA (US); T'Avvion Jones, Mableton, GA (US); and Harnoor Singh, Atlanta, GA (US)
Assigned to NCR Voyix Corporation, Atlanta, GA (US)
Filed by NCR Voyix Corporation, Atlanta, GA (US)
Filed on Oct. 13, 2021, as Appl. No. 17/500,187.
Prior Publication US 2023/0114834 A1, Apr. 13, 2023
Int. Cl. G10L 15/08 (2006.01); G06F 40/42 (2020.01); G10L 15/22 (2006.01); G10L 15/26 (2006.01); G10L 19/00 (2013.01)
CPC G10L 15/08 (2013.01) [G06F 40/42 (2020.01); G10L 15/22 (2013.01); G10L 15/26 (2013.01); G10L 19/0018 (2013.01); G10L 2015/223 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method, comprising:
detecting a presence of a customer at a device equipped with a plurality of peripheral devices including at least a microphone and a speaker, and optionally a camera or a motion sensor;
initiating a natural-language voice dialogue with the customer during a session based on the detected presence, wherein the natural-language voice dialogue is facilitated by a session manager configured to establish the session via speech captured by the microphone;
translating voice statements of the customer during the session to order details of an order using a dialogue application programming interface (API) translator that converts audio speech of the customer into text structured sentences or text commands;
placing the order with a transaction system associated with the device based on the order details, wherein the transaction system interacts with fulfillment terminals at a store to communicate the order and the order details for fulfillment and delivery to the customer; and
providing a location identifier associated with a geographical location of the device to the dialogue API translator, wherein the location identifier configures the dialogue API translator for a dialect or accent used in the geographical location when translating the voice statements;
wherein the transaction system is configured to update a display associated with the device with results based on sending commands to the transaction system using the dialogue API translator;
wherein the display is updated in real-time as the customer provides voice statements during the session to show a visual representation of ordered items;
wherein the session manager uses the dialogue API translator to instruct the transaction system to begin an order for the customer at the store associated with the device, which causes a menu of items associated with the store to be rendered and presented on the display associated with the device for customer viewing.