US 11,836,777 B2
Intelligent online personal assistant with multi-turn dialog based on visual search
Ajinkya Gorakhnath Kale, San Jose, CA (US); Fan Yang, San Jose, CA (US); Qiaosong Wang, San Francisco, CA (US); Mohammadhadi Kiapour, Roslyn, NY (US); and Robinson Piramuthu, Oakland, CA (US)
Assigned to eBay Inc., San Jose, CA (US)
Filed by eBay Inc., San Jose, CA (US)
Filed on Apr. 2, 2021, as Appl. No. 17/221,367.
Application 17/221,367 is a continuation of application No. 15/294,765, filed on Oct. 16, 2016, granted, now 11,004,131.
Prior Publication US 2021/0224876 A1, Jul. 22, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 30/00 (2023.01); G06Q 30/0601 (2023.01); G06F 16/583 (2019.01); G06F 16/2452 (2019.01); G06F 16/2457 (2019.01); G06F 16/532 (2019.01); G06N 5/022 (2023.01); G06N 3/044 (2023.01); G06N 7/01 (2023.01); G06N 3/02 (2006.01)
CPC G06Q 30/0625 (2013.01) [G06F 16/24522 (2019.01); G06F 16/24578 (2019.01); G06F 16/532 (2019.01); G06F 16/583 (2019.01); G06N 3/02 (2013.01); G06N 3/044 (2023.01); G06N 5/022 (2013.01); G06N 7/01 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving an input query image;
assembling a list of candidate products based on a visual similarity measure between the input query image and one or more candidate products in the list of candidate products;
providing, for at least a subset of candidate products in the list of candidate products, corresponding knowledge graph information comprising aggregate historical electronic marketplace user interaction information;
determining, based on the corresponding knowledge graph information, a mismatch between the list of candidate products and a non-image input;
outputting an instruction to cause display of a user prompt on a graphical user interface of a client device, wherein the user prompt requests a specified user input in a multi-turn dialog;
receiving, from the client device via the multi-turn dialog, the specified user input;
generating a filtered list of candidate products based at least upon the specified user input; and
providing the filtered list of candidate products.