US 11,861,674 B1
Method, one or more computer-readable non-transitory storage media, and a system for generating comprehensive information for products of interest by assistant systems
Lisa Xiaoyi Huang, Mountain View, CA (US); Eric Xiao, Berkeley, CA (US); Rui Shao, Mountain View, CA (US); and Animesh Sinha, Mountain View, CA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Oct. 21, 2019, as Appl. No. 16/659,419.
Claims priority of provisional application 62/923,342, filed on Oct. 18, 2019.
Int. Cl. G06Q 30/00 (2023.01); G06Q 30/0601 (2023.01); G06N 20/00 (2019.01)
CPC G06Q 30/0631 (2013.01) [G06N 20/00 (2019.01); G06Q 30/0603 (2013.01); G06Q 30/0633 (2013.01); G06Q 30/0643 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising, by a client system associated with a first user:
receiving, at the client system by a client-side assistant application, a video input from one or more cameras of the client system, wherein the video input comprises a field of view of the first user;
determining, based on one or more machine-learning models and the video input, one or more products of interest to the first user within the field of view, wherein the determining comprises:
prioritizing one or more regions of the video input comprising the one or more products of interest for processing, and
analyzing the one or more prioritized regions of the video input by the one or more machine-learning models;
accessing, by the client system from a data store of a server-side assistant application, social data associated with the one or more products of interest, wherein the social data comprises social signals and second content objects associated with one or more second users, each second user being within a threshold degree of separation of the first user within a social graph, and wherein the second content objects were previously authored by the one or more second users on an online social network;
generating, based on the accessed social data, one or more social summaries associated with the one or more products of interest, wherein the one or more social summaries comprise summarization s of the second content objects previously authored by the one or more second users;
generating, based on first content objects associated with the first user's episodic memories of one or more of the one or more products of interest, one or more shopping suggestions for the one or more of the one or more products of interest, wherein the first content objects identify the one or more of the one or more products of interest;
proactively presenting, at the client system by the client-side assistant application and responsive to the determining of the one or more products of interest, the one or more social summaries of the one or more products of interest and the one or more shopping suggestions for the one or more of the one or more products of interest;
receiving, at the client system by the client-side assistant application, a user selection of one of the one or more products of interest; and
proactively sending, from the client system to a first retailer, a purchase request of the selected product of interest to the first retailer, wherein the first retailer is determined based on location information associated with the first user, user profile data associated with the first user, and delivery information associated with the selected product of interest.