US 11,943,181 B2
Personality reply for digital content
Ibrahim Badr, Zurich (CH); Aayush Kumar, Zurich (CH); Goekhan Hasan Bakir, Zurich (CH); Nils Grimsmo, Adliswil (CH); and Bianca Madalina Buisman, Kilchberg (CH)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by GOOGLE LLC, Mountain View, CA (US)
Filed on Jul. 7, 2022, as Appl. No. 17/859,460.
Application 17/859,460 is a continuation of application No. 17/019,575, filed on Sep. 14, 2020, granted, now 11,405,340.
Application 17/019,575 is a continuation of application No. 16/411,792, filed on May 14, 2019, granted, now 10,778,619, issued on Sep. 15, 2020.
Application 16/411,792 is a continuation of application No. 15/587,783, filed on May 5, 2017, granted, now 10,341,272, issued on Jul. 2, 2019.
Prior Publication US 2022/0337539 A1, Oct. 20, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. H04L 51/046 (2022.01); H04L 51/10 (2022.01)
CPC H04L 51/046 (2013.01) [H04L 51/10 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors comprising:
receiving an electronic communication that includes an image, the electronic communication being received at a computing device and from an additional computing device;
subsequent to receiving the electronic communication that includes the image, but prior to a reply electronic communication that is a reply to the electronic communication being transmitted to the additional computing device:
processing the image to identify one or more items included in the image from the received electronic communication, wherein processing the image to identify one or more of the items included in the image comprises:
processing, using an image recognition module, the image to extract one or more features of the image; and
generating, based on one or more of the features extracted from the image, a label for one or more of the items included in the image, the label including a natural language description for one or more of the items included in the image;
generating, based on one or more of the items included in the image, multiple candidate replies that are each descriptive of the item in the image, wherein generating the multiple candidate replies comprises generating a given candidate reply, of the multiple candidate replies, based on previous replies created by a plurality of users that are related to one or more of the items included in the image, wherein generating the given candidate reply based on the previous replies created by the plurality of users that are related to one or more of the items included in the image comprises:
identifying, based on the natural language description for one or more of the items included in the image, at least one content item, from the previous replies created by the plurality of users, associated with one or more of the items included in the image; and
generating the given candidate reply based on the at least one content item that is associated with one or more of the items included in the image; and
causing one or more of the multiple candidate replies to be visually rendered for presentation to a user of the computing device via an electronic communications interface of the computing device;
receiving a user selection of a given candidate reply, of the multiple candidate replies, the user selection being received via the electronic communications interface of the computing device; and
causing the given candidate reply to be transmitted to the additional computing device as the reply electronic communication that is the reply to the electronic communication.