US 11,748,579 B2
Augmented reality speech balloon system
Piers Cowburn, London (GB); Qi Pan, London (GB); and Eitan Pilipski, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Sep. 14, 2021, as Appl. No. 17/474,392.
Application 17/474,392 is a continuation of application No. 16/749,678, filed on Jan. 22, 2020, granted, now 11,189,299.
Application 16/749,678 is a continuation of application No. 16/014,193, filed on Jun. 21, 2018, granted, now 10,614,828.
Application 16/014,193 is a continuation of application No. 15/437,018, filed on Feb. 20, 2017, granted, now 10,074,381.
Prior Publication US 2021/0407533 A1, Dec. 30, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G10L 15/26 (2006.01); G06F 40/58 (2020.01); G06T 11/00 (2006.01); G06F 40/30 (2020.01); G06F 40/205 (2020.01); G06T 11/60 (2006.01); G10L 15/25 (2013.01); G10L 21/10 (2013.01); G10L 25/63 (2013.01); G06V 20/20 (2022.01); G06V 40/16 (2022.01)
CPC G06F 40/58 (2020.01) [G06F 40/205 (2020.01); G06F 40/30 (2020.01); G06T 11/00 (2013.01); G06T 11/60 (2013.01); G06V 20/20 (2022.01); G06V 40/171 (2022.01); G10L 15/25 (2013.01); G10L 15/26 (2013.01); G10L 21/10 (2013.01); G10L 25/63 (2013.01); G06V 40/175 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
causing display of a presentation of image data at a client device, the presentation of the image data comprising a depiction of a set of facial features;
detecting, by the client device, a speech signal that comprises auditory properties;
transcribing the speech signal to a text string based on the auditory properties;
determining an emotional effect of the speech signal based on the set of facial features;
selecting a graphical element based on the emotional effect; and
causing display of the text string within the graphical element within the presentation of the image data.