US 11,783,556 B2
Augmented reality content generators including 3D data in a messaging system
Kyle Goodrich, Venice, CA (US); Samuel Edward Hare, Los Angeles, CA (US); Maxim Maximov Lazarov, Culver City, CA (US); Tony Mathew, Los Angeles, CA (US); Andrew James McPhee, Culver City, CA (US); Daniel Moreno, Los Angeles, CA (US); and Wentao Shang, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Nov. 16, 2022, as Appl. No. 18/56,099.
Application 18/056,099 is a continuation of application No. 17/301,735, filed on Apr. 13, 2021, granted, now 11,508,135.
Claims priority of provisional application 63/009,158, filed on Apr. 13, 2020.
Prior Publication US 2023/0073310 A1, Mar. 9, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 19/00 (2011.01); G06F 3/0482 (2013.01); G06F 3/0488 (2022.01); G06T 5/00 (2006.01); G06F 3/04815 (2022.01)
CPC G06T 19/006 (2013.01) [G06F 3/0482 (2013.01); G06F 3/0488 (2013.01); G06F 3/04815 (2013.01); G06T 5/005 (2013.01); G06T 2207/10028 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, at a client device, a selection of a first selectable graphical item from a plurality of selectable graphical items displayed in a carousel interface, the first selectable graphical item comprising a first augmented reality content generator for applying a first 3D effect;
generating a segmentation mask based on first image data;
applying the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data;
generating a packed depth map based at least in part on the depth map, the generating the packed depth map comprising:
converting a single channel floating point texture to a raw depth map, and
generating multiple channels based at least in part on the raw depth map;
applying, to the first image data and the first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item, the first image data and the first depth data being captured with a camera; and
generating a message including the applied first augmented reality content generator to the first image data and the first depth data.