US 12,223,602 B2
Handcrafted augmented reality experiences
Tianying Chen, Pittsburgh, PA (US); Timothy Chong, Kirkland, WA (US); Sven Kratz, Mercer Island, WA (US); Fannie Liu, New York, NY (US); Andrés Monroy-Hernández, Seattle, WA (US); Olivia Seow, Cambridge, MA (US); Yu Jiang Tham, Seattle, WA (US); Rajan Vaish, Beverly Hills, CA (US); and Lei Zhang, Ann Arbor, MI (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Aug. 15, 2022, as Appl. No. 17/887,817.
Claims priority of provisional application 63/239,700, filed on Sep. 1, 2021.
Prior Publication US 2023/0062366 A1, Mar. 2, 2023
Int. Cl. G06T 19/00 (2011.01); G06F 3/04815 (2022.01); G06T 19/20 (2011.01)
CPC G06T 19/006 (2013.01) [G06F 3/04815 (2013.01); G06T 19/20 (2013.01)] 19 Claims
OG exemplary drawing
 
1. An augmented reality (AR) device for creating a handcrafted AR experience, the AR device comprising:
a camera system configured to capture images of a scene within a field of view;
a display system configured to present AR overlays on a display, the display having a viewing area corresponding to the camera system field of view;
a user input system configured to receive input from a user; and
a processor coupled to the camera system, the display system, and the user input system, the processor configured to:
capture, via the camera system, images of the scene;
identify an object receiving surface and corresponding surface coordinates within the scene;
identify, responsive to input received via the user input system, a customizable AR primary object, the customizable AR primary object identified in response to selection of the customizable AR primary object by a user from a plurality of customizable virtual characters using the user input system, the customizable AR primary object including an image receiving area and associated with at least one set of primary object coordinates;
generate AR overlays including the customizable AR primary object for positioning adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene;
present, via the display system, the AR overlays;
receive, via the user input system, customization commands, the customization commands including a predefined media selection customization command for accessing images captured with the camera system;
receive, via the user input system, selection of an image from the images captured with the camera system;
generate handcrafted AR overlays including customizations associated with the customizable AR primary object responsive to the customization commands for positioning adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene, the customizations including the selected image from the images captured with the camera system added to the image receiving area of the customizable AR primary object;
present, via the display system, the handcrafted AR overlays;
record the handcrafted AR overlays;
create a handcrafted AR file including the recorded overlays; and
transmit the handcrafted AR file.