US 12,272,014 B2
Post-capture editing of augmented reality content
Faisal Alqadi, Santa Monica, CA (US); Omer Cansizoglu, Mercer Island, WA (US); Nicolai Darmancev, Odesa (UA); Ivan Golub, Playa Vista, CA (US); Hwan Moon Lee, Los Angeles, CA (US); Xiaorong Li, Los Angeles, CA (US); David Meisenholder, Manhattan Beach, CA (US); Quinton Roberts, Marina Del Rey, CA (US); and Yihuan Zhou, Los Angeles, CA (US)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jan. 11, 2024, as Appl. No. 18/410,868.
Application 18/410,868 is a continuation of application No. 17/646,445, filed on Dec. 29, 2021, granted, now 11,880,949.
Claims priority of provisional application 63/132,970, filed on Dec. 31, 2020.
Prior Publication US 2024/0144616 A1, May 2, 2024
Int. Cl. G06T 19/00 (2011.01); G02B 27/01 (2006.01); G06T 15/00 (2011.01)
CPC G06T 19/006 (2013.01) [G02B 27/0172 (2013.01); G06T 15/005 (2013.01); G02B 2027/0178 (2013.01)] 18 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, by a client device from a storage device, first image data captured by the client device at a previous time;
receiving first metadata corresponding to at least a first image processing operation and a second image processing operation;
generating, in a first render pass, second image data based on the first metadata and the first image processing operation performed on the first image data;
generating, in a second render pass, third image data based on the first metadata and the second image processing operation performed on the second image data;
generating second metadata comprising information corresponding to the third image data;
generating a composite AR content item comprising the second metadata, the third image data, and the first image data;
providing a multi-layer image processing pipeline, the multi-layer image processing pipeline comprising a feature layer, a render pipeline layer, and a render pass layer;
receiving, by the render pipeline layer, the first image data, the first image data comprising a first pixel buffer, a second pixel buffer, and a bitmap; and
generating, using the feature layer, cascaded render passes, the cascaded render passes comprising a sequence of respective render passes in which an order of the respective render passes is fixed based at least in part on metadata corresponding to a set of augmented reality content generators to apply for each of the respective render passes, each of the set of augmented reality content generators corresponding to a respective image processing effect or operation related to an augmented reality object or augmented reality content.