US 12,094,073 B2
Cross-modal shape and color manipulation
Menglei Chai, Los Angeles, CA (US); Sergey Tulyakov, Marina del Rey, CA (US); Jian Ren, Marina Del Ray, CA (US); Hsin-Ying Lee, San Jose, CA (US); Kyle Olszewski, Los Angeles, CA (US); Zeng Huang, Los Angeles, CA (US); and Zezhou Cheng, Hadley, MA (US)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Jul. 22, 2022, as Appl. No. 17/814,391.
Claims priority of provisional application 63/365,568, filed on May 31, 2022.
Prior Publication US 2023/0386158 A1, Nov. 30, 2023
Int. Cl. G06T 19/20 (2011.01); G06T 9/00 (2006.01); G06T 11/00 (2006.01); G06T 17/00 (2006.01)
CPC G06T 19/20 (2013.01) [G06T 17/00 (2013.01); G06T 2219/2012 (2013.01); G06T 2219/2021 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method comprising:
accessing a first two-dimensional (2D) sketch;
determining, by one or more processors, a first latent code corresponding to the first 2D sketch based on a first variational auto-decoder (VAD);
generating a second 2D sketch based on the first VAD with the first latent code as input;
causing the second 2D sketch to be displayed;
determining the second 2D sketch has been edited;
determining a second latent code corresponding to the edited 2D sketch based on the first VAD;
generating a three-dimensional (3D) shape from the second latent code based on a second VAD with the second latent code as input; and
causing to be displayed the 3D shape on the display of a computing device.