US 12,307,600 B2
Modifying two-dimensional images utilizing iterative three-dimensional meshes of the two-dimensional images
Radomir Mech, Mountain View, CA (US); Nathan Carr, San Jose, CA (US); and Matheus Gadelha, San Jose, CA (US)
Assigned to Adobe Inc., San Jose, CA (US)
Filed by Adobe Inc., San Jose, CA (US)
Filed on Nov. 15, 2022, as Appl. No. 18/055,590.
Prior Publication US 2024/0161406 A1, May 16, 2024
Int. Cl. G06T 17/20 (2006.01); G06T 5/00 (2024.01); G06T 5/77 (2024.01)
CPC G06T 17/205 (2013.01) [G06T 5/77 (2024.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a memory component; and
a processing device coupled to the memory component, the processing device to perform operations comprising:
determining, utilizing one or more neural networks, first pixel depth values representing first estimated depths at pixels of a two-dimensional image;
generating, utilizing the one or more neural networks, a first three-dimensional mesh by generating a first tessellation incorporating depth information from the first pixel depth values of the two-dimensional image;
determining, in response to a displacement input to a portion of the two-dimensional image within a graphical user interface displaying the two-dimensional image, that the two-dimensional image is modified to create a modified two-dimensional image comprising at least one modified portion of the two-dimensional image according to a corresponding modified portion of the first three-dimensional mesh;
determining, utilizing the one or more neural networks, second pixel depth values representing second estimated depths at pixels of the modified two-dimensional image; and
generating, utilizing the one or more neural networks in response to determining that the two-dimensional image is modified to create the modified two-dimensional image, a second three-dimensional mesh by generating a second tessellation incorporating depth information of the modified two-dimensional image based on the second pixel depth values for the modified two-dimensional image according to the at least one modified portion of the modified two-dimensional image.