US 12,450,686 B2
Methods and devices for improved inverse iterative warping
Seyedkoosha Mirhosseini, Cupertino, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on May 14, 2024, as Appl. No. 18/664,159.
Application 18/664,159 is a continuation of application No. 16/983,201, filed on Aug. 3, 2020, granted, now 12,014,472.
Claims priority of provisional application 62/895,062, filed on Sep. 3, 2019.
Prior Publication US 2024/0303766 A1, Sep. 12, 2024
Int. Cl. G06T 3/18 (2024.01); G06T 19/20 (2011.01)
CPC G06T 3/18 (2024.01) [G06T 19/20 (2013.01); G06T 2219/2021 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
at a device including non-transitory memory and one or more processors coupled with the non-transitory memory:
obtaining a reference image frame and forward flow information associated with the reference image frame;
obtaining a plurality of characterization vectors for each of a plurality of neighborhoods of pixels in the reference image frame, wherein each characterization vector at least includes a foreground depth value and a background depth value;
for a respective pixel within a target image frame:
identifying a respective neighborhood of pixels within the reference image frame that corresponds to the respective pixel within the target image frame based on the forward flow information;
in accordance with a determination that a respective characterization vector for the respective neighborhood of pixels satisfies a background condition, generating a warp result for the respective pixel based on a first warp type, wherein the warp result includes a warp position and an associated depth value;
in accordance with a determination that the respective characterization vector for the respective neighborhood of pixels satisfies a foreground condition, generating the warp result for the respective pixel based on a second warp type, wherein the second warp type corresponds to a first iterative warp operation; and
in accordance with a determination that the respective characterization vector for the respective neighborhood of pixels does not satisfy the foreground or background conditions, generating the warp result for the respective pixel based on a third warp type, wherein the third warp type corresponds to a second iterative warp operation; and
populating pixel information for the respective pixel within the target image frame based on pixel information for a reference pixel within the reference image frame that corresponds to the warp result.