	US 12,192,673 B2
	Accurate optical flow interpolation optimizing bi-directional consistency and temporal smoothness
Gyeongmin Choe, San Jose, CA (US); Yingmao Li, Allen, TX (US); John Seokjun Lee, Allen, TX (US); Hamid R. Sheikh, Allen, TX (US); and Michael O. Polley, Garland, TX (US)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on Feb. 2, 2022, as Appl. No. 17/591,350.
Claims priority of provisional application 63/161,899, filed on Mar. 16, 2021.
Prior Publication US 2022/0301184 A1, Sep. 22, 2022
Int. Cl. H04N 7/01 (2006.01); G06T 1/00 (2006.01); G06T 3/18 (2024.01); G06T 5/50 (2006.01); G06T 7/207 (2017.01); H04N 1/32 (2006.01); H04N 19/139 (2014.01); H04N 19/577 (2014.01)

CPC H04N 7/0137 (2013.01) [G06T 1/0021 (2013.01); G06T 3/18 (2024.01); G06T 5/50 (2013.01); G06T 7/207 (2017.01); H04N 1/32224 (2013.01); H04N 19/139 (2014.11); H04N 19/577 (2014.11); G06T 2207/20221 (2013.01)]

20 Claims

1. A method comprising:

obtaining multiple video frames;

determining whether a bi-directional optical flow between the multiple video frames satisfies an image quality criterion for bi-directional consistency;

identifying a non-linear curve based on pixel coordinate values from at least two of the video frames, the at least two video frames comprising first and second video frames;

generating interpolated video frames between the first and second video frames by applying non-linear interpolation based on the non-linear curve; and

outputting the interpolated video frames for presentation.