US 12,333,694 B2
Image processing method and apparatus
Quanhe Yu, Beijing (CN); Weiwei Xu, Hangzhou (CN); Hu Chen, Munich (DE); Dongsheng Wu, Shenzhen (CN); and Le Yuan, Shenzhen (CN)
Assigned to HUAWEI TECHNOLOGIES CO., LTD., Shenzhen (CN)
Filed by HUAWEI TECHNOLOGIES CO., LTD., Shenzhen (CN)
Filed on Apr. 15, 2022, as Appl. No. 17/721,602.
Application 17/721,602 is a continuation of application No. PCT/CN2020/113525, filed on Sep. 4, 2020.
Claims priority of application No. 201910996393.9 (CN), filed on Oct. 18, 2019.
Prior Publication US 2022/0237754 A1, Jul. 28, 2022
Int. Cl. G06K 9/00 (2022.01); G06T 5/92 (2024.01)
CPC G06T 5/92 (2024.01) [G06T 2207/20208 (2013.01)] 5 Claims
OG exemplary drawing
 
1. An image processing method, comprising:
determining a first coordinate of at least one interpolation point based on feature information or dynamic metadata of a to-be-processed image;
determining at least one second coordinate and at least one first-order derivative corresponding to the first coordinate of the at least one interpolation point;
determining coefficients of a modified spline curve based on the first coordinate of the at least one interpolation point, the at least one second coordinate, and the at least one first-order derivative, wherein the modified spline curve comprises at least one of a linear spline curve or a cubic spline curve; and
performing tone mapping on the to-be-processed image based on a modified tone mapping curve, wherein the modified tone mapping curve comprises at least a part of an initial tone mapping curve and the modified spline curve;
wherein the at least one interpolation point comprises a first interpolation point, the modified spline curve comprises a first spline curve, the first spline curve is a linear spline function that passes through an origin and the first interpolation point, and the coefficients of the modified spline curve comprise a first-order derivative MB0 of the first spline curve;
before the determining of the at least one second coordinate and the at least one first-order derivative based on the first coordinate of the at least one interpolation point, the method further comprises:
obtaining the first-order derivative MB0 of the first spline curve based on at least one of a maximum value maxL of luminance of the to-be-processed image and an average value avgL of luminance of the to-be-processed image that are comprised in the dynamic metadata; and
wherein the at least one interpolation point further comprises a second interpolation point and a third interpolation point, the modified spline curve further comprises a second spline curve and a third spline curve, the second spline curve is a cubic spline curve that passes through the first interpolation point and the second interpolation point, the third spline curve is a cubic spline curve that passes through the second interpolation point and the third interpolation point, and the coefficients of the modified spline curve further comprise: MA1, MB1, MC1, MD1, MA2, MB2, MC2 and MD2; and wherein the MA1, MB1, MC1, and MD1 are coefficients of the first spline curve and the MA2, MB2, MC2, and MD2 are coefficients of the second spline curve;
the determining of the at least one second coordinate and the at least one first-order derivative based on the first coordinate of the at least one interpolation point comprises:
calculating a second coordinate VA1 of the first interpolation point on the first spline curve based on a first coordinate TH1 of the first interpolation point and the first-order derivative MB0;
calculating a second coordinate VA3 of the third interpolation point on the initial tone mapping curve based on a first coordinate TH3 of the third interpolation point;
calculating a second coordinate VA2 of the second interpolation point on a first straight line based on a first coordinate TH2 of the second interpolation point, wherein the first straight line includes the first interpolation point and the third interpolation point; and
calculating a first-order derivative GD3 of the initial tone mapping curve at the third interpolation point based on TH3; and
wherein the determining of the coefficients of the modified spline curve based on the first coordinate of the at least one interpolation point, the at least one second coordinate, and the at least one first-order derivative comprises:
determining VA1 as MA1;
determining the first-order derivative MB0 as MB1;
determining a sum of VA2 and an offset value as MA2, wherein the offset value is 0, a positive number, or a negative number; and
obtaining MC1, MD1, MB2, MC2, and MD2 based on TH1, TH2, TH3, VA2, VA3, and GD3;
wherein the coefficients MC1, MD1, MB2, MC2, and MD2 are determined together.