US 11,750,814 B2
Single layer high dynamic range coding with standard dynamic range backward compatibility
Koohyar Minoo, San Diego, CA (US); Zhouye Gu, San Jose, CA (US); David M. Baylon, San Diego, CA (US); Ajay Luthra, San Diego, CA (US); and Yue Yu, San Diego, CA (US)
Assigned to ARRIS Enterprises LLC, Suwanee, GA (US)
Filed by ARRIS Enterprises LLC, Suwanee, GA (US)
Filed on Jan. 4, 2023, as Appl. No. 18/93,079.
Application 18/093,079 is a continuation of application No. 17/667,059, filed on Feb. 8, 2022, granted, now 11,575,899.
Application 17/667,059 is a continuation of application No. 15/274,486, filed on Sep. 23, 2016, granted, now 11,277,610, issued on Mar. 15, 2022.
Claims priority of provisional application 62/242,272, filed on Oct. 15, 2015.
Claims priority of provisional application 62/241,087, filed on Oct. 13, 2015.
Claims priority of provisional application 62/241,094, filed on Oct. 13, 2015.
Claims priority of provisional application 62/222,723, filed on Sep. 23, 2015.
Prior Publication US 2023/0141102 A1, May 11, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 19/124 (2014.01); H04N 19/186 (2014.01); H04N 19/44 (2014.01); G06T 5/00 (2006.01); H04N 19/98 (2014.01); H04N 19/70 (2014.01); H04N 19/174 (2014.01); H04N 19/177 (2014.01)
CPC H04N 19/124 (2014.11) [G06T 5/007 (2013.01); H04N 19/174 (2014.11); H04N 19/177 (2014.11); H04N 19/186 (2014.11); H04N 19/44 (2014.11); H04N 19/70 (2014.11); H04N 19/98 (2014.11); G06T 2207/20208 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A high dynamic range (HDR) coding process with standard dynamic range (SDR) backwards compatibility, the HDR coding process comprising:
generating a tone map describing a transformation from data representing a first color component of an HDR video image to data representing a corresponding first color component of an SDR video image on a pixel-by-pixel basis;
modeling the tone map as a reshaping transfer function;
processing data representing one or more additional color components of the HDR video image using another reshaping transfer function to generate data representing one or more additional color components of the SDR video image;
determining an inverse reshaping transfer function that corresponds to the reshaping transfer function, another inverse shaping transfer function from the other reshaping transfer function;
generating a metadata structure describing the inverse reshaping transfer function and the other reshaping transfer function, the metadata structure including:
a first function describing a mapping of reconstructed SDR samples to HDR samples for a first color component representing luminance; and
a second function describing a mapping of reconstructed SDR samples to HDR samples for the one or more additional color components, where the second function is different than the first function, each representing a representative chrominance; and encoding the SDR video image to generate encoded video data including the metadata structure;
wherein the generating of the metadata structure describing the inverse reshaping transfer function includes:
dividing the inverse reshaping transfer function into P-1 segments defined by a P pivot points, where P is an integer;
fitting an equation to each segment, each equation having an order, N, where N is an integer that varies based on characteristics of the segment;
for each pivot point except the last pivot point:
allocating a cell is the metadata structure to hold a value indicating a number of coefficients to be stored for the pivot point;
allocating a number of cells in the metadata structure sufficient to describe the coefficients for the pivot point:
storing a value indicating the number of cells for the pivot point into a first one of the allocated cells;
storing the coefficient values in the remaining allocated cells;
further including, for each pivot point except the last pivot point:
allocating a cell in the metadata structure for storing a smoothness degree, the smoothness degree indicating constraints on the equations fitted to the segment, wherein, for each pivot point except the last pivot point:
the number of cells allocated to describe the coefficients of the pivot point is N when the smoothness degree indicates that the functions modeling the segments are continuous; and
the number of cells allocated to describe the coefficients of the pivot point is N-1 when the smoothness degree indicates that the functions modeling the segments are continuous and have corresponding slopes at the pivot points.