US 12,126,841 B2
Feature compression for video coding for machines
Wen Gao, West Windsor, NJ (US); Xiaozhong Xu, State College, PA (US); and Shan Liu, San Jose, CA (US)
Assigned to TENCENT AMERICA LLC, Palo Alto, CA (US)
Filed by TENCENT AMERICA LLC, Palo Alto, CA (US)
Filed on Sep. 8, 2022, as Appl. No. 17/940,374.
Claims priority of provisional application 63/246,217, filed on Sep. 20, 2021.
Prior Publication US 2023/0086521 A1, Mar. 23, 2023
Int. Cl. H04N 19/88 (2014.01); H04N 19/105 (2014.01); H04N 19/136 (2014.01); H04N 19/172 (2014.01); H04N 19/189 (2014.01)
CPC H04N 19/88 (2014.11) [H04N 19/105 (2014.11); H04N 19/136 (2014.11); H04N 19/172 (2014.11); H04N 19/189 (2014.11)] 15 Claims
OG exemplary drawing
 
1. A method of performing feature compression, the method being executed by at least one processor and comprising:
obtaining an input video;
obtaining a feature map corresponding to the input video, the feature map comprising a plurality of feature channels;
reordering the plurality of feature channels based on at least one characteristic of the plurality of feature channels;
compressing the reordered plurality of feature channels; and
generating an encoded bitstream based on the reordered and compressed plurality of feature channels,
wherein the at least one characteristic comprises a similarity of the plurality of feature channels,
wherein the similarity is determined based on a correlation coefficient between two feature channels of the plurality of feature channels,
wherein the correlation coefficient corresponds to a ratio between a covariance of the two feature channels and a product of standard deviations of the two feature channels, and
wherein the reordering comprises computing a total correlation coefficient for each feature channel of the plurality of feature channels, and ordering the plurality of feature channels based on the total correlation coefficient.