US 12,455,858 B2
Saliency-based compression
Nezare Chafni, Santa Monica, CA (US); and Shaun Moore, Siesta Key, FL (US)
Assigned to 214 TECHNOLOGIES, INC., Mclean, VA (US)
Filed by 214 Technologies, Inc., Los Angeles, CA (US)
Filed on Jul. 28, 2021, as Appl. No. 17/387,935.
Prior Publication US 2023/0029608 A1, Feb. 2, 2023
Int. Cl. G06F 16/16 (2019.01); G06N 20/00 (2019.01); G06T 9/00 (2006.01)
CPC G06F 16/164 (2019.01) [G06N 20/00 (2019.01); G06T 9/00 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method, comprising:
obtaining a machine learning model configured to label media files of a given type corresponding to a type of training media samples, wherein the given type of the media files comprises at least one of an image type, an audio type, or a video type;
assigning, by the machine learning model, a label to a training media sample comprising a plurality of elements;
modifying an element of the plurality of elements to generate an updated training media sample;
assigning, by the machine learning model, a label to the updated training media sample;
comparing the label assigned to the training media sample to the label assigned to the updated training media sample;
determining, using the machine learning model, a salience of the element that was modified based on the comparison of the labels;
generating, using the machine learning model, a saliency map based on a plurality of training media samples, the saliency map including a plurality of values corresponding to elements of the saliency map, each element of the plurality of elements corresponding to at least one value, each of the values correspond to the salience of the corresponding element for perception of the media files by a computer determined by the machine learning model, and each of the values indicate an importance of a corresponding element of the saliency map in assigning a label to a media sample;
obtaining a first media sample of the given type, the first media sample having a first sample size;
compressing elements of the first media sample according to the values corresponding to the plurality of elements of the saliency map to generate a second media sample having a second sample size, wherein the second sample size is smaller than the first sample size;
identifying, using the machine learning model, a pattern between the elements of the second media sample and elements of the training media sample; and
assigning, by the machine learning model, a label to the second media sample based on the identified pattern between the elements of the second media sample and the elements of the training media sample.