US 11,057,576 B2
System and method for automated detection and replacement of photographic scenes
Leo Cyrus, Eden Prairie, MN (US)
Assigned to Shutterfly, LLC, Redwood City, CA (US)
Filed by Shutterfly, LLC, Redwood City, CA (US)
Filed on Mar. 11, 2020, as Appl. No. 16/816,065.
Application 16/816,065 is a continuation in part of application No. 16/277,051, filed on Feb. 15, 2019.
Prior Publication US 2020/0267334 A1, Aug. 20, 2020
Int. Cl. G06K 9/00 (2006.01); H04N 5/272 (2006.01); G06T 7/90 (2017.01); H04N 5/222 (2006.01); G06T 7/44 (2017.01); G06T 7/194 (2017.01); G06N 3/08 (2006.01)
CPC H04N 5/272 (2013.01) [G06N 3/084 (2013.01); G06T 7/194 (2017.01); G06T 7/44 (2017.01); G06T 7/90 (2017.01); H04N 5/2226 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A method of identifying a background type in a photograph, comprising:
extracting a background image from a photograph;
feeding the background image into a first convolution neural network by one or more computer processors to obtain a first decision;
automatically extracting color features in the background image by the one or more computer processors;
transforming the color features into a two-dimensional color feature matrix;
feeding the two-dimensional color feature matrix into a second convolution neural network to obtain a second decision by the one or more computer processors;
automatically extracting texture features in the background image;
transforming the texture features into a two-dimensional texture feature matrix image by the one or more computer processors;
feeding the two-dimensional texture feature matrix into a third convolution neural network to obtain a third decision by the one or more computer processors;
computing a hybrid decision based on the first decision, the second decision, and the third decision; and
identifying a background type in the background image based on the hybrid decision.