US 11,985,365 B2
Information processing device, information processing system, and information processing method
Takayoshi Shimizu, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/760,898
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed Aug. 6, 2020, PCT No. PCT/JP2020/030192
§ 371(c)(1), (2) Date Mar. 16, 2022,
PCT Pub. No. WO2021/059770, PCT Pub. Date Apr. 1, 2021.
Claims priority of application No. 2019-173496 (JP), filed on Sep. 24, 2019.
Prior Publication US 2022/0345760 A1, Oct. 27, 2022
Int. Cl. H04N 21/234 (2011.01); G06V 10/74 (2022.01); G06V 10/60 (2022.01); G06V 10/50 (2022.01); H04N 21/6587 (2011.01)
CPC H04N 21/23424 (2013.01) [G06V 10/50 (2022.01); G06V 10/60 (2022.01); G06V 10/761 (2022.01); H04N 21/6587 (2013.01)] 16 Claims
OG exemplary drawing
 
1. An information processing device, comprising:
a central processing unit (CPU) configured to:
calculate, in response to detection of a user action on playback content, a similarity rate between a playback image frame in the playback content and a plurality of performer reaction image frames, wherein
each of the plurality of performer reaction image frames includes a scene of a performer in reaction, and
the calculated similarity rate is a weighted addition value of each data of:
(a) a face size of a face included in an image frame,
(b) a face position of a face included in an image frame,
(c) an overall luminance of an image frame, and
(d) a pixel value histogram of an entire image frame;
select, based on the calculated similarity rate, a performer reaction image frame from the plurality of performer reaction image frames, wherein the calculated similarity rate of the selected performer reaction image frame is equal to or higher than a threshold value;
replace the playback image frame in the playback content with the selected performer reaction image frame; and
play back the selected performer reaction image frame.