US 12,328,514 B2
Image processing device, and image processing method
Takashi Miyata, Tokyo (JP); Taiki Yamada, Tokyo (JP); and Tomoaki Hagihara, Tokyo (JP)
Assigned to HONDA MOTOR CO., LTD., Tokyo (JP)
Filed by HONDA MOTOR CO., LTD., Tokyo (JP)
Filed on Mar. 2, 2023, as Appl. No. 18/177,264.
Claims priority of application No. 2022-042098 (JP), filed on Mar. 17, 2022.
Prior Publication US 2023/0328393 A1, Oct. 12, 2023
Int. Cl. H04N 23/80 (2023.01); G03B 17/56 (2021.01); G06F 16/438 (2019.01); G06F 18/22 (2023.01); G06F 18/30 (2023.01); G06T 7/00 (2017.01); H04N 23/68 (2023.01)
CPC H04N 23/80 (2023.01) [G03B 17/56 (2013.01); G06F 16/4393 (2019.01); G06F 18/22 (2023.01); G06F 18/30 (2023.01); G06T 7/0002 (2013.01); H04N 23/6811 (2023.01)] 7 Claims
OG exemplary drawing
 
1. An image processing device comprising a computer, wherein the computer functions as:
a captured image acquisition unit for acquiring a plurality of captured images photographed with an on-vehicle camera that photographs surroundings and an interior of a vehicle;
a music playback information acquisition unit for acquiring music playback information that is information about music being played in the vehicle during photographing of the captured images, and for storing the music playback information in a memory; and
a captured image selection unit for highlight scene, for selecting, from among the plurality of captured images, based on the music playback information, captured images that were photographed when music meeting a predetermined music condition was being played, wherein
the music playback information includes feeling information about a feeling that a person listening to the music gets, and
the captured image selection unit for highlight scene:
obtains, from an on-vehicle device, travel information including traveling speed of the vehicle, a current location of the vehicle, a type of road of traveling, and a congestion state of the road of traveling;
for each of the plurality of captured images, determines, at a timing when each of the plurality of captured images are photographed, whether or not a situation during the photographing is a situation that can put a user of the vehicle in an uplifting mood based on environmental information and the travel information, the environmental information including scenery and weather around the vehicle, as well as a time; and
determines that the music meeting the predetermined music condition is being played when the situation during the photographing is the situation that can put the user in the uplifting mood, and the feeling related to the uplifting mood is recorded in the feeling information about the music being played at that time.