Editing device and editing method

Patent metadata

Field	Value
Publication number	US-11694377-B2
Application number	US-202117392283-A
Country	US
Kind code	B2
Filing date	Aug 3, 2021
Priority date	Aug 7, 2020
Publication date	Jul 4, 2023
Grant date	Jul 4, 2023

Abstract

An editing device acquires a first image in which an occupant of a vehicle has been imaged in association with a time point in a time series and a second image in which scenery around the vehicle has been imaged in association with a time point in a time series, acquires first index information indicating feelings of the occupant when the first image has been captured on the basis of the first image, and extracts the first image and the second image from first images of the time series and second images of the time series on the basis of the first index information and the time point associated with the first image based on the first index information to generate a library including the extracted images.

First claim

What is claimed is:

1. An editing device comprising:
a memory configured to store instructions; and
one or more processors configured to execute the instructions to:
acquire a first image in which an occupant of a vehicle has been imaged in association with a first time point in a first time series and a second image in which scenery around the vehicle has been imaged in association with a second time point in a second time series,
acquire first index information indicating feelings of the occupant when the first image has been captured on the basis of the first image, and
extract the first image and the second image from first images of the first time series and second images of the second time series on the basis of the first index information and the first time point associated with the first image based on the first index information to generate a library including the extracted images
wherein the instructions further comprise instructions to:
cause a display of the vehicle to display an edited image that has been edited and include the extracted images,
start editing at a first predetermined time point or at a first predetermined distance before the vehicle arrives at a destination,
end the editing at a second predetermined time point or at a second predetermined distance before the vehicle arrives at the destination, and
allow the edited image to be displayed until the vehicle arrives at the destination after the editing has ended.

2. The editing device according to claim 1 ,
wherein the instructions further comprise instructions to:
cause a storage to store the first images of the first time series and the second images of the second time series, and
extract the first image and the second image from the first images of the first time series and the second images of the second time series stored in the storage on the basis of the first index information and the first time point to generate the library including the extracted images.

3. The editing device according to claim 1 ,
wherein the instructions further comprise instructions to:
extract the first image based on the first index information associated with positive feelings and the second image captured at the second time point associated with the first image to generate the library including the extracted images.

4. The editing device according to claim 1 ,
wherein the instructions further comprise instructions to:
extract the first image and the second image on the basis of second index information associated with a position where the vehicle has traveled, the first index information, and the first time point to generate the library including the extracted images.

5. The editing device according to claim 1 ,
wherein the instructions further comprise instructions to:
acquire the first index information indicating the feelings of the occupant when the first image has been captured on the basis of a facial expression of the occupant included in the first image.

6. The editing device according to claim 1 ,
wherein the instructions further comprise instructions to:
acquire speech information indicating speech uttered by the occupant of the vehicle in association with a third time point in a third time series,
acquire third index information indicating feelings of the occupant when the first image has been captured on the basis of the speech information, and
extract the first image and the second image from the first images and the second images of the third time series on the basis of the third index information, the first index information, and the first time point associated with the first image based on the first index information to generate the library including the extracted images.

7. An editing device comprising:
a memory configured to store instructions; and
one or more processors configured to execute the instructions to:
acquire a first image in which an occupant of a vehicle has been imaged in association with a first time point in a first time series, a second image in which scenery around the vehicle has been imaged in association with a second time point in a second time series, and speech information indicating speech uttered by the occupant of the vehicle in association with a third time point in a third time series,
acquire index information indicating feelings of the occupant when the speech of the speech information has been uttered on the basis of the speech information,
extract the first image and the second image from first images of the first time series and second images of the second time series on the basis of the index information and the third time point associated with the speech information based on the index information to generate a library including the extracted images, cause a display of the vehicle to display an edited image that has been edited and include the extracted images,
start editing at a first predetermined time point or at a first predetermined distance before the vehicle arrives at a destination,
end the editing at a second predetermined time point or at a second predetermined distance before the vehicle arrives at the destination, and
allow the edited image to be displayed until the vehicle arrives at the destination after the editing has ended.

8. An editing method comprising:
acquiring, by a computer, a first image in which an occupant of a vehicle has been imaged in association with a first time point in a first time series and a second image in which scenery around the vehicle has been imaged in association with a second time point in a second time series,
acquiring, by the computer, first index information indicating feelings of the occupant when the first image has been captured on the basis of the first image,
extracting, by the computer, the first image and the second image from first images of the first time series and second images of the second time series on the basis of the first index information and the first time point associated with the first image based on the first index information to generate a library including the extracted images, causing, by the computer, a display of the vehicle to display an edited image that has been edited and include the extracted images,
starting, by the computer, editing at a first predetermined time point or at a first predetermined distance before the vehicle arrives at a destination,
ending, by the computer, the editing at a second predetermined time point or at a second predetermined distance before the vehicle arrives at the destination, and
allowing, by the computer, the edited image to be displayed until the vehicle arrives at the destination after the editing has ended.

9. The editing device according to claim 1 ,
wherein the instructions further comprise instructions to:
determine a starting time point of editing the first image and the second image based on the number of acquired first image and second image,
start editing the first image and the second image for generating the library based on the starting time point, the starting time point being a duration of time during which the editing is able to end before the vehicle arrives at the destination,
provide a user with the library so that the user is able to see edited images of the library after the vehicle has arrived at the destination.

Assignees

• Honda Motor Co Ltd

Inventors

• Aoki Yuki
• Murayama Hisashi
• Kono Koichi
• Kobayashi Masahide

Classifications

• G06V40/176

  Dynamic expression · CPC title

• G06F16/51

  Indexing; Data structures therefor; Storage structures · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• G06F16/5866 Primary

  using information manually generated, e.g. tags, keywords, comments, manually generated location and time information · CPC title

• G06V20/59

  inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions · CPC title