Digest video generation apparatus

Patent metadata

Field	Value
Publication number	US-9298820-B2
Application number	US-201314053240-A
Country	US
Kind code	B2
Filing date	Oct 14, 2013
Priority date	Oct 14, 2013
Publication date	Mar 29, 2016
Grant date	Mar 29, 2016

Abstract

A terminal device includes circuitry configured to acquire designated image data stored in a memory. The circuitry may sort the designated image data based on a time at which the designated image data was captured. The circuitry may divide the sorted image data into a plurality of time slots and calculate, based on features of the designated image data corresponding to each time slot of the plurality of time slots, a time slot score for each of the plurality of time slots. The circuitry may allocate, based on the time slot score, a portion of a digest video to each of the plurality of time slots. The circuitry may generate, for each time slot, a local digest video by assigning an amount of the designated image data to the local digest video corresponding to the time slot, and generate the digest video by connecting the generated local digest videos.

First claim

The invention claimed is:

1. A terminal device comprising:
circuitry configured to
acquire image data stored in a memory;
sort the image data based on a time at which the image data was captured;
divide the sorted image data into a plurality of time slots;
calculate, based on features of the image data corresponding to each time slot of the plurality of time slots, a time slot score for each of the plurality of time slots;
allocate a percentage of a digest video to each of the plurality of time slots based on the time slot score;
generate, for each time slot, a corresponding local digest video by assigning an amount of the image data included in a corresponding time slot to the corresponding local digest video, the amount being based on the percentage of the digest video allocated to the corresponding time slot; and
generate the digest video by connecting local digest videos generated for each of the plurality of time slots.

2. The terminal device of claim 1 , wherein the circuitry is configured to:
divide each of the plurality of time slots into a plurality of sub-time slots;
calculate, based on the features of the image data corresponding to each sub-time slot of the plurality of sub-time slots, a sub-time slot score for each of the plurality of sub-time slots; and
assign, based on the sub-time slot score, the amount of the image data included in the corresponding time slot to the corresponding local digest video.

3. The terminal device of claim 2 , wherein the circuitry is configured to:
calculate, for each time slot of the plurality of time slots, a sub-time slot score ratio represented by each sub-time slot's score relative to a total sub-time slot score for the plurality of sub-time slots included in the time slot; and
assign, based on the sub-time slot score ratio, the amount of the image data included in the corresponding time slot to the corresponding local digest video.

4. The terminal device of claim 2 , wherein the circuitry is configured to:
acquire, as metadata corresponding to the image data, user comments corresponding to the image data, and
calculate the sub-time slot score for each of the plurality of sub-time slots included in each of the plurality of time slots based on one or more of a quantity of image data files included in the corresponding time slot, a length of the image data included in the corresponding time slot, a sound level of audio corresponding to the image data included in the corresponding time slot, a number of faces detected in the image data included in the corresponding time slot, and a number of user comments corresponding to the image data included in the corresponding time slot.

5. The terminal device of claim 2 , wherein the circuitry is configured to:
determine, for each sub-time slot of the plurality of sub-time slots included in the plurality of time slots, when the sub-time slot score is below a threshold value, and
exclude the image data corresponding to the sub-time slot having the sub-time slot score below the threshold value when generating the corresponding local digest video.

6. The terminal device of claim 1 , wherein:
the circuitry is configured to calculate, based on the time slot score, a score ratio for each time slot,
the score ratio represents a relative measure of each time slot's score with respect to a total score for the plurality of time slots, and
the circuitry is configured to allocate, based on the score ratio, the percentage of the digest video to each of the plurality of time slots.

7. The terminal device of claim 1 , wherein the circuitry is configured to:
extract metadata from the image data, and
calculate the time slot score for each of the plurality of time slots based on the metadata corresponding to the image data included in each respective time slot.

8. The terminal device of claim 1 , wherein the circuitry is configured to calculate the time slot score for each of the plurality of time slots based on one or more of a quantity of image data files included in the corresponding time slot, a length of the image data included in the corresponding time slot, a sound level of audio corresponding to the image data included in the corresponding time slot, and a number of faces detected in the image data included in the corresponding time slot.

9. The terminal device of claim 1 , wherein
the circuitry is configured to determine when the time slot score for each time slot of the plurality of time slots is outside a range defined by a minimum threshold value and a maximum threshold value, and
in response to determining the time slot score is outside the range, the circuitry is configured to adjust the time slot score to fall within the range.

10. The terminal device of claim 1 , wherein the circuitry is configured to acquire, as metadata corresponding to the image data, user comments corresponding to the image data.

11. The terminal device of claim 10 , wherein the circuitry is configured to determine whether the user comments correspond to a positive affinity or a negative affinity for the image data.

12. The terminal device of claim 1 , wherein the memory is included in a server accessed on a network.

13. The terminal device of claim 12 , wherein:
the image data stored on the server is viewable by a plurality of terminal devices connected to the network,
the server determines, for the image data stored on the server, a number of view requests of the image data, and
the circuitry is configured to acquire the determined number of view requests from the server, and to calculate the time slot score for each of the plurality of time slots based on the number of view requests for the image data included in the corresponding time slot.

14. An information processing system comprising:
a server configured to store image data uploaded from one or more external devices;
a digest video creating device configured to acquire the image data stored on the server, and to create a digest video from the acquired image data; and
a terminal device configured to acquire the digest video created by the digest video creating device and display the acquired digest video on a display, wherein
the digest video creating device includes circuitry configured to:
sort the image data based on a time at which the image data was captured;
divide the sorted image data into a plurality of time slots;
calculate, based on features of the image data corresponding to each time slot of the plurality of time slots, a time slot score for each of the plurality of time slots;
allocate a percentage of a digest video to each of the plurality of time slots based on the time slot score;
generate, for each time slot, a corresponding local digest video by assigning an amount of the image data included in a corresponding time slot to the corresponding local digest video, the amount being based on the percentage of the digest video allocated to the corresponding time slot; and
generate the digest video by connecting local digest videos generated for each of the plurality of time slots.

15. The information processing system of claim 14 , wherein the circuitry is configured to:
divide each of the plurality of time slots into a plurality of sub-time slots;
calculate, based on the features of the image data corresponding to each sub-time slot of the plurality of sub-time slots, a sub-time slot score for each of the plurality of sub-time slots; and
assign, based on the sub-time slot score, the amount of the image data included in the corresponding time slot to the corresponding local digest video.

16. The information process

Assignees

• Sony Corp

Inventors

• Kosaka Junichi
• Hama Tatsuya
• Yoneda Kenichi
• Tsuda Takamoto
• Akiyama Yukiko

Classifications

• G06F17/30784 Primary

  Physics · mapped topic

• G06F17/30056

  Physics · mapped topic

• G06F17/30837

  Physics · mapped topic

• G06F16/4393

  Multimedia presentations, e.g. slide shows, multimedia albums · CPC title

• G06F16/738 Primary

  Presentation of query results · CPC title