Video search system and method

Patent metadata

Field	Value
Publication number	US-9792362-B2
Application number	US-201414468532-A
Country	US
Kind code	B2
Filing date	Aug 26, 2014
Priority date	Nov 7, 2013
Publication date	Oct 17, 2017
Grant date	Oct 17, 2017

Abstract

Provided is a video search system and method. The video search system includes: a search engine configured to extract video data matching a search condition from an original video; and a browsing engine configured to generate a summarized video based on the extracted video data, render a plurality of objects in the summarized video on a background model in an overlapping manner in an object appearing order in the original video, and display the rendered objects.

First claim

What is claimed is:

1. A video search system comprising:
a search engine configured to extract video data matching a search condition from an original video; and
a browsing engine configured to:
generate a summarized video based on the extracted video data,
render, in real time, a plurality of objects over a background model in the summarized video in an overlapping manner according to a temporal order of appearance of the plurality of objects in the original video, display the plurality of rendered objects over the background model, the temporal order of appearance of the plurality of objects in the original video corresponding to a displaying order of the plurality of rendered objects in the summarized video, and,

in response to a video change request, display a plurality of summarized video layers in the overlapping manner based on at least one of a time basis and a category basis, the background model corresponding to a lowest layer of the plurality of summarized video layers.

2. The video search system of claim 1 , wherein the browsing engine is configured to render the plurality of objects by changing a degree of temporal overlapping between the plurality of objects in the summarized video while maintaining the displaying order of the plurality of objects in the summarized video.

3. The video search system of claim 1 , wherein the browsing engine is configured to limit a number of the plurality of objects displayed for a predetermined period of time.

4. The video search system of claim 1 , wherein the browsing engine is configured to display at least one selected layer of the plurality of summarized video layers, in response to a selection from among the plurality of summarized video layers displayed in the overlapping manner over the background model.

5. The video search system of claim 1 , wherein the browsing engine is configured to remove at least one object corresponding to a canceling condition from the summarized video, if the canceling condition is input.

6. The video search system of claim 1 , wherein the browsing engine is configured to display at least one object identified in the summarized video as at least one search condition and remove an object corresponding to a search condition selected from the at least one search condition.

7. The video search system of claim 1 , further comprising an indexing engine configured to generate index data by structuralizing metadata extracted from the original video,
wherein the search engine is further configured to extract the index data matching the search condition and the video data corresponding to the extracted index data.

8. A video search system comprising:
a summarized video generation unit configured to:
generate a summarized video based on a search condition and video data corresponding to the search condition, the video data being extracted from an original video,
render, in real time, a plurality of objects in the summarized video in an overlapping manner according to a temporal order of appearance of the plurality of objects in the original video, and
display the plurality of rendered objects over the background model, the temporal order of appearance of the plurality of objects in the original video corresponding to a displaying order of the plurality of rendered objects in the summarized video;
a three-dimensional (3D) configuring unit configured to three-dimensionally arrange the summarized video into a plurality of summarized video layers in the overlapping manner over the background model based on one of a time basis and a category basis, in response to a video change request, the background model corresponding to a lowest layer of the plurality of summarized video layers; and
a filtering unit configured to display the summarized video from which an object corresponding to a canceling condition is removed, in response to the canceling condition being input.

9. The video search system of claim 8 , wherein the summarized video generation unit is configured to render the plurality of objects by changing a degree of temporal overlapping between the plurality of objects in the summarized video while maintaining the displaying order of the plurality of objects in the summarized video.

10. The video search system of claim 8 , wherein the summarized video generation unit is configured to limit a number of the plurality of objects displayed for a predetermined period of time.

11. The video search system of claim 8 , wherein the 3D configuring unit is further configured to display at least one selected layer of the plurality of summarized video layers, in response to a selection from among the plurality of summarized video layers displayed in the overlapping manner over the background model.

12. The video search system of claim 8 , wherein the filtering unit is configured to display at least one object identified in the summarized video as at least one search condition and remove an object corresponding to a search condition selected from the at least one search condition.

13. A video search method comprising:
extracting video data matching a search condition from an original video;
generating a summarized video based on the extracted video data;
rendering, in real time, a plurality of objects over a background model in the summarized video in an overlapping manner according to a temporal order of appearance of the plurality of objects in the original video;
displaying the rendered plurality of objects over the background model, the temporal order of appearance of the plurality of objects in the original video corresponding to a displaying order of the rendered plurality of objects in the summarized video; and
in response to a video change request, displaying a plurality of summarized video layers in the overlapping manner over the background model based on at least one of a time basis and a category basis, the background model corresponding to a lowest layer of the plurality of summarized video layers.

14. The video search method of claim 13 , wherein the rendering the plurality of objects comprises rendering the plurality of objects by changing a degree of temporal overlapping between the plurality of objects in the summarized video while maintaining a displaying order of appearance of the plurality of objects in the summarized video.

15. The video search method of claim 13 , wherein the rendering the plurality of objects comprises limiting a number of the objects displayed for a predetermined period of time.

16. The video search method of claim 13 , further comprising displaying at least one selected layer of the plurality of summarized video layers, in response to a selection from among the plurality of summarized video layers displayed in the overlapping manner over the background model.

17. The video search method of claim 13 , further comprising removing an object corresponding to a canceling condition from the summarized video, if the canceling condition is input.

18. The video search method of claim 13 , further comprising displaying at least one object identified in the summarized video as at least one search condition and removing an object corresponding to a search condition selected from the at least one search condition.

Assignees

• Hanwha Techwin Co Ltd

Inventors

• Park Dong Jun
• Lim Jeong Eun
• Lee Ho Jung

Classifications

• G06F16/738 Primary

  Presentation of query results · CPC title

• G06F16/7837

  using objects detected or recognised in the video content · CPC title

• G06F17/30837 Primary

  Physics · mapped topic

• G06F17/3079

  Physics · mapped topic