Video search device, data storage method and data storage device

Patent metadata

Field	Value
Publication number	US-11449544-B2
Application number	US-201916418334-A
Country	US
Kind code	B2
Filing date	May 21, 2019
Priority date	Nov 23, 2016
Publication date	Sep 20, 2022
Grant date	Sep 20, 2022

Abstract

Disclosed herein is a video search device comprising: at least one processor configured to implement an updating unit generating event object information based on feature information on an object detected in a video; and a storage configured to store comparison object information containing feature information on a reference object, wherein the processor is further configured to implement: an object information generating/deleting unit configured to create information on an object having a predetermined degree of similarity between the event object information and the comparison object information as final object information, and storing the final object information in the storage; and a data searching unit searching the final object information for data that satisfies a search criterion entered by a user.

First claim

What is claimed is:

1. A video search device comprising:
at least one processor configured to implement an updater which generates event object information based on feature information on at least one object detected in a video; and
a storage configured to store comparison object information containing feature information on at least one reference object,
wherein the processor is further configured to implement:
an object information generator/deleter configured to generate information on a first object, among the at least one object, having a predetermined degree of similarity between the event object information and the comparison object information as final object information, and storing the final object information in the storage; and
a data searcher configured to search the final object information for data that satisfies a search criterion entered by a user,
wherein the object information generator/deleter is further configured to store information on a second object, among the at least one object, having a similarity lower than the predetermined degree in the storage as temporary object information,
wherein, based on determining that the temporary object information satisfies a predetermined criterion, the updater is configured to update the final object information based on the temporary object information,
wherein whether the first object and the second object have the predetermined degree of similarity is determined by comparing feature information on the first object and the second object with the feature information on the at least one reference object,
wherein whether the temporary object information satisfies the predetermined criterion is determined based on another information on the second object which is not included in the feature information on the second object, and
wherein the predetermined criterion comprises a frequency at which the second object appears, or a frequency at which the second object takes a given action which is detected through video analysis of the video.

2. The device of claim 1 , wherein a number of attribute items included in the final object information is smaller than a number of attribute items included in the event object information.

3. The device of claim 1 , wherein the at least one processor is further configured to implement a counter configured to determine whether the temporary object information satisfies the predetermined criterion.

4. The device of claim 1 ,
wherein at least one attribute item defined by the feature information on the at least one object is different from an attribute item defined by the other information on the second object.

5. The device of claim 3 , wherein, based on determining that the temporary object information satisfies the predetermined criterion, the updater is further configured to update the comparison object information based on the temporary object information.

6. The device of claim 3 , wherein, based on determining that the temporary object information fails to satisfy the predetermined criterion for a predetermined time, the object information generator/deleter is configured to delete the temporary object information.

7. The device of claim 1 , wherein the storage is further configured to store a representative image for the video.

8. The device of claim 7 , further comprising:
a display configured to display a video derived as search results when the data searcher searches for the data,
wherein the display is configured to display the representative image associated with the video as thumbnails.

9. A data storing method comprising:
generating event object information comprising a plurality of entries each of which comprises a plurality of attribute items of an object detected in a video;
comparing the event object information with comparison object information comprising feature information on a reference object;
selecting at least one entry, from among the plurality of entries, of which attribute items have at least a predetermined degree of similarity to the feature information on the reference object;
generating final object information in which at least one attribute item from among the attribute items of the at least one entry is associated with an identifier of the reference object;
establishing a database based on the final object information such that the at least one entry can be retrieved from the database by the at least one attribute item or the identifier of the reference object;
storing information on an object having a similarity lower than the predetermined degree in a storage as temporary object information, and
updating the final object information based on the temporary object information, based on determining that the temporary object information satisfies a predetermined criterion,
wherein whether the object has the predetermined degree of similarity is determined by comparing feature information on the object with the feature information on the reference object,
wherein whether the temporary object information satisfies the predetermined criterion is determined based on another information on the object which is not included in the feature information on the object, and
wherein the predetermined criterion comprises a frequency at which the object appears, or a frequency at which the object takes a given action which is detected through video analysis of the video.

10. The method of claim 9 , wherein a number of the at least one attribute item included in the final object information is smaller than a number of the attribute items included in the event object information.

11. The method of claim 9 , further comprising:
generating the temporary object information based on another entry, from among the plurality of entries, of which attribute items have a less similarity to the feature information on the reference object than the predetermined degree.

12. The method of claim 11 , further comprising:
updating the final object information to include at least one attribute item of the other entry, based on determining that the temporary object information satisfies a predetermined criterion.

13. The method of claim 9 , further comprising:
searching the final object information for data if a search criterion is entered.

14. A data storing device comprising:
at least one processor to implement an updater configured to extract feature information on at least one object included in a video, and generate event object information based on the extracted feature information; and
a storage configured to store the event object information,
wherein the processor is further configured to implement:
a comparer configured to compare the extracted feature information with event object information already stored in the storage; and
an object information generator/deleter configured to generate final object information based on information on a first object, among the at least one object, having a predetermined degree of similarity between the extracted feature information and the event object information, and store the final object information in the storage,
wherein the object information generator/deleter is further configured to store information on a second object, among the at least one object, having a similarity lower than the predetermined degree in the storage as temporary object information,
wherein, based on determining that the temporary object information satisfies a predetermined criterion, the updater is configured to update the final object information based on the temporary object information,
wherein whether the first object and the second object have the predetermined degree of simila

Assignees

• Hanwha Techwin Co Ltd

Inventors

• Choi Jae Won
• Lee Jeong Hun
• Kim Kye Won
• Kim Ji Man
• Lee Sang Wook
• Lee Jong Hyeok
• Byun Jae Woon
• Lee Ho Jung
• Choi Jin Hyuk
• Cheung Sweung Won
• Kim Yeon Woo
• Yoon Jin

Classifications

• G06V40/103

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title

• G06V20/40

  in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) · CPC title

• G06V10/761

  Proximity, similarity or dissimilarity measures · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06T7/00

  Image analysis · CPC title