Image search system, image search apparatus, and image search method

Patent metadata

Field	Value
Publication number	US-10074186-B2
Application number	US-201515114585-A
Country	US
Kind code	B2
Filing date	Jan 14, 2015
Priority date	Jan 31, 2014
Publication date	Sep 11, 2018
Grant date	Sep 11, 2018

Abstract

An image search system comprising an video taking unit that takes a video, a search unit that contains a processor and a storage unit and searches for an image contained in the video, an input unit that receives information that is input to the search unit, and a display unit that displays information that is output from the search unit. The storage unit holds information indicating the shapes of trajectories that represent the travel paths of a plurality of moving objects extracted from the video. When information indicating the shape of a trajectory is input from the input unit, the search unit searches the plurality of moving-object trajectories held in the storage unit for trajectories that are similar to the input trajectory shape, and if such a trajectory is found, the search unit displays, on the display unit, images of the moving objects that have traveled along the found trajectories.

First claim

What is claimed is:

1. An image search system, comprising:
a processor; and
a storage device coupled to the processor, and configured to hold one or more videos, information indicating shapes of trajectories that represent travel paths of a plurality of moving objects extracted from the one or more videos, and information indicating image feature amounts of image areas of a plurality of types that are extracted from the one or more videos,
wherein the processor is configured to:
search, when information indicating a trajectory shape is input, the trajectories of the plurality of moving objects that are held in the storage device for trajectories that are similar to the input trajectory shape;
calculate, when information indicating an image feature amount of at least one type of image area, and information indicating weights of a feature amount of the input trajectory shape and each image feature amount of the at least one type of image area are input, similarity degree scores based on degrees of similarity between the input trajectory shape and the shapes of the trajectories of the plurality of moving objects that are held in the storage device, degrees of similarity between the input image feature amount of the at least one type of image area and the image feature amounts held in the storage device, and the input weights; and
output images from the one or more videos of the moving objects that have traveled along the trajectories found through the search in an order of the calculated similarity degree scores.

2. The image search system according to claim 1 , further comprising:
a camera configured to capture the one or more videos.

3. The image search system according to claim 1 , further comprising:
a camera configured to capture the one or more videos; and
a display apparatus connected to the processor,
wherein the processor is further configured to:
display the output images from the one or more videos of the moving objects that have traveled along the trajectories found through the search in the order of the calculated similarity degree scores on the display apparatus.

4. The image search system according to claim 1 ,
wherein the processor is further configured to:
extract the information indicating shapes of trajectories that represent travel paths of the plurality of moving objects and the information indicating image feature amounts of image areas of the plurality of types from the one or more videos.

5. An image search system, comprising:
a processor; and
a storage device coupled to the processor, and configured to hold one or more videos, information indicating shapes of trajectories that represent travel paths of a plurality of moving objects extracted from the one or more videos, map information of a space corresponding to the one or more videos, and conversion information for identifying one or more conversion parameters for conversion between coordinates of a map of the space and coordinates of the one or more videos,
wherein the processor is configured to:
output a map of the space;
convert, when information indicating a trajectory shape on the map of the space is input, the input trajectory shape into a trajectory shape on the one or more videos that are held in the storage device based on the conversion information;
search the trajectories of the plurality of moving objects that are held in the storage device for trajectories that are similar to the trajectory shape created by the conversion; and
output images from the one or more videos of the moving objects that have traveled along the trajectories found through the search.

6. The image search system according to claim 5 , further comprising:
a camera configured to capture the one or more videos.

7. The image search system according to claim 5 , further comprising:
a camera configured to capture the one or more videos; and
a display apparatus connected to the processor,
wherein the processor is further configured to:
display the output images from the one or more videos of the moving objects that have traveled along the trajectories found through the search on the display apparatus.

8. The image search system according to claim 5 ,
wherein the processor is further configured to:
extract the information indicating shapes of trajectories that represent travel paths of the plurality of moving objects from the one or more videos.

9. An image search system, comprising:
a processor; and
a storage device coupled to the processor, and configured to hold one or more videos, information indicating shapes of trajectories that represent travel paths of a plurality of moving objects extracted from the one or more videos, map information of a space corresponding to the one or more videos, and conversion information for identifying one or more conversion parameters for conversion between coordinates of a map of the space and coordinates of the one or more videos,
wherein, when information indicating a trajectory shape is input, the processor is configured to:
search, the trajectories of the plurality of moving objects that are held in the storage device for trajectories that are similar to the input trajectory shape;
convert the trajectory shapes found through the search into trajectory shapes on the map of the space based on the conversion information; and
output information indicating the map of the space and the trajectory shapes created by the conversion; and
output images from the one or more videos of the moving objects that have traveled along the trajectories found through the search.

10. The image search system according to claim 9 , further comprising:
a camera configured to capture the one or more videos.

11. The image search system according to claim 9 , further comprising:
a camera configured to capture the one or more videos; and
a display apparatus connected to the processor,
wherein the processor is further configured to:
display the output images from the one or more videos of the moving objects that have traveled along the trajectories found through the search on the display apparatus.

12. The image search system according to claim 9 ,
wherein the processor is further configured to:
extract the information indicating shapes of trajectories that represent travel paths of the plurality of moving objects from the one or more videos.

Assignees

• Hitachi Ltd

Inventors

• Nukaga Nobuo
• Matsubara Daisuke
• Watanabe Yuki
• Yoneji Kenichi
• Yoshinaga Tomoaki
• Hiroike Atsushi

Classifications

• G06F16/783 Primary

  using metadata automatically derived from the content · CPC title

• G06T7/246 Primary

  using feature-based methods, e.g. the tracking of corners or segments · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06F17/30823

  Physics · mapped topic

• G06K9/6201

  Physics · mapped topic