Image processing apparatus, image processing system, image processing method, and computer-readable recording medium

Patent metadata

Field	Value
Publication number	US-10949983-B2
Application number	US-201616062468-A
Country	US
Kind code	B2
Filing date	Nov 24, 2016
Priority date	Dec 18, 2015
Publication date	Mar 16, 2021
Grant date	Mar 16, 2021

Abstract

An apparatus includes a reproducing unit configured to reproduce and display video data captured by an imaging apparatus in a predetermined display area on a display device; a feature area detecting unit configured to detect a plurality of feature areas based on feature information that is registered in advance for a tracking target, in a first frame of the video data displayed by the reproducing unit; and a tracking area detecting unit configured to detect an area including the plurality of feature areas as a tracking area that includes the tracking target, based on a distance between the plurality of feature areas detected by the feature area detecting unit.

First claim

The invention claimed is:

1. An image processing apparatus, comprising:
processing circuitry configured to
reproduce and cause display video data captured by an imaging apparatus to be displayed in a predetermined display area on a display;
register a reference color corresponding to a color included in a tracking target as feature information;
detect a plurality of two-dimensional feature areas, based on the feature information that is registered in advance for detecting the tracking target, in a first frame of the displayed video data; and
determine an area that encompasses the plurality of two-dimensional feature areas as a tracking area that includes the tracking target, based on a distance between pixels in the detected plurality of two-dimensional feature areas,

wherein the processing circuitry is further configured to
obtain a first image by extracting an area including a pixel with a color that is included in a predetermined color range that includes the reference color in at least a partial area of the first frame,
obtain a second image by binarizing the first image,
obtain a third image in which one or more blocks that are obtained in the second image through the binarizing are distinguished from one another, and
when a pixel value of an area of the first frame corresponding to each of the blocks of the third image is included in the predetermined color range, detect the area as the feature area.

2. The image processing apparatus according to claim 1 , wherein the processing circuitry is further configured to:
calculate the distance,
determine whether the calculated distance is equal to or smaller than a threshold, and
when determining that the distance between the plurality of two-dimensional feature areas is equal to or smaller than the threshold, determine the area encompassing the plurality of two-dimensional feature areas as the tracking area.

3. The image processing apparatus according to claim 1 , wherein the processing circuitry is further configured to:
determine a specific area, which is to be a target in which the processing circuitry is configured to detect the plurality of two-dimensional feature areas, as a search area in the display area, and
detect the plurality of two-dimensional feature areas in the search area.

4. The image processing apparatus according to claim 3 , wherein the processing circuitry is further configured to determine a first area, which has a predetermined size and which includes the determined tracking area in a second frame provided before the first frame, as the search area in the first frame.

5. The image processing apparatus according to claim 3 , wherein
when the processing circuitry does not detect the tracking area in the first frame, the processing circuitry is further configured to determine a new search area by extending the search area determined for the first frame by a predetermined amount, and
the processing circuitry is further configured to detect the plurality of two-dimensional feature areas in the new search area for a third frame provided after the first frame.

6. The image processing apparatus according to claim 1 , wherein the processing circuitry is further configured to register a plurality of reference colors corresponding to a plurality of colors included in the tracking target as the feature information.

7. The image processing apparatus according to claim 1 , wherein the processing circuitry is further configured to:
designate a designation area for registering the reference color; and
register the reference color using a color of a pixel present in the designation area.

8. The image processing apparatus according to claim 1 , wherein the processing circuitry is further configured to additionally register a reference shape corresponding to a shape included in the tracking target as the feature information.

9. The image processing apparatus according to claim 8 , wherein the processing circuitry is further configured to:
designate a designation area for registering the reference shape; and
register the reference shape using a shape present in the designation area.

10. The image processing apparatus according to claim 1 , wherein the processing circuitry is further configured to cause the display to display a trajectory line indicating a trajectory of the tracking target in a superimposed manner on the video data.

11. The image processing apparatus according to claim 10 , wherein the processing circuitry is further configured to cause the display to display parts of the trajectory line in different modes in chronological order.

12. The image processing apparatus according to claim 1 , wherein the processing circuitry is further configured to update the feature information with new feature information based on the plurality of feature areas detected in the first frame, and detect a plurality of feature areas based on the new feature information in a frame provided after the first frame.

13. An image processing system comprising:
the imaging apparatus configured to capture the video data;
the display device configured to display the video data captured by the imaging apparatus; and
the image processing apparatus according to claim 1 .

14. An image processing method, comprising:
reproducing and displaying video data captured by an imaging apparatus in a predetermined display area on a display;
registering a reference color corresponding to a color included in a tracking target as feature information;
detecting a plurality of two-dimensional feature areas, based on the feature information that is registered in advance for detecting the tracking target, in a first frame of the displayed video data; and
determining an area that encompasses the plurality of two-dimensional feature areas as a tracking area that includes the tracking target, based on a distance between pixels in the detected plurality of two-dimensional feature areas,
wherein the method further includes
obtaining a first image by extracting an area including a pixel with a color that is included in a predetermined color range that includes the reference color in at least a partial area of the first frame,
obtaining a second image by binarizing the first image,
obtaining a third image in which one or more blocks that are obtained in the second image through the binarizing are distinguished from one another, and
when a pixel value of an area of the first frame corresponding to each of the blocks of the third image is included in the predetermined color range, detecting the area as the feature area.

15. A non-transitory computer-readable recording medium that contains a computer program that causes a computer to execute a method comprising:
reproducing and displaying video data captured by an imaging apparatus in a predetermined display area on a display device;
registering a reference color corresponding to a color included in a tracking target as feature information;
detecting a plurality of two-dimensional feature areas based on the feature information that is registered in advance for the tracking target, in a first frame of the displayed video data; and
determining an area that encompasses the plurality of two-dimensional feature areas as a tracking area that includes the tracking target, based on a distance between pixels in the detected plurality of two-dimensional feature areas,
wherein the method further includes
obtaining a first image by extracting an area including a pixel with a color that is included in a predetermined color range that includes the reference color in at least a partial area of the first frame,
obtaining

Assignees

• Komoto Shotaro
• Ohmura Keiji
• Ricoh Co Ltd

Inventors

• Komoto Shotaro
• Ohmura Keiji

Classifications

• G06T7/00

  Image analysis · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T7/251 Primary

  involving models · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title