Image processing device, device control system, and computer-readable storage medium

Patent metadata

Field	Value
Publication number	US-10489664-B2
Application number	US-201515115832-A
Country	US
Kind code	B2
Filing date	Feb 5, 2015
Priority date	Feb 5, 2014
Publication date	Nov 26, 2019
Grant date	Nov 26, 2019

Abstract

An image processing device includes circuitry to acquire a range image, recognize an external situation indicating a situation of an imaging area corresponding to the range image, recognize a recognition target to be tracked from the range image by a recognition method based on the recognized external situation, remove the recognition target from the range image to generate a new range image, and detect an object in the new range image from which the recognition target has been removed.

First claim

The invention claimed is:

1. An image processing device, comprising:
processing circuitry configured to
acquire a current range image of a sequence of range images captured at different times, respectively, wherein each range image of the sequence of range images captures a scene as viewed from a moving vehicle,
recognize an external situation indicating a situation of an imaging area external to the moving vehicle and corresponding to the current range image,
recognize a recognition target in the current range image by a recognition method based on the recognized external situation,
when determining that the recognition target recognized in the current range image was also recognized in a previous range image captured at a time prior to a capture time of the current range image and is being tracked, remove the recognition target from the current range image to generate a new range image, and
detect an object, different from the recognition target, in the new range image from which the recognition target has been removed.

2. The image processing device according to claim 1 , wherein the processing circuitry is further configured to
predict a next external situation of a next frame from the recognized external situation, and
recognize a recognition object by the recognition method in accordance with the predicted next external situation.

3. The image processing device according to claim 2 , wherein the processing circuitry is further configured to
select the recognition method suitable for a prediction result from among one or a plurality of recognition methods to recognize the recognition object from the range image;
change a threshold of the recognition method used to recognize the recognition object to another threshold; and
recognize the recognition object by using the selected recognition method and the another threshold.

4. The image processing device according to claim 2 , wherein the processing circuitry is further configured to acquire an internal situation indicating an operational situation of a controlled device, wherein
the processing circuitry is further configured to predict the next external situation of the next frame from the recognized external situation and the acquired internal situation.

5. The image processing device according to claim 1 , wherein the processing circuitry is further configured to recognize the recognition target, from among a plurality of potential targets, based on a priority level.

6. The image processing device according to claim 2 , wherein the processing circuitry is further configured to calculate and output, as the next external situation, a position of the recognition object, a shape change rate of the recognition object, and a shielded ratio of the recognition object.

7. A device control system, comprising:
processing circuitry configured to
acquire a current range image of a sequence of range images captured at different times, respectively, wherein each range image of the sequence of range images captures a scene as viewed from a moving vehicle,
recognize an external situation indicating a situation of an imaging area external to the moving vehicle and corresponding to the current range image,
recognize a recognition target in the current range image by a recognition method based on the recognized external situation,
when determining that the recognition target recognized in the current range image was also recognized in a previous range image captured at a time prior to a capture time of the current range image and is being tracked, remove the recognition target from the current range image to generate a new range image, and
detect an object, different from the recognition target, in the new range image from which the recognition target has been removed.

8. A non-transitory computer-readable storage medium with an executable program stored thereon and executed by a computer, wherein the program instructs the computer to perform:
acquiring a current range image of a sequence of range images captured at different times, respectively, wherein each range image of the sequence of range images captures a scene as viewed from a moving vehicle;
recognizing an external situation indicating a situation of an imaging area external to the vehicle and corresponding to the current range image;
recognizing a recognition target in the current range image by a recognition method based on the recognized external situation;
when determining that the recognition target recognized in the current range image was also recognized in a previous range image captured at a time prior to a capture time of the current range image and is being tracked, removing the recognition target from the current range image to generate a new range image; and
detecting an object, different from the recognition target, in the new range image from which the recognition target has been removed.

9. The image processing device of claim 1 , wherein the range image is a disparity image, and the processing circuitry is further configured to store the new range image in a memory.

Assignees

• Yokota Soichiro
• Lu Yaojie
• Ishigaki Tomoko
• Ricoh Co Ltd

Inventors

• Yokota Soichiro
• Lu Yaojie
• Ishigaki Tomoko

Classifications

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V20/56 Primary

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G01S13/931

  of land vehicles · CPC title

• B60W30/08

  Active safety systems} predicting or avoiding probable or impending collision {or attempting to minimise its consequences · CPC title

• G06V10/255

  Detecting or recognising potential candidate objects based on visual cues, e.g. shapes · CPC title