Image processing apparatus

Patent metadata

Field	Value
Publication number	US-11030468-B2
Application number	US-201716462488-A
Country	US
Kind code	B2
Filing date	Nov 21, 2017
Priority date	Nov 21, 2016
Publication date	Jun 8, 2021
Grant date	Jun 8, 2021

Abstract

An image processing apparatus includes a communication interface and a controller. The communication interface is configured to acquire a first video image capturing an outside area of a moving body. The controller is configured to cause a second video image corresponding to a display region of the first video image to be displayed on a display apparatus. The controller is also configured to detect at least a portion of a detection object in the display region of the first video image, determine whether one or more conditions are met based on a relative positional relationship between the moving body and the detection object and, when it is determined that the one or more conditions are met, cause a first marker corresponding to the detection object to be superimposed on the second video image and displayed on the display apparatus.

First claim

The invention claimed is:

1. An image processing apparatus comprising:
a communication interface configured to acquire a first video image capturing an outside area of a moving body; and
a controller configured to:
cause a second video image corresponding to a display region of the first video image to be displayed on a display apparatus;
detect at least a portion of a detection object in the display region of the first video image;
determine whether one or more conditions are met based on a relative positional relationship between the moving body and the detection object; and
when it is determined that the one or more conditions are met, cause a first marker corresponding to the detection object to be superimposed on the second video image and displayed on the display apparatus.

2. The image processing apparatus according to claim 1 ,
wherein the controller is configured to:
acquire moving body information from the moving body via the communication interface;
determine a first predicted path of the moving body based on the moving body information; and
when at least a portion of the detection object is detected, determine a second predicted path of the detection object based on the detection object in the first video image, and

further wherein the one or more conditions include a first condition that the detection object is located in the first predicted path of the moving body or a second condition that the first predicted path of the moving body and the second predicted path of the detection object at least partially overlap with each other.

3. The image processing apparatus according to claim 1 ,
wherein the one or more conditions include a third condition that a distance between the moving body and the detection object is less than a threshold.

4. The image processing apparatus according to claim 1 ,
wherein the controller is further configured to:
detect a plurality of types of objects as detection objects; and
determine a display mode of the first marker in accordance with a type of an object detected in the first video image.

5. The image processing apparatus according to claim 1 ,
wherein the controller is configured to:
when a distance between the moving body and the detection object decreases, determine which one of the moving body and the detection object contributes more to the decrease in the distance;
when it is determined that the moving body contributes more, cause a second marker to be superimposed on the second video image and displayed on the display apparatus in such a manner that the second marker moves from a position different from a superimposed position of the first marker on the second video image toward the superimposed position of the first marker; and
when it is determined that the detection object contributes more, cause the second marker to be superimposed on the second video image and displayed on the display apparatus in such a manner that the second marker moves from the superimposed position of the first marker on the second video image toward a position different from the superimposed position of the first marker.

6. The image processing apparatus according to claim 5 ,
wherein the controller is configured to determine a moving speed of the second marker based on a rate of decrease of the distance between the moving body and the detection object.

7. The image processing apparatus according to claim 1 ,
wherein the controller is configured to cause the first marker to be superimposed on the second video image and displayed on the display apparatus after causing a third marker corresponding to the detection object to be superimposed on the detection object in the second video image and displayed on the display apparatus, when it is determined that the one or more conditions are met.

8. The image processing apparatus according to claim 1 ,
wherein the controller is configured to display a fourth marker corresponding to the detection object to be superimposed on the second video image and displayed on the display apparatus when a distance between the moving body and the detection object is less than a predetermined threshold.

9. The image processing apparatus according to claim 1 ,
wherein the controller is configured to change a display mode of the first marker when a distance between the moving body and the detection object is less than a predetermined threshold.

10. An image processing apparatus comprising:
a communication interface configured to acquire a first video image capturing an outside area of a moving body; and
a controller configured to:
cause a second video image corresponding to a display region of the first video image to be displayed on a display apparatus;
detect at least a portion of a detection object in the display region of the first video image; and
perform specific image processing on a region of the second video image corresponding to the at least a portion of the detection object, the specific image processing including changing a characteristic value of the region of the second video image.

11. The image processing apparatus according to claim 10 ,
wherein the specific image processing further includes superimposing a marker corresponding to the detection object on the region of the second video image.

12. The image processing apparatus according to claim 11 ,
wherein
the controller is further configured to:
detect a plurality of types of objects as detection objects; and
determine a display mode of the marker in accordance with a type of an object detected in the first video image.

13. The image processing apparatus according to claim 11 ,
wherein
the marker includes an image corresponding to an outline of the at least a portion of the detection object in the second video image.

14. The image processing apparatus according to claim 10 ,
wherein
the characteristic value includes at least one of a luminance value and a contrast ratio of a video image.

15. The image processing apparatus according to claim 10 ,
wherein the controller is configured to perform the specific image processing when a first condition specifying that the detection object is located in a first predicted path of the moving body or a second condition specifying that the first predicated path of the moving body and a second predicted path of the detection object at least partially overlap with each other is met.

16. The image processing apparatus according to claim 10 ,
wherein the controller is configured to perform the specific image processing when a third condition specifying that a distance between the moving body and the detection object is less than a threshold is met.

17. The image processing apparatus according to claim 10 ,
wherein the controller is configured to perform the specific image processing when a fourth condition specifying that a characteristic value of the second image is smaller than a threshold is met.

18. An image processing apparatus comprising:
a communication interface configured to acquire a first video image capturing an outside area of a moving body; and
a controller configured to:
cause a second video image corresponding to a display region of the first video image to be displayed on a display apparatus;
detect at least a portion of a detection object in a detection region of the first video image; and
cause a marker corresponding to the detection object to be superimposed on the second video image and displayed on the display apparatus when a detection position of the at least a portion of the detection object in the

Assignees

• Kyocera Corp

Inventors

• Shimazu Tomohiro
• FUKASAWA Taro
• Oshima Takeo

Classifications

• G06V20/58 Primary

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06T7/246 Primary

  using feature-based methods, e.g. the tracking of corners or segments · CPC title

• G06T2207/30204

  Marker · CPC title

• G06T7/73

  using feature-based methods · CPC title