Driving-support-image generation device, driving-support-image display device, driving-support-image display system, and driving-support-image generation program

Patent metadata

Field	Value
Publication number	US-10061994-B2
Application number	US-201315032185-A
Country	US
Kind code	B2
Filing date	Nov 12, 2013
Priority date	Nov 12, 2013
Publication date	Aug 28, 2018
Grant date	Aug 28, 2018

Abstract

A driving-support-image generation device of the present invention comprises: a character recognizer that recognizes a character in an image indicative of a message content of a messaging object posted on a road or around a road; and an image processor that generates, based on the character recognized by the character recognizer and driving-support information related to the character, a driving-support image obtained by modifying the image of the messaging object into an image matched to the driving-support information.

First claim

The invention claimed is:

1. A driving-support-image generation device installed within a host vehicle and operatively connected to a navigation device and a display installed within the host vehicle, the driving-support-image generation device comprising:
a computer processor; and
a memory storing instructions which, when executed by the computer processor, performs a process comprising:
recognizing a character in an image captured by an image capturing device mounted to the host vehicle, the image being indicative of a message content of a messaging object posted on a road or around a road,
determining whether or not the recognized character corresponds to information related to a destination point or a route point of the host vehicle set in the navigation device,

generating a driving-support image in which the recognized character that has been determined to correspond to the information related to the destination point or the route point of the host vehicle is highlighted, and
causing the driving-support image to be displayed on the display.

2. The driving-support-image generation device of claim 1 , the process further comprising determining an image quality of the driving-support image prior to highlighting the recognized character, wherein
the recognized character is highlighted in response to a determination that the image quality of the driving-support image is lower than a set threshold value.

3. The driving-support-image display device of claim 1 ,
wherein the driving-support-image display device further comprises a camera of detecting a direction of a sight line of a passenger of the host vehicle,
wherein the process further comprises determining whether the passenger recognizes the messaging object based on the detected direction of the sight line, and
wherein the driving-support image is caused to be displayed on the display when the passenger is determined not to recognize the messaging object.

4. A driving-support-image display system installed within a host vehicle, the driving-support-image generation device, comprising:
an image capturing device mounted to the host vehicle that captures a messaging object posted on a road or around a road;
a driving-support-image generation device operatively connected to a navigation device installed within the host vehicle, the driving-support-image generation device comprising a computer processor and a memory storing instructions which, when executed by the computer processor, performs a process that comprises:
recognizing a character in an image captured by the image capturing device, the image being indicative of a message content of the messaging object captured by the image capturing device,
determining whether or not the recognized character corresponds to information related to a destination point or a route point of the host vehicle set in the navigation device, and
generating a driving-support image in which the recognized character that has been determined to correspond to the information related to the destination point or the route point of host vehicle is highlighted; and

a display that displays the driving-support image.

5. A non-transitory computer readable medium on which is stored a driving-support-image generation program that causes a computer, which is installed within a host vehicle and operatively connected to a navigation device and a display installed within the host vehicle, to perform the following process when executed:
recognizing a character in an image captured by an image capturing device mounted to the host vehicle indicative of a message content of a messaging object posted on a road or around a road;
determining whether or not the recognized character corresponds to information related to a destination point or a route point of the host vehicle set in the navigation device;
generating a driving-support image in which the recognized character that has been determined to correspond to the information related to the destination point or the route point of the host vehicle is highlighted; and
causing the driving-support image to be displayed on the display.

Assignees

• Mitsubishi Electric Corp

Inventors

• Tsushima Naoyuki
• Murayama Shu

Classifications

• G01C21/3655 Primary

  Timing of guidance instructions · CPC title

• G06V20/582

  of traffic signs · CPC title

• G06V30/10

  Character recognition · CPC title

• G06K2209/01

  Physics · mapped topic

• G06T11/60

  Creating or editing images; Combining images with text · CPC title