Display control device, display control method, and storage medium storing display control program

Patent metadata

Field	Value
Publication number	US-2022169257-A1
Application number	US-201917600607-A
Country	US
Kind code	A1
Filing date	Apr 12, 2019
Priority date	Apr 12, 2019
Publication date	Jun 2, 2022
Grant date	—

Abstract

A display control device includes processing circuitry to acquire traveling environment information; to estimate driving skill of the driver; to detect a direction of a line of sight of the driver; to accumulate information on movements of the sight line direction and driving action information; to calculate a visual field range and a visual recognition level indicating ease of recognition of each of a plurality of sections in the visual field range by the driver's vision based on the information on the movements of the sight line direction and the driving action information accumulated in the memory and at least one of the traveling environment information and the driving skill information; and to receive display information and to control at least one of a display position and a display method of an image on a basis of the display information.

First claim

1 . A display control device comprising:
processing circuitry to acquire traveling environment information indicating environment around a vehicle driven by a driver; to estimate driving skill of the driver and to generate driving skill information indicating the driving skill; to detect a direction of a line of sight of the driver and to generate sight line direction information indicating the direction of the line of sight; to accumulate information on movements of the sight line direction occurring at times of driving actions of the driver and driving action information on the driver in a memory, the information on the movements being obtained by the sight line direction information; to calculate a visual field range indicating a region that can be visually recognized by the driver and a visual recognition level indicating ease of recognition of each of a plurality of sections in the visual field range by the driver's vision based on the information on the movements of the sight line direction and the driving action information accumulated in the memory and at least one of the traveling environment information and the driving skill information; and to receive display information to be presented to the driver and to control at least one of a display position and a display method of an image on a basis of the display information based on the display information, the visual field range and the visual recognition level.

2 . The display control device according to claim 1 , wherein the processing circuitry calculates the visual recognition level based on the sight line direction information on the driver, the driving skill information and the traveling environment information.

3 . (canceled)

4 . The display control device according to claim 1 , wherein the processing circuitry edits the position and the display method of displaying the image on the basis of the display information depending on the acquired visual recognition level and an importance level of the display information.

5 . The display control device according to claim 1 , wherein the processing circuitry executes control for producing a display that guides the driver's line of sight from the driver's visual field range to a sight line direction in which the driver should view according to the driver's visual field range and the acquired visual recognition level and information indicating the sight line direction in which the driver should view included in the display information.

6 . The display control device according to claim 1 , wherein the processing circuitry acquires position information regarding the vehicle, weather around the vehicle and road environment information.

7 . The display control device according to claim 1 , wherein the processing circuitry detects an object existing around the vehicle based on information acquired from a camera that captures an image of a scene outside the vehicle or an infrared ray sensor.

8 . The display control device according to claim 1 , wherein the processing circuitry acquires and accumulates driving actions of the driver and estimates the driving skill from a frequency of a predetermined driving action.

9 . The display control device according to claim 8 , wherein the processing circuitry acquires biological information on the driver and corrects the driving skill information based on the biological information.

10 . The display control device according to claim 8 , wherein the processing circuitry acquires the driver's driving experience, driving history records, health condition or eyesight information and corrects the driving skill information based on one or more items of information among the driving experience, the driving history records, the health condition and the eyesight information.

11 . A display control method comprising:
acquiring traveling environment information indicating environment around a vehicle driven by a driver; estimating driving skill of the driver and generating driving skill information indicating the driving skill; detecting a direction of a line of sight of the driver and generating sight line direction information indicating the direction of the line of sight; accumulating information on movements of the sight line direction occurring at times of driving actions of the driver and driving action information on the driver in a memory, the information on the movements being obtained by the sight line direction information; calculating a visual field range indicating a region that can be visually recognized by the driver and a visual recognition level indicating ease of recognition of each of a plurality of sections in the visual field range by the driver's vision based on the accumulated information on the movements of the sight line direction and the accumulated driving action information and at least one of the traveling environment information and the driving skill information; and receiving display information to be presented to the driver and controlling at least one of a display position and a display method of an image on a basis of the display information based on the display information, the visual field range and the visual recognition level.

12 . A non-transitory computer-readable storage medium storing a display control program that causes a computer to execute:
acquiring traveling environment information indicating environment around a vehicle driven by a driver; estimating driving skill of the driver and generating driving skill information indicating the driving skill; detecting a direction of a line of sight of the driver and generating sight line direction information indicating the direction of the line of sight; accumulating information on movements of the sight line direction occurring at times of driving actions of the driver and driving action information on the driver in a memory, the information on the movements being obtained by the sight line direction information; calculating a visual field range indicating a region that can be visually recognized by the driver and a visual recognition level indicating ease of recognition of each of a plurality of sections in the visual field range by the driver's vision based on the accumulated information on the movements of the sight line direction and the accumulated driving action information and at least one of the traveling environment information and the driving skill information; and receiving display information to be presented to the driver and controlling at least one of a display position and a display method of an image on a basis of the display information based on the display information, the visual field range and the visual recognition level.

Assignees

• Mitsubishi Electric Corp

Inventors

• KIKUTA Hayato
• Nakamura Yoshitomo
• Kubota Satoru

Classifications

• B60W2050/146

  Display means · CPC title

• B60W50/14

  Means for informing the driver, warning the driver or prompting a driver intervention · CPC title

• B60K35/81

  for controlling displays · CPC title

• B60K35/23

  Head-up displays [HUD] (optical aspects of head-up displays G02B27/01) · CPC title

• B60K35/60

  Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10) · CPC title