Information presenting apparatus and information presenting method

Patent metadata

Field	Value
Publication number	US-10146221-B2
Application number	US-201415128036-A
Country	US
Kind code	B2
Filing date	Mar 26, 2014
Priority date	Mar 26, 2014
Publication date	Dec 4, 2018
Grant date	Dec 4, 2018

Abstract

An information presenting apparatus is used in an autonomous vehicle capable of switching between autonomous driving control and manual driving control. The information presenting apparatus determines a response action for checking that the driver is ready to take over when the autonomous driving control is switched to the manual driving control, performs control for requesting the driver to perform the response action determined, and detects the response action performed by the driver.

First claim

The invention claimed is:

1. An information presenting apparatus for use in an autonomous vehicle capable of switching between autonomous driving control and manual driving control, in which the vehicle is driven by a driver, the information presenting apparatus comprising:
a memory; and
a processor configured to execute instructions stored in the memory to:
determine a response action to be performed by the driver of the autonomous vehicle, wherein
the response action being indicative of a driving operation of the autonomous driving control, and
the driving operation being selected from a plurality of self-vehicle behavior candidates of the autonomous driving control;

perform control for requesting the driver to perform the response action;
detect whether the driver performed the response action;
in response to detecting that the response action is not performed by the driver:
set a flag indicating that the driver is not ready take over when the autonomous driving control is switched to the manual driving control; and

in response to detecting that the response action is performed by the driver:
set the flag indicating that the driver is ready to take over when the autonomous driving control is switched to the manual driving control; and
maintain the autonomous driving control of the autonomous vehicle, wherein
performance, by the driver, of the response action, is indicative of an approval of the driver of the continuance of the autonomous driving, and
when a point to switch from the autonomous driving control to the manual driving control is predetermined, the processor shortens an interval for requesting the driver to perform the response action as the predetermined point approaches.

2. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to receive only an affirmative response from the driver.

3. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to receive only a negative response from the driver.

4. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to receive both an affirmative response and a negative response from the driver.

5. The information presenting apparatus according to claim 1 , wherein the processor is further configured to execute instructions stored in the memory to:
on condition that a frequency of the response action is below a predetermined frequency, ask the driver a question to which a response is inevitable.

6. The information presenting apparatus according to claim 1 , wherein the response action is a button operation by the driver.

7. The information presenting apparatus according to claim 1 , wherein the response action is a response speech by the driver.

8. The information presenting apparatus according to claim 7 , wherein when a frequency of the speech or a dialogue by the driver is below a predetermined frequency, a question to which the speech or the dialogue is inevitable is asked to the driver.

9. The information presenting apparatus according to claim 7 , wherein the processor is configured to execute instructions stored in the memory to shorten an interval of requesting the driver to perform the response action when the driver makes an inappropriate speech or dialogue.

10. The information presenting apparatus according to claim 1 , wherein the response action is a dialogue with the driver.

11. The information presenting apparatus according to claim 10 , wherein when the driver has a low level of awareness of surroundings in the dialogue with the driver, the dialogue with the driver is repeated.

12. The information presenting apparatus according to claim 1 , wherein the processor is further configured to execute instructions stored in the memory to:
stop the autonomous driving control of the autonomous vehicle when the driver does not perform the response action.

13. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to request the driver to perform the response action every time a predetermined period of time passes or every time the autonomous vehicle performs a predetermined number of cruise control operations.

14. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to request the driver to perform the response action when detecting that the driver is not awake or is not watching ahead.

15. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to set timing to request the driver to perform the response action, based on a state of the driver and a travelling condition and outside circumstance of the autonomous vehicle.

16. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to delay timing to request the driver to perform the response action when the driver manually drives the autonomous vehicle.

17. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to when requesting to perform the response action, display a pattern formed by spatial-frequency and temporal-frequency having no luminance edge.

18. The information presenting apparatus according to claim 1 , wherein the processor is configured to execute instructions stored in the memory to when requesting to perform the response action, provide the driver with sensory stimulation in synchronization with displaying an image.

19. An information presenting method performed by an information presenting apparatus for use in an autonomous vehicle capable of switching between autonomous driving control and manual driving control, in which the vehicle is driven by a driver, the information presenting method comprising:
determining a response action for maintaining the autonomous driving control by determining that the driver of the autonomous vehicle approves of the autonomous driving control, wherein the response action being indicative of a driving operation of the autonomous driving control;
requesting the driver to perform the determined response action; and
detecting the response action performed by the driver;
in response to detecting that the response action is not performed by the driver:
determining that the driver is not ready take over when the autonomous driving control is switched to the manual driving control; and

in response to detecting that the response action is performed by the driver:
determining that the driver is ready to take over when the autonomous driving control is switched to the manual driving control; and
maintaining the autonomous driving control of the autonomous vehicle, wherein
performance, by the driver, of the response action, is indicative of an approval of the driver of the continuance of the autonomous driving, and
when a point switch from the autonomous driving control to the manual driving control is predetermined, shortening an interval for requesting the driver to perform the response action as the predetermined point approaches.

20. The information presenting apparatus according to claim 1 , wherein the processor is further configured to execute instructions s

Assignees

• Nissan Motor

Inventors

• Funakawa Masami

Classifications

• B60W2540/215

  Selection or confirmation of options · CPC title

• B60W2540/21

  Voice · CPC title

• B60W50/14

  Means for informing the driver, warning the driver or prompting a driver intervention · CPC title

• B60W2040/0863

  due to erroneous selection or response of the driver · CPC title

• B60W2900/00

  Indexing codes relating to the purpose of, or problem solved of road vehicle drive control systems not otherwise provided for in groups B60W30/00 · CPC title