Controlling autonomous-vehicle functions and output based on occupant position and attention

Patent metadata

Field	Value
Publication number	US-10317900-B2
Application number	US-201715589253-A
Country	US
Kind code	B2
Filing date	May 8, 2017
Priority date	May 13, 2016
Publication date	Jun 11, 2019
Grant date	Jun 11, 2019

Abstract

Systems for use with an autonomous vehicle. The systems in various embodiments include a non-transitory storage device comprising an autonomous-vehicle context module that, when executed by a hardware-based processing unit, determines that manual operation of the vehicle is recommended or required during autonomous operation of the vehicle. The storage device also includes an autonomous-vehicle driver module that, when executed, determines that a vehicle occupant is not ready to take manual control of the autonomous vehicle based on one or both of occupant-position data, indicating a position of the vehicle occupant, and occupant-gaze data, indicating a gaze of the vehicle occupant. The system may in response advise the user of the need to take proper position to assume manual control of the vehicle. The system may also adjust present autonomous driving, such as to slow the vehicle, or pull the vehicle over to park.

First claim

What is claimed is:

1. A system, for use with an autonomous vehicle, comprising:
a non-transitory storage device comprising:
an autonomous-vehicle context module that, when executed by a hardware-based processing unit, determines that manual operation of the autonomous vehicle is recommended or required during autonomous operation of the autonomous vehicle; and
an autonomous-vehicle driver module that, when executed by the hardware-based processing unit, determines, based on occupant-position data received from an occupant-position sensor, that a vehicle occupant is not ready to take manual control of the autonomous vehicle, wherein the occupant-position sensor is a art of a portable occupant device.

2. The system of claim 1 wherein the non-transitory storage device comprises an activity module that, when executed by the processing unit, determines an action to be taken in response to determining that the vehicle occupant is not ready to take manual control of the autonomous vehicle.

3. The system of claim 2 wherein the action comprises providing an occupant communication configured to motivate the vehicle occupant to take a position to assume manual control of the autonomous vehicle.

4. The system of claim 3 further comprising an output module that, when executed by the processing unit, initiates delivery of the occupant communication via a human-machine interface (HMI) of the autonomous vehicle.

5. The system of claim 3 further comprising an output module that, when executed by the processing unit, initiates delivery of the occupant communication via the portable occupant device.

6. The system of claim 2 wherein the action comprises adjusting autonomous-driving operation of the autonomous vehicle.

7. The system of claim 6 further comprising an output module that, when executed by the processing unit, initiates adjusting at least one autonomous-driving component to change autonomous-driving operation of the autonomous vehicle.

8. The system of claim 1 wherein the autonomous-vehicle context module, when executed to determine that manual operation of the autonomous vehicle is recommended or required during autonomous operation of the autonomous vehicle, determines that manual operation is recommended or required for a safety reason.

9. The system of claim 1 wherein the autonomous-vehicle context module, when executed to determine that manual operation of the autonomous vehicle is recommended or required during autonomous operation of the autonomous vehicle, determines that manual operation is recommended or required based on a pre-established occupant-preference setting.

10. A system, for use with an autonomous vehicle, comprising:
a non-transitory storage device comprising:
an autonomous-vehicle context module that, when executed by a hardware-based processing unit, determines that manual operation of the autonomous vehicle is recommended or required during autonomous operation of the autonomous vehicle; and
an autonomous-vehicle driver module that, when executed by the hardware-based processing unit, determines, based on occupant-gaze data indicating a gaze of a vehicle occupant, that the vehicle occupant is not ready to take manual control of the autonomous vehicle, wherein the occupant-gaze data is received from an occupant handheld device or an occupant wearable device.

11. The system of claim 10 comprising an output module that, when executed by the hardware-based processing unit, initiates sending environmental context data to the occupant handheld device or occupant wearable device, for use in providing a display at the occupant handheld device or the occupant wearable device.

12. The system of claim 10 wherein the autonomous-vehicle driver module, when executed by the hardware-based processing unit, determines that a vehicle occupant is not ready to take manual control of the autonomous vehicle based on the occupant-gaze data and environmental data indicating characteristics of a present vehicle-driving environment.

13. The system of claim 12 wherein the environmental data includes vehicle pose data correlating (i) vehicle position, pose, or orientation and (ii) one or more features of an environment in which the autonomous vehicle is being used.

14. A system, for use with an autonomous vehicle, comprising:
a non-transitory storage device comprising:
an autonomous-vehicle context module that, when executed by a hardware-based processing unit, determines that manual operation of the autonomous vehicle is recommended or required during autonomous operation of the autonomous vehicle; and
an autonomous-vehicle driver module that, when executed by the hardware-based processing unit, determines, based on occupant-position data received from an occupant-position sensor, a position of multiple vehicle occupants of the autonomous vehicle and that none of the multiple vehicle occupants is ready to take manual control of the autonomous vehicle.

15. The system of claim 14 wherein the occupant-position sensor is a temperature sensor.

16. The system of claim 14 wherein the occupant-position sensor is a short-range radar.

Assignees

• Gm Global Tech Operations Llc

Inventors

• Kamhi Gila
• Mathieu Roy J

Classifications

• B60W40/08

  related to drivers or passengers · CPC title

• B60W2050/0043

  Signal treatments, identification of variables or parameters, parameter estimation or state estimation · CPC title

• B60W2556/45

  External transmission of data to or from the vehicle · CPC title

• B60W2050/0075

  Automatic parameter input, automatic initialising or calibrating means · CPC title

• B60W2040/0881

  Seat occupation; Driver or passenger presence · CPC title