Spatial auditory alerts for a vehicle

Patent metadata

Field	Value
Publication number	US-9896031-B1
Application number	US-201715397413-A
Country	US
Kind code	B1
Filing date	Jan 3, 2017
Priority date	Jan 3, 2017
Publication date	Feb 20, 2018
Grant date	Feb 20, 2018

Abstract

A vehicle includes a plurality of sensors including exterior sensors. Vehicle signals, such as those derived from sensors, are processed to detect alertable conditions and each alertable condition is represented by a created software object. A location is associated with each software object, such as corresponding to a location of an exterior feature that gave rise to the alertable condition. The software object is updated over time according to the vehicle signals, such as by updating the location according to movement of the obstacle. The software objects are processed to drive an array of speakers effective to simulate a sound originating from the location associated with the software object. The sound generated by the speakers may be repeated chimes having a volume and period determined according to the location.

First claim

The invention claimed is:

1. A method comprising, by a controller of a vehicle:
receiving sensor data from multiple vehicle sensors;
generating software objects corresponding to the sensor data;
modifying the software objects in real time based on updated data from the vehicle sensors; and
generating three dimensional (3D) auditory signals using a plurality of speakers according to the software objects to convey vehicle information to a driver;
wherein generating the software objects corresponding to the sensor data comprises:
detecting in the sensor data presence of cross-traffic behind the vehicle in the sensor data; and
creating a feature software object for the cross-traffic;
wherein generating the 3D auditory signals using a plurality of speakers according to the software objects to convey vehicle information to a driver comprises generating a series of audible signals simulating movement of a sound source behind a driver of the vehicle in a direction of the cross traffic.

2. The method of claim 1 , wherein generating the software objects corresponding to the sensor data comprises:
detecting in the sensor data presence of an exterior feature and a feature location for the exterior feature; and
creating a feature software object for the exterior feature and having the feature location associated therewith.

3. The method of claim 2 , wherein modifying the software objects in real time based on the updated data from the vehicle sensors comprises:
detecting movement of the exterior feature relative to the vehicle in the updated data to an updated location; and
modifying the feature location according to the updated location in the feature software object.

4. The method of claim 3 , wherein generating the 3D auditory signals using the plurality of speakers according to the software objects comprises:
generating a feature audio signal having a simulated location in outputs of the plurality of speakers corresponding to the feature location of the feature software object.

5. The method of claim 4 , wherein the vehicle sensors comprise at least one of an ultrasonic sensor, a radio detection and ranging (RADAR) sensor, a light detection and ranging (LIDAR) sensor, a camera, and a sound navigation and ranging (SONAR) sensor.

6. The method of claim 4 , wherein generating the 3D auditory signals using the plurality of speakers according to the software objects comprises:
generating a series of audible sounds having a separation between audible sounds that decreases with decrease in a distance between the feature location and the vehicle.

7. The method of claim 4 , wherein generating the 3D auditory signals using the plurality of speakers according to the software objects comprises:
generating a series of audible sounds having one or more auditory dimensions effective to convey at least one of a location of the exterior feature relative to the vehicle, a type of exterior feature, the relative threat level of the exterior feature, a distance between the vehicle and the exterior feature, and a rate of change of the distance.

8. The method of claim 1 , wherein receiving sensor data from multiple vehicle sensors comprises receiving an output of a door sensor indicating that a door is ajar, the method further comprising:
generating a door ajar software object having a location associated therewith and varying the location associated with the door ajar software object over a time period to indicate movement toward the door; and
generating the three dimensional (3D) auditory signals using the plurality of speakers over the time period according to a current value of the location.

9. The method of claim 1 , wherein receiving sensor data from multiple vehicle sensors comprises receiving signals used by the controller for implementing one or more of:
adaptive cruise control;
automatic emergency braking;
automatic parking;
assisted parking;
blind spot detection;
collision avoidance;
lane departure warning;
lane keeping assistance;
global positioning system (GPS) navigation;
tire pressure monitoring; and
a traction control system.

10. A vehicle comprising:
a plurality of sensors operable to sense operating parameters of the vehicle; a plurality of speakers positioned within an interior of the vehicle; a controller operably coupled to the plurality of sensors and the plurality of speakers, the controller programmed to:
receive sensor data from the plurality of sensors: generate software objects corresponding to the sensor data; modify the software objects in real time based on updated data from the plurality of sensors; and
generate three dimensional (3D) auditory signals using a plurality of speakers according to the software objects to convey vehicle information to a driver;
wherein the controller is further programmed to generate the software objects corresponding to the sensor data comprises:
detecting in the sensor data presence of cross-traffic behind the vehicle in the sensor data; and
creating a feature software object for the cross-traffic;
wherein generating the 3D auditory signals using a plurality of speakers according to the software objects to convey vehicle information to a driver comprises generating a series of audible signals simulating movement of a sound source behind a driver of the vehicle in a direction of the cross traffic.

11. The vehicle of claim 10 , wherein the controller is further programmed to generate software objects corresponding to the sensor data by:
detecting in the sensor data presence of an exterior feature and a feature location for the feature; and
creating a feature software object for the exterior feature and having the feature location associated therewith.

12. The vehicle of claim 11 , wherein the controller is further programmed to modify the software objects in real time based on the updated data from the plurality of sensors by:
detecting movement of the exterior feature relative to the vehicle in the updated data to an updated location; and
modifying the feature location according to the updated location in the feature software object.

13. The vehicle of claim 12 , wherein the controller is further programmed to generate the 3D auditory signals using the plurality of speakers according to the software objects by:
generating a feature audio signal having a simulated location in outputs of the plurality of speakers corresponding to the feature location of the feature software object.

14. The vehicle of claim 13 , wherein the plurality of sensors comprises at least one of an ultrasonic sensor, a radio detection and ranging (RADAR) sensor, a light detection and ranging (LIDAR) sensor, a camera, and a sound navigation and ranging (SONAR) sensor.

15. The vehicle of claim 13 , wherein the controller is further programmed to generate the 3D auditory signals using the plurality of speakers according to the software objects by:
generating a series of audible sounds having a separation between audible sounds that decreases with decrease in a distance between the feature location and the vehicle.

16. The vehicle of claim 13 , wherein the controller is further programmed to generate the 3D auditory signals using the plurality of speakers according to the software objects by:
generating a series of audible sounds, the intensity of the audible sounds increasing with decrease in a distance between the feature location and the vehicle.

17. The vehicle of claim 10 , wherein the controller is further programmed to:
receive sensor data from the plurality of sensors by receiving an output of a door sens

Assignees

• Ford Global Tech Llc

Inventors

• Groh Alexander
• Norton Alan
• Feldman Casey Bryan
• Kadepurkar Prabhanjan

Classifications

• H04R2499/13

  Acoustic transducers and sound field adaptation in vehicles · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• B60Q9/008 Primary

  for anti-collision purposes · CPC title

• H04S7/302 Primary

  Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence) · CPC title

• B60R11/0217

  for loud-speakers · CPC title