Detecting and responding to sirens

Patent metadata

Field	Value
Publication number	US-10319228-B2
Application number	US-201715689336-A
Country	US
Kind code	B2
Filing date	Aug 29, 2017
Priority date	Jun 27, 2017
Publication date	Jun 11, 2019
Grant date	Jun 11, 2019

Abstract

The technology relates to detecting and responding to emergency vehicles. This may include using a plurality of microphones to detect a siren noise corresponding to an emergency vehicle and to estimate a bearing of the emergency vehicle. This estimated bearing is compared to map information to identify a portion of roadway on which the emergency vehicle is traveling. In addition, information identifying a set of objects in the vehicle's environment as well as characteristics of those objects is received from a perception system is used to determine whether one of the set of objects corresponds to the emergency vehicle. How to respond to the emergency vehicle is determined based on the estimated bearing and identified road segments and the determination of whether one of the set of objects corresponds to the emergency vehicle. This determined response is then used to control the vehicle in an autonomous driving mode.

First claim

The invention claimed is:

1. A method of detecting and responding to emergency vehicles, the method comprising:
using, by one or more processors, a plurality of microphones arranged at different locations on a vehicle to detect a siren noise corresponding to an emergency vehicle;
using, by the one or more processors, output from the plurality of microphones to estimate a bearing, a range and a relative velocity of a source of the detected siren noise;
comparing, by the one or more processors, the estimated bearing to map information to identify a portion of a roadway on which the emergency vehicle is traveling;
determining, by the one or more processors, whether one vehicle of a plurality of vehicles within range of one or more sensors of a perception system of the vehicle corresponds to the emergency vehicle by determining information including at least one of a heading, location or relative velocity of each of the plurality of vehicles and, estimating a likelihood of each of the plurality of vehicles being the source of the detected siren noise by comparing the determined information of each of the plurality of vehicles to the estimated bearing, range and relative velocity of the source of the detected siren noise;
determining, by the one or more processors, how to respond to the emergency vehicle based on the estimated bearing and the identified portion of the roadway and the estimated likelihoods of each of the plurality of vehicles being the source of the siren noise; and
controlling, by the one or more processors, the vehicle in an autonomous driving mode based on the determination of how to respond to the emergency vehicle.

2. The method of claim 1 , further comprising using output from the plurality of microphones over time to estimate the range of the source of the detected siren noise.

3. The method of claim 1 , further comprising using output from the plurality of microphones over time to estimate the relative velocity of the source of the detected siren noise.

4. The method of claim 1 , wherein controlling the vehicle includes changing from a first lane to a second lane.

5. The method of claim 1 , wherein controlling the vehicle includes pulling the vehicle over onto a shoulder area.

6. The method of claim 1 , wherein controlling the vehicle includes continuing on a current trajectory of the vehicle.

7. The method of claim 1 , wherein controlling the vehicle further includes decreasing a speed of the vehicle.

8. A method of detecting and responding to emergency vehicles, the method comprising:
using, by one or more processors, a plurality of microphones arranged at different locations on a vehicle to detect a siren noise corresponding to an emergency vehicle;
using, by the one or more processors, output from the plurality of microphones to estimate a bearing, a range and a relative velocity of a source of the detected siren noise;
comparing, by the one or more processors, the estimated bearing to map information to identify a portion of a roadway on which the emergency vehicle is traveling;
receiving, from a perception system of the vehicle having one or more sensors, information identifying a set of objects in the vehicle's environment as well as characteristics of the set of objects, the set of objects including a plurality of vehicles, the characteristics for each of the plurality of vehicles including at least one of a heading, location or relative velocity;
determining based on the received information, by the one or more processors, whether one of the plurality of vehicles corresponds to the emergency vehicle based on the characteristics of the set of objects, including estimating a likelihood of each of the plurality of vehicles being the source of the detected siren noise by comparing the characteristics of each of the plurality of vehicles to the estimated bearing, range and relative velocity of the source of the detected siren noise;
determining, by the one or more processors, how to respond to the emergency vehicle based on the estimated bearing, the identified portion, and the determination of whether the one of plurality of vehicles corresponds to the emergency vehicle according to the estimated likelihoods of each of the plurality of vehicles being the source of the siren noise; and
controlling, by the one or more processors, the vehicle in an autonomous driving mode based on the determination of how to respond to the emergency vehicle.

9. The method of claim 8 , further comprising using output from the plurality of microphones over time to estimate the range of the source of the detected siren noise.

10. The method of claim 8 , further comprising using output from the plurality of microphones over time to estimate the relative velocity of the source of the detected siren noise.

11. The method of claim 8 , further comprising comparing, by the one or more processors, the estimated bearing to map information to identify a portion of roadway on which the emergency vehicle is traveling, and wherein determining how to respond to the emergency vehicle is further based on the estimated bearing and the portion of roadway.

12. The method of claim 8 , further comprising identifying a first likelihood that each given vehicle of the plurality of vehicles is the emergency vehicle based on the characteristics of that given vehicle, and wherein determining whether one of the plurality of vehicles corresponds to the emergency vehicle is further based on any first likelihoods.

13. The method of claim 8 , further comprising identifying a second likelihood that each given vehicle of the plurality of vehicles is not the emergency vehicle based on the characteristics of that given vehicle, and wherein determining whether one of the plurality of vehicles corresponds to the emergency vehicle is further based on any second likelihoods.

14. The method of claim 8 , wherein controlling the vehicle includes stopping at an intersection when the vehicle would otherwise have right of way to proceed through the intersection.

15. A system for detecting and responding to emergency vehicles, the system comprising one or more processors configured to:
use a plurality of microphones arranged at different locations on a vehicle to detect a siren noise corresponding to an emergency vehicle;
use output from the plurality of microphones over time to estimate a bearing, a range and a relative velocity of a source of the detected siren noise;
compare the estimated bearing to map information to identify a portion of roadway on which the emergency vehicle is traveling;
receive, from a perception system of the vehicle having one or more sensors, information identifying a set of objects in the vehicle's environment as well as characteristics of the set of objects, the set of objects including a plurality of vehicles, the characteristics for each of the plurality of vehicles including at least one of a heading, location or relative velocity;
determine based on the received information whether one of the plurality of vehicles corresponds to the emergency vehicle based on the characteristics of the set of objects, including estimation of a likelihood of each of the plurality of vehicles being a source of the detected siren noise by comparison of the characteristics of each of the plurality of vehicles to the estimated bearing, range and relative velocity of the source of the detected siren noise;
determine how to respond to the emergency vehicle based on the estimated bearing, the portion of roadway, and the determination of whether one of the plurality of vehicles corresponds to the emergency vehicle according to the estimated likel

Assignees

• Waymo Llc

Inventors

• Silver David Harrison
• Leigh Angus
• Ingram Benjamin
• Taylor Jennifer
• Nangia Vaibhav

Classifications

• G08G1/09623

  Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle (G08G1/0967 takes precedence) · CPC title

• G08G1/09626

  where the origin of the information is within the own vehicle, e.g. a local storage device, digital map · CPC title

• H04R2499/13

  Acoustic transducers and sound field adaptation in vehicles · CPC title

• G08G1/0965 Primary

  responding to signals from another vehicle, e.g. emergency vehicle · CPC title

• G06F16/683

  using metadata automatically derived from the content · CPC title