System and method of dynamically controlling parameters for processing sensor output data for collision avoidance and path planning

Patent metadata

Field	Value
Publication number	US-10126722-B2
Application number	US-201615224904-A
Country	US
Kind code	B2
Filing date	Aug 1, 2016
Priority date	Aug 1, 2016
Publication date	Nov 13, 2018
Grant date	Nov 13, 2018

Abstract

Various embodiments involve dynamically controlling parameters for processing sensor data, including rates at which vehicle sensors are sampled and analyzed, based on the vehicle's speed and direction. Data or sampling rates of sensors useful for collision avoidance and/or path planning may be adjusted to emphasize data from sensors having a field of view encompassing the travel direction, while limiting processing of data from sensors less likely to provide useful data for such purposes. In some embodiments, the rate at which data from a particular sensor is sampled and/or processed may depend on a vehicle's direction and speed of travel as well as the sensor's field of view. Processing demands may be reduced by focusing processing on data from sensors viewing the direction of travel while reducing processing of data from sensors viewing other directions. In some embodiments, sensor data sampling or processing rates may vary based on collision risk probabilities.

First claim

What is claimed is:

1. A method of dynamically controlling a plurality of sensors on a vehicle, comprising:
determining, by a processor of the vehicle, a speed and a direction of travel of the vehicle;
determining, by the processor, one or more of a view direction and a field of view of each of the plurality of sensors; and
controlling, by the processor, a sampling or frame rate of one or more of the plurality of sensors based on the speed and the direction of travel of the vehicle and the one or more of the view direction and the field of view of each sensor.

2. The method of claim 1 , further comprising controlling, by the processor, a rate at which output data received from one or more of the plurality of sensors is processed.

3. The method of claim 2 , wherein controlling the rate at which output data received from one or more of the plurality of sensors is processed comprises:
determining, by the processor, whether the speed of the vehicle exceeds a speed threshold;
determining, by the processor, for each of the plurality of sensors whether the view direction of the sensor is directed away from or the field of view of the sensor does not encompass the direction of travel of the vehicle in response to determining that the speed of the vehicle exceeds the speed threshold; and
throttling, by the processor, a data processing rate of output data received from one or more of the of the plurality of sensors in response to determining that the view direction of the one or more of the plurality of sensors is directed away from or the field of view of the one or more of the plurality of sensors does not encompass the direction of travel of the vehicle.

4. The method of claim 3 , further comprising:
maintaining or increasing, by the processor, the data processing rate of output data received from one or more of the plurality of sensors in response to determining that the view direction of the one or more of the plurality of sensors are aligned with or the field of view of the one or more of the plurality of sensors encompass the direction of travel of the vehicle.

5. The method of claim 3 , further comprising:
equalizing, by the processor, the data processing rate of output data received from the plurality of sensors in response to determining that the speed of the vehicle does not exceed the speed threshold.

6. The method of claim 1 , further comprising:
determining, by the processor, the speed and a next direction of travel of the vehicle in advance of a change in the direction of travel of the vehicle;
determining, by the processor, a next data processing rate for processing the output data received from each of the plurality of sensors based on the speed and the next direction of travel of the vehicle and the one or more of the view direction and the field of view of the sensor;
detecting, by the processor, whether the vehicle is moving in the next direction of travel; and
processing, by the processor, the output data received from each of the plurality of sensors at the next data processing rate for the sensor in response to detecting that the vehicle is moving in the next direction of travel.

7. The method of claim 1 , wherein the plurality of sensors comprise one or more of cameras, stereoscopic cameras, image sensors, radar sensors, sonar sensors, ultrasound sensors, depth sensors, activate sensors, passive sensors, or any combination thereof.

8. The method of claim 2 , further comprising:
determining, by the processor, one or more collision risk factors in the one or more of the view direction and the field of view of each sensor,
wherein controlling the rate at which output data received from one or more of the plurality of sensors is processed comprises controlling, by the processor, a data processing rate of output data received from each of the plurality of sensors based on the speed and the direction of travel of the vehicle and the one or more collision risk factors in the one or more of the view direction and the field of view of each sensor.

9. The method of claim 8 , wherein the one or more collision risk factors comprise one or more of at least one operational characteristic of the sensor, detection of an obstacle within the field of view, a speed of a detected obstacle within the field of view, one or more vehicle handling parameters, a processing characteristic of the processor, or any combination thereof.

10. The method of claim 1 , further comprising:
controlling, by the processor, a transmit power of each of the plurality of sensors based on the speed and the direction of travel of the vehicle and the one or more of the view direction and the field of view of the sensor.

11. The method of claim 1 , wherein the vehicle is an unmanned vehicle.

12. The method of claim 11 , wherein the unmanned vehicle is one of an aerial vehicle, a terrestrial vehicle, a space-based vehicle, or an aquatic vehicle.

13. A computing device for a vehicle, comprising:
a processor configured with processor-executable instructions to:
determine a speed and a direction of travel of the vehicle;
determine one or more of a view direction and a field of view of each of a plurality of sensors on the vehicle; and
control a sampling or frame rate of one or more of the plurality of sensors based on the speed and the direction of travel of the vehicle and the one or more of the view direction and the field of view of each sensor.

14. The computing device of claim 13 , wherein the processor is further configured with processor-executable instructions to control
a rate at which output data received from one or more of the plurality of sensors is processed.

15. The computing device of claim 14 , wherein the processor is further configured with processor-executable instructions to:
determine whether the speed of the vehicle exceeds a speed threshold;
determine for each sensor whether the view direction of the sensor is directed away from or the field of view of the sensor does not encompass the direction of travel of the vehicle in response to determining that the speed of the vehicle exceeds the speed threshold; and
throttle the data processing rate of the output data received from the one or more of the plurality of sensors in response to determining that the view direction of the one or more of the plurality of sensors is directed away from or the field of view of the one or more of the plurality of sensors does not encompass the direction of travel of the vehicle.

16. The computing device of claim 15 , wherein the processor is further configured with processor-executable instructions to:
maintain or increase the data processing rate of the output data received from one or more of the plurality of sensors in response to determining that the view direction of the one or more of the plurality of sensors are aligned with or the field of view of the one or more of the plurality of sensors encompass the direction of travel of the vehicle.

17. The computing device of claim 15 , wherein the processor is further configured with processor-executable instructions to:
equalize the data processing rate of the output data received from the plurality of sensors in response to determining that the speed of the vehicle does not exceed the speed threshold.

18. The computing device of claim 13 , wherein the processor is further configured with processor-executable instructions to:
determine the speed and a next direction of travel of the vehicle in advance of a change in the direction of travel of the vehicle;
determine a next data processing rate for proce

Assignees

• Qualcomm Inc

Inventors

• Sweet Iii Charles Wheeler
• Swart Hugo

Classifications

• H04N21/422

  Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)} · CPC title

• H04N21/41422

  located in transportation means, e.g. personal vehicle (arrangements specially adapted for transportation systems in broadcast systems H04H20/62) · CPC title

• H04N21/41407

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• H04N21/440281

  by altering the temporal resolution, e.g. by frame skipping (television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783) · CPC title