Dynamic sensor operation and data processing based on motion information

Patent metadata

Field	Value
Publication number	US-12374124-B2
Application number	US-202117345182-A
Country	US
Kind code	B2
Filing date	Jun 11, 2021
Priority date	May 2, 2017
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

Methods and apparatuses are disclosed for determining a characteristic of a device's object detection sensor oriented in a first direction. An example device may include one or more processors. The device may further include a memory coupled to the one or more processors, the memory including one or more instructions that when executed by the one or more processors cause the device to determine a direction of travel for the device, compare the direction of travel to the first direction to determine a magnitude of difference, and determine a characteristic of the object detection sensor based on the magnitude of difference.

First claim

What is claimed is:

1. An apparatus, comprising:
a first camera;
a memory storing instructions; and
one or more processors communicatively coupled to the memory and the first camera, wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
determine a future direction of travel of the apparatus;
determine a first frame rate for the first camera based on a comparison between the future direction of travel and a direction of a first field of capture of the first camera; and
adjust a frame rate of the first camera to the determined first frame rate.

2. The apparatus of claim 1 , wherein the apparatus comprises a headset, wherein the first camera is coupled to the headset.

3. The apparatus of claim 2 , wherein the headset is a virtual reality headset.

4. The apparatus of claim 1 , wherein adjusting the frame rate of the first camera causes a change in power consumption associated with the first camera.

5. The apparatus of claim 1 , wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
determine the direction of the first field of capture of the first camera.

6. The apparatus of claim 1 , wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
determine the direction of the first field of capture of the first camera; and
determine the first frame rate for the first camera is within a range of frame rates, wherein the first frame rate is determined to be (i) a maximum frame rate when the future direction of travel matches the direction of the first field of capture of the first camera, and (ii) a minimum frame rate when the future direction of travel is opposite the direction of the first field of capture of the first camera.

7. The apparatus of claim 1 , further comprising a second camera configured to image a second field of capture, wherein the one or more processors are configured to determine a second frame rate for the second camera based on a comparison between the future direction of travel and a direction of the second field of capture.

8. The apparatus of claim 7 , wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
increase a frame rate of the first camera to the first frame rate; and
decrease a frame rate of the second camera to the second frame rate.

9. The apparatus of claim 1 , further comprising an emitter for a laser sensor associated with the first camera.

10. The apparatus of claim 9 , wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
determine a difference between the future direction of travel and the direction of the first field of capture;
determine a characteristic of the emitter based on the difference, and adjust a power of the emitter based on the characteristic.

11. The apparatus of claim 9 , wherein the laser sensor is a LIDAR sensor.

12. The apparatus of claim 1 , further comprising a motion sensor, wherein determining the future direction of travel of the apparatus comprises determining a trajectory of the apparatus based on data received from the motion sensor.

13. The apparatus of claim 1 , further comprising a motion sensor, wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
determine a speed of the apparatus based on data received from the motion sensor; and
determine the first frame rate for the first camera based on the speed of the apparatus.

14. The apparatus of claim 1 , further comprising a motion sensor, wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to are configured to:
determine an acceleration of the apparatus based on data received from the motion sensor; and
determine a change from a current direction of travel to the future direction of travel based on the acceleration of the apparatus.

15. The apparatus of claim 1 , further comprising a motion sensor, wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to are configured to:
determine an acceleration of the apparatus based on data received from the motion sensor; and
determine the first frame rate for the first camera based on the acceleration.

16. The apparatus of claim 1 , wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
determine a difference between the future direction of travel and the direction of the first field of capture; and
determine the first frame rate based on the difference.

17. The apparatus of claim 1 , wherein the apparatus is a vehicle.

18. The apparatus of claim 17 , wherein the future direction of travel comprises a direction opposite of a current direction of travel of the vehicle.

19. The apparatus of claim 1 , wherein, when the instructions are executed by the one or more processors, the one or more processors perform operations to:
perform an object detection process based on image data received from the first camera; and
adjust a frame rate of the first camera to the first frame rate based on the object detection process.

20. A method of operating an apparatus, comprising:
determining a future direction of travel of the apparatus;
determining a first frame rate for a first camera of the apparatus based on a comparison between the future direction of travel and a direction of a first field of capture of the first camera; and
adjusting a frame rate of the first camera to the determined first frame rate.

21. The method of claim 20 , wherein adjusting the frame rate of the first camera causes a change in power consumption associated with the first camera.

22. The method of claim 20 , wherein determining the first frame rate for the first camera comprises:
determining the direction of the first field of capture of the first camera.

23. The method of claim 20 , wherein determining the first frame rate comprises:
determining the direction of the first field of capture of the first camera; and
determining the first frame rate for the first camera is within a range of frame rates, wherein the first frame rate is determined to be (i) a maximum frame rate when the future direction of travel matches the direction of the first field of capture of the first camera, and (ii) a minimum frame rate when the future direction of travel is opposite the direction of the first field of capture of the first camera.

24. The method of claim 20 , further comprising determining a second frame rate for a second camera configured to image a second field of capture based on a comparison between the future direction of travel and a direction of the second field of capture.

25. The method of claim 20 , wherein determining the first frame rate for the first camera comprises:
determining a difference between the future direction of travel and the direction of the first field of capture; and
determining the first frame rate based on the difference.

26. A non-transitory computer-readable storage medium storing one or more programs containing instructions that, when executed by one or more processors of an apparatus, cause the a

Assignees

• Qualcomm Inc

Inventors

• Sweet Iii Charles Wheeler
• Swart Hugo

Classifications

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title

• G01S13/933

  of aircraft or spacecraft · CPC title

• G01S7/52004

  Means for monitoring or calibrating (short-range imaging G01S7/5205) · CPC title

• G01S15/93

  for anti-collision purposes · CPC title

• G01S7/40

  Means for monitoring or calibrating · CPC title