Systems and methods for providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap

Patent metadata

Field	Value
Publication number	US-12007768-B2
Application number	US-202117412482-A
Country	US
Kind code	B2
Filing date	Aug 26, 2021
Priority date	Dec 21, 2015
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

This disclosure relates to providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap. The UAV may include a housing, a motor, a first image sensor, a second image sensor, a first optical element having a first field of view greater than 180 degrees, a second optical element having a second field of view greater than 180 degrees, and one or more processors. The first optical element and the second optical element may be carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view, and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap. Flight control for the UAV may be provided based on parallax disparity of an object within the overlapping fields of view.

First claim

What is claimed is:

1. An unmanned aerial vehicle, comprising:
a first optical element being oriented such that a first field of view is directed upwards when the unmanned aerial vehicle operates;
a second optical element being positioned at least partially below the first optical element such that a peripheral portion of the first field of view and a peripheral portion of a second field of view overlap, the second optical element being oriented such that the second field of view is directed downwards when the unmanned aerial vehicle operates, wherein an angle of the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view is asymmetrical about a vertical axis of the unmanned aerial vehicle so that the overlap in a front of the unmanned aerial vehicle and the overlap in a rear of the unmanned aerial vehicle are different; and
a processor configured to determine a disparity of an object captured within the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view so that the processor controls flight of the unmanned aerial vehicle based on the disparity to follow the object while maintaining a distance between the unmanned aerial vehicle and the object.

2. The unmanned aerial vehicle of claim 1 , wherein the first optical element is configured to guide light to a first image sensor and the second optical element is configured to guide light to a second image sensor.

3. The unmanned aerial vehicle of claim 1 , further comprising:
a housing; and
a motor carried by the housing, the motor configured to drive a rotor.

4. The unmanned aerial vehicle of claim 3 , wherein the first optical element is carried by the housing such that a centerline of the first field of view is substantially parallel to the vertical axis of the unmanned aerial vehicle.

5. The unmanned aerial vehicle of claim 3 , wherein the first optical element is carried by the housing such that a centerline of the first field of view is coincident with the vertical axis of the unmanned aerial vehicle.

6. The unmanned aerial vehicle of claim 3 , wherein the first optical element is carried by the housing such that a centerline of the first field of view is not coincident with the vertical axis of the unmanned aerial vehicle.

7. The unmanned aerial vehicle of claim 3 , wherein the first optical element is carried by the housing such that a centerline of the first field of view is offset from the vertical axis of the unmanned aerial vehicle.

8. The unmanned aerial vehicle of claim 7 , wherein the offset is ten degrees or less.

9. The unmanned aerial vehicle of claim 3 , wherein the first optical element is carried by the housing such that an offset of a centerline of the first field of view from the vertical axis of the unmanned aerial vehicle changes based on a tilt of the unmanned aerial vehicle.

10. The unmanned aerial vehicle of claim 3 , wherein the first optical element and the second optical element are carried by the housing such that a centerline of the first field of view is not coincident with a centerline of the second field of view.

11. The unmanned aerial vehicle of claim 1 , wherein the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap circumscribe the unmanned aerial vehicle around the vertical axis of the unmanned aerial vehicle.

12. A system, comprising:
a housing;
a rotor;
a motor configured to drive the rotor;
a first image sensor;
a second image sensor;
a first optical element configured to guide light within a first field of view to the first image sensor, the first optical element being oriented such that the first field of view is directed upwards when the system operates;
a second optical element configured to guide light within a second field of view to the second image sensor, the second optical element being carried by the housing at least partially below the first optical element such that a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap, the second optical element being oriented such that the second field of view is directed downwards when the system operates; and
a processor configured to determine a disparity of an object captured within the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view so that the processor controls the system based on the disparity,
wherein the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view is asymmetrical relative to a vertical axis of the system so that the overlap in a front of the system and the overlap in a rear of the system are different, and
wherein the processor controls flight of the system based on the disparity to maintain the system at a distance relative to the object while tracking the object.

13. The system of claim 12 , wherein the overlap includes 360 degrees of lateral directions around the system.

14. The system of claim 12 , wherein the first optical element is carried by the housing such that one of a centerline of the first field of view is substantially parallel to the vertical axis of the system, the centerline of the first field of view is coincident with the vertical axis of the system, the centerline of the first field of view is not coincident with the vertical axis of the system, or the centerline of the first field of view is offset from the vertical axis of the system by ten degrees or less.

15. The system of claim 12 , wherein the first optical element is carried by the housing such that an offset of a centerline of the first field of view from the vertical axis of the system changes based on a tilt of the system.

16. The system of claim 12 , wherein the first optical element and the second optical element are carried by the housing such that a centerline of the first field of view is not coincident with a centerline of the second field of view.

17. The system of claim 12 , wherein the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap circumscribe the system around the vertical axis of the system.

18. A non-transitory computer readable storage medium having instructions executed thereon that, when executed by a processor, causes the processor to:
receive a first output signal, generated by a first image sensor, and convey first visual information within a first field of view of a first optical element, wherein the first optical element is carried by an unmanned aerial vehicle and is vertically oriented such that the first field of view is directed upwards;
receive a second output signal, generated by a second image sensor, and convey second visual information within a second field of view of a second optical element, wherein the second optical element is carried by the unmanned aerial vehicle at least partially below the first optical element such that a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap thereby circumscribing the unmanned aerial vehicle, and wherein the second optical element is vertically oriented such that the second field of view is directed downwards, wherein an angle of the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view is asymmetrical about a vertical axis of the unmanned aerial vehicle so that the overlap in a front of the unmanned

Assignees

• Gopro Inc

Inventors

• Lema Pablo
• Fong Gary
• Ip Shu Ching

Classifications

• G05D1/46

  Control of position or course in three dimensions [3D] · CPC title

• G05D1/227

  Handing over between remote control and on-board control; Handing over between remote control arrangements · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• B64C13/18

  using automatic pilot · CPC title

• G05D1/102 Primary

  specially adapted for vertical take-off of aircraft · CPC title