Systems and methods for adjusting flight control of an unmanned aerial vehicle

Patent metadata

Field	Value
Publication number	US-11454964-B2
Application number	US-202016827241-A
Country	US
Kind code	B2
Filing date	Mar 23, 2020
Priority date	Jan 6, 2016
Publication date	Sep 27, 2022
Grant date	Sep 27, 2022

Abstract

A first pattern associated with a performer may be recognized based upon visual information. A sensor carried by an unmanned aerial vehicle may be configured to generate output signals conveying the visual information. A first distance may be determined between the first pattern and the unmanned aerial vehicle. A second pattern associated with a performee may be recognized based upon the visual information. A second distance may be determined between the second pattern and the unmanned aerial vehicle. Flight control may be adjusted based upon the first distance and the second distance. A flight control subsystem may be configured to provide the flight control for the unmanned aerial vehicle.

First claim

What is claimed is:

1. A system for adjusting flight control of an unmanned aerial vehicle, the system comprising:
an image sensor carried by the unmanned aerial vehicle, the image sensor configured to generate output signals conveying visual information;
one or more physical processors configured by computer-readable instructions to:
provide the flight control for the unmanned aerial vehicle such that, responsive to a first object approaching a second object, the unmanned aerial vehicle is positioned for the image sensor to capture the visual information including the first and second objects;
capture the visual information including the first and second objects; and
mark the visual information at a point in time in which the first and second objects are separated by a predefined distance; and

a gesture recognition component configured to recognize or interpret gestures from the first object in real time so that a flight control subsystem or sensor control system of the unmanned aerial vehicle can implement a change based upon the gestures from the first object.

2. The system of claim 1 , wherein the one or more physical processors are configured to:
determine a first position of the first object based on the visual information; and
determine a second position of the second object based on the visual information.

3. The system of claim 2 , wherein the flight control is provided such that any of the target altitude differential, a target cardinal direction, and the target distance is maintained between the unmanned aerial vehicle and the second object based on the first position and the second position.

4. The system of claim 1 , wherein providing the flight control includes controlling any of an altitude, a longitude, a latitude, a geographical location, a heading, and a speed of the unmanned aerial vehicle.

5. The system of claim 1 , wherein the visual information is a video frame of a video segment.

6. The system of claim 5 , wherein the one or more physical processors are configured to:
mark the video segment at a point in time in which the first and second objects overlap.

7. The system of claim 1 , wherein the flight control is provided such that any of the target altitude differential, a target cardinal direction, and the target distance is adjusted between the unmanned aerial vehicle and the second object based on the gestures associated with the first object.

8. The system of claim 1 , wherein the flight control is provided such that the unmanned aerial vehicle being positioned for the image sensor to capture the visual information includes repositioning the unmanned aerial vehicle from an original position to a new position.

9. The system of claim 1 , wherein the flight control is provided such that any of the target altitude differential, a target cardinal direction, and the target distance is adjusted between the unmanned aerial vehicle and the first object based on the gestures associated with the first object.

10. A method for adjusting flight control of an unmanned aerial vehicle, the method performed by a computing system including one or more physical processors, the method comprising:
determining a first position of a first object based on visual information;
determining a second position of a second object based on the visual information;
providing the flight control for the unmanned aerial vehicle such that, responsive to the first object approaching the second object, the unmanned aerial vehicle is positioned to capture the visual information including the first and second objects;
capturing the visual information including the first and second objects;
marking the visual information at a point in time in which the first and second objects are separated by a predefined distance; and
implementing a change in real time based upon gestures of the first object.

11. The method of claim 10 , wherein the flight control is provided such that any of the target altitude differential, a target cardinal direction, and the target distance is maintained between the unmanned aerial vehicle and the second object based on the first position and the second position.

12. The method of claim 10 , wherein providing the flight control includes controlling any of an altitude, a longitude, a latitude, a geographical location, a heading, and a speed of the unmanned aerial vehicle.

13. The method of claim 10 , wherein the visual information is a video frame of a video segment; further comprising:
marking the video segment at a point in time in which the first and second objects overlap.

14. The method of claim 10 , wherein the flight control is provided such that any of the target altitude differential, a target cardinal direction, and the target distance is adjusted between the unmanned aerial vehicle and the second object based on the gestures associated with the first object.

15. The method of claim 10 , wherein the flight control is provided such that any of the target altitude differential, a target cardinal direction, and the target distance is adjusted between the unmanned aerial vehicle and the first object based on the gestures associated with the first object.

16. The method of claim 10 , wherein the flight control is provided such that the unmanned aerial vehicle being positioned to capture the visual information includes repositioning the unmanned aerial vehicle from an original position to a new position.

17. A method comprising:
providing flight control for an unmanned aerial vehicle such that, responsive to a first object approaching a second object, the unmanned aerial vehicle is positioned to capture content including the first and second objects;
capturing the content including the first and second objects;
marking the content at a point in time in which the first and second objects are separated by a predefined distance;
recognizing or interpreting gestures from the first object in real time; and
controlling any of an altitude, a longitude, a latitude, a geographical location, a heading, a speed of the unmanned aerial vehicle, a zoom of an image capture device, a target cardinal direction, and a target distance between the unmanned aerial vehicle and the first object.

18. The method of claim 17 , further comprising adjusting a target altitude differential based upon an interpretation of the gestures from the first object.

19. The method of claim 17 , further comprising tracking a particular object or person instead of the first object based on interpreting the gestures from the first object.

20. The method of claim 17 , wherein a gesture recognition component recognizes and interprets the gestures from the first object in real time.

Assignees

• Gopro Inc

Inventors

• Lema Pablo
• Ip Shu Ching

Classifications

• B64U2201/20

  Remote controls · CPC title

• B64U2201/10

  autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS] · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• G05D1/689

  Pointing payloads towards fixed or moving targets (positioning towed, pushed or suspended implements G05D1/672) · CPC title

• G06V20/41 Primary

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title