Systems and methods for landing a drone on a moving base

Patent metadata

Field	Value
Publication number	US-10152059-B2
Application number	US-201615289882-A
Country	US
Kind code	B2
Filing date	Oct 10, 2016
Priority date	Oct 10, 2016
Publication date	Dec 11, 2018
Grant date	Dec 11, 2018

Abstract

A drone is described. The drone includes a depth sensor configured to provide information for determining a distance between the drone and a moving base. The drone also includes a processor configured to control a computer vision tracking algorithm based on the distance, and to control drone movement based on the computer vision tracking algorithm. A vehicle is also described. The vehicle includes a depth sensor configured to provide information for determining a distance between a drone and the vehicle. The vehicle also includes a processor configured to control a computer vision tracking algorithm based on the distance and to send information for controlling drone movement based on the computer vision tracking algorithm.

First claim

What is claimed is:

1. A drone, comprising:
a depth sensor configured to provide information for determining a distance between the drone and a moving base; and
a processor configured to control a computer vision tracking algorithm by increasing tracking when the distance is within a distance threshold and to control drone movement based on the computer vision tracking algorithm.

2. The drone of claim 1 , wherein the processor is configured to control jitter of the computer vision tracking algorithm.

3. The drone of claim 2 , wherein the processor is configured to control the jitter by converting an increased number of red-green-blue (RGB) frames to hue-saturation-value (HSV) frames.

4. The drone of claim 2 , wherein the processor is configured to control the jitter by:
computing a saliency score based on a model and at least a portion of a frame;
determining whether the frame is a valid frame for tracking based on the saliency score; and
providing the frame to the computer vision tracking algorithm in a case that the frame is a valid frame.

5. The drone of claim 1 , wherein the processor is configured to perform frame smoothing on a set of frames provided to the computer vision tracking algorithm.

6. The drone of claim 1 , wherein the processor is configured to control drone movement by controlling drone acceleration, using one or more movement mechanisms, based on the computer vision tracking algorithm.

7. The drone of claim 1 , wherein the processor is configured to perform obstacle detection using at least one of computer vision or depth sensing, and wherein the processor is configured to control drone movement by changing drone trajectory to avoid an obstacle using one or more movement mechanisms.

8. The drone of claim 1 , wherein the processor is configured to determine whether one or more slots on the moving base are occupied.

9. The drone of claim 1 , wherein the processor is configured to provide information for controlling an adjustable landing pad on the moving base.

10. A method performed by a drone, comprising:
determining a distance between the drone and a moving base;
controlling a computer vision tracking algorithm, comprising increasing tracking when the distance is within a distance threshold; and
controlling drone movement based on the computer vision tracking algorithm.

11. The method of claim 10 , further comprising controlling jitter of the computer vision tracking algorithm.

12. The method of claim 10 , further comprising determining whether one or more slots on the moving base are occupied.

13. The method of claim 10 , further comprising providing information for controlling an adjustable landing pad on the moving base.

14. A vehicle, comprising:
a depth sensor configured to provide information for determining a distance between a drone and the vehicle; and
a processor configured to control a computer vision tracking algorithm by increasing tracking when the distance is within a distance threshold and to send information for controlling drone movement based on the computer vision tracking algorithm.

15. The vehicle of claim 14 , wherein the processor is configured to control jitter of the computer vision tracking algorithm.

16. The vehicle of claim 15 , wherein the processor is configured to control the jitter by converting an increased number of red-green-blue (RGB) frames to hue-saturation-value (HSV) frames.

17. The vehicle of claim 15 , wherein the processor is configured to control the jitter by:
computing a saliency score based on a model and at least a portion of a frame;
determining whether the frame is a valid frame for tracking based on the saliency score; and
providing the frame to the computer vision tracking algorithm in a case that the frame is a valid frame.

18. The vehicle of claim 14 , wherein the information includes drone position information and drone movement information determined by the vehicle based on the computer vision tracking algorithm.

19. The vehicle of claim 14 , wherein the processor is configured to control drone movement by controlling drone acceleration, using one or more movement mechanisms, based on the computer vision tracking algorithm.

20. The vehicle of claim 14 , wherein the processor is configured to perform obstacle detection using at least one of computer vision or depth sensing, and wherein the processor is configured to control drone movement by changing drone trajectory to avoid an obstacle using one or more movement mechanisms.

21. The vehicle of claim 14 , wherein the processor is configured to determine whether one or more slots on the vehicle are occupied.

22. The vehicle of claim 14 , wherein the processor is configured to control an adjustable landing pad on the vehicle using an adjustable mechanism based on the computer vision tracking algorithm.

23. A method performed by a vehicle, comprising:
determining a distance between a drone and the vehicle;
controlling a computer vision tracking algorithm, comprising increasing tracking when the distance is within a distance threshold; and
controlling drone movement based on the computer vision tracking algorithm.

24. The method of claim 23 , wherein controlling the drone movement is based on drone position information and drone movement information determined by the vehicle based on the computer vision tracking algorithm.

25. The method of claim 23 , further comprising determining whether one or more slots on the vehicle are occupied.

26. The method of claim 23 , further comprising controlling an adjustable landing pad on the vehicle based on the computer vision tracking algorithm.

Assignees

• Qualcomm Inc

Inventors

• Banerjee Debdeep
• Kandhadai Ananthapadmanabhan Arasanipalai

Classifications

• B64U2201/10

  autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS] · CPC title

• H04N23/68

  for stable pick-up of the scene, e.g. compensating for camera body vibrations · CPC title

• B64U80/86

  Land vehicles · CPC title

• G05D1/0684 Primary

  on a moving platform, e.g. aircraft carrier · CPC title

• G05D1/0094 Primary

  involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target · CPC title