Tether-based wind estimation

Patent metadata

Field	Value
Publication number	US-12164308-B2
Application number	US-202217812758-A
Country	US
Kind code	B2
Filing date	Jul 15, 2022
Priority date	Jul 15, 2022
Publication date	Dec 10, 2024
Grant date	Dec 10, 2024

Abstract

A method includes causing an aerial vehicle to deploy a tethered component to a particular distance beneath the aerial vehicle by releasing a tether connecting the tethered component to the aerial vehicle. The method also includes obtaining, from a camera connected to the aerial vehicle, image data that represents the tethered component while the tethered component is deployed to the particular distance beneath the aerial vehicle. The method additionally includes determining, based on the image data, a position of the tethered component within the image data. The method further includes determining, based on the position of the tethered component within the image data, a wind vector that represents a wind condition present in an environment of the aerial vehicle. The method yet further includes causing the aerial vehicle to perform an operation based on the wind vector.

First claim

What is claimed is:

1. A computer-implemented method comprising:
causing an aerial vehicle to deploy a tethered component to a particular distance beneath the aerial vehicle by releasing a tether connecting the tethered component to the aerial vehicle;
obtaining, from a camera connected to the aerial vehicle, image data that represents the tethered component while the tethered component is deployed to the particular distance beneath the aerial vehicle;
determining, based on the image data, a position of the tethered component within the image data;
determining, based on the position of the tethered component within the image data, a wind vector that represents a wind velocity present in an environment of the aerial vehicle, wherein determining the wind vector comprises selecting the wind velocity from a predetermined mapping for the tethered component based on the wind velocity corresponding to the particular distance and the position of the tethered component within the image data, wherein the predetermined mapping comprises, for each respective distance of one or more distances to which the tethered component is deployable beneath the aerial vehicle, a mapping between (i) a plurality of possible positions of the tethered component within the image data and (ii) a plurality of possible wind velocities; and
causing the aerial vehicle to perform an operation based on the wind vector.

2. The computer-implemented method of claim 1 , wherein causing the aerial vehicle to perform an operation based on the wind vector comprises:
adjusting at least one of a position or an orientation of the aerial vehicle in the environment based on the wind vector.

3. The computer-implemented method of claim 1 , wherein determining the wind vector comprises:
determining a pixel distance between (i) the position of the tethered component within the image data and (ii) a reference position within the image data, wherein the reference position is expected to represent the tethered component in the absence of wind.

4. The computer-implemented method of claim 3 , wherein determining the wind vector further comprises:
determining a weight of the tethered component based on a mass of the tethered component;
determining, based on the pixel distance, a field of view of the camera, and a resolution of the camera, a wind-induced angle formed between (i) the tethered component and (ii) a vertical line coincident with the reference position; and
determining the wind velocity based on: (i) the weight of the tethered component, (ii) the wind-induced angle, (iii) a density of air in the environment, (iv) a drag coefficient of the tethered component, and (v) an area of a surface of the tethered component facing the wind vector.

5. The computer-implemented method of claim 4 , wherein determining the wind-induced angle comprises:
determining the wind-induced angle further based on the particular distance to which the tethered component is deployed beneath the aerial vehicle.

6. The computer-implemented method of claim 1 , wherein the tethered component comprises a payload coupling apparatus configured to couple a payload to the tether.

7. The computer-implemented method of claim 1 , wherein the tethered component comprises reflective paint configured to reflect light from the tethered component towards the camera to increase a visibility of the tethered component within the image data.

8. The computer-implemented method of claim 1 , wherein the tethered component comprises a light emitter configured to emit light toward the camera, and wherein the camera is configured to capture the image data while the light emitter emits the light towards the camera.

9. The computer-implemented method of claim 1 , wherein the aerial vehicle further comprises a light emitter configured to emit light toward the tethered component, and wherein the camera is configured to capture the image data while the light emitter emits the light towards the tethered component.

10. The computer-implemented method of claim 1 , wherein the tethered component comprises one or more of (i) a fiducial marker disposed thereon or (ii) a particular shape, and wherein determining the position of the tethered component within the image data comprises:
detecting, within the image data, one or more of (i) the fiducial marker or (ii) the particular shape.

11. The computer-implemented method of claim 1 , wherein the particular distance beneath the aerial vehicle to which the tethered component is deployed is selected based a size of the tethered component such that the tethered component is detectable within the image data.

12. The computer-implemented method of claim 1 , wherein the particular distance beneath the aerial vehicle to which the tethered component is deployed is selected based a field of view of the camera such that, when displaced by the wind vector, the tethered component is expected to be positioned within the field of view of the camera.

13. The computer-implemented method of claim 1 , wherein the particular distance beneath the aerial vehicle to which the tethered component is deployed is selected based on one or more of: (i) an extent of downwash generated a propeller of the aerial vehicle, (ii) damping of the tethered component at the particular distance, or (iii) a likelihood of the tethered component, when deployed at the particular distance, striking the propeller of the aerial vehicle during movements of the aerial vehicle.

14. The computer-implemented method of claim 1 , wherein the image data comprises a plurality of images captured at a plurality of different times, and wherein determining the position of the tethered component within the image data comprises:
determining, for each respective image of the plurality of images, a corresponding location of a centroid of the tethered component within the respective image; and
determining, based on the corresponding location of the centroid of the tethered component within each respective image of the plurality of images, an average location of the centroid across the plurality of different times.

15. The computer-implemented method of claim 1 , further comprising:
causing the aerial vehicle to attempt to hover in a fixed location while obtaining the image data.

16. The computer-implemented method of claim 1 , wherein:
the image data comprises a plurality of images captured at a plurality of different times;
determining the position of the tethered component within the image data comprises determining, for each respective image of the plurality of images, a corresponding position of the tethered component within the respective image; and
determining the wind vector comprises:
determining a position change in the corresponding position of the tethered component across two or more images of the plurality of images; and
determining, based on the position change, at least one of (i) a wind speed change or (ii) a confidence value associated with the wind vector.

17. A system, comprising:
a processor; and
a non-transitory computer-readable medium having stored thereon instructions that, when executed by the processor, cause the processor to perform operations comprising:
causing an aerial vehicle to deploy a tethered component to a particular distance beneath the aerial vehicle by releasing a tether connecting the tethered component to the aerial vehicle;
obtaining, from a camera connected to the aerial vehicle, image data that represents the tethered component while the tethered component is deployed to the particular distance beneath the aerial vehicle;
determining, b

Assignees

• Wing Aviation Llc

Inventors

• Qiu Ivan

Classifications

• G05D1/621

  responding to weather conditions, e.g. storms or wind shear · CPC title

• G05D1/606

  Compensating for or utilising external environmental conditions, e.g. wind or water currents (station keeping G05D1/611) · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• G06F18/24137

  Distances to cluster centroïds · CPC title

• B64D47/02 Primary

  Arrangements or adaptations of signal or lighting devices · CPC title