Systems and methods for taking, processing, retrieving, and displaying images from unmanned aerial vehicles

Patent metadata

Field	Value
Publication number	US-12079013-B2
Application number	US-202117495988-A
Country	US
Kind code	B2
Filing date	Oct 7, 2021
Priority date	Jan 8, 2016
Publication date	Sep 3, 2024
Grant date	Sep 3, 2024

Abstract

Systems and methods for taking, processing, retrieving, and/or displaying images from unmanned aerial vehicles are disclosed, including an unmanned aerial vehicle, comprising: an image capture device; and a controller configured to: determine a flight plan of the unmanned aerial vehicle, the flight plan configured such that the unmanned aerial vehicle and fields of view of the image capture device are restricted to a geographic area within boundaries of a geographic location identified by coordinates of the geographic location; execute the flight plan; and capture, with the image capture device, one or more aerial images restricted to fields of view within the boundaries of the geographic location while executing the flight plan, such that items outside of the boundaries are not captured in the one or more aerial images.

First claim

What is claimed is:

1. An unmanned aerial vehicle, comprising:
an image capture device; and
a controller programmed or hardwired to control fields of view of the image capture device during flight of the unmanned aerial vehicle such that items outside of boundaries surrounding a geographic area are not captured in any of one or more images captured by the image capture device during the flight, by:
determining a flight plan of the unmanned aerial vehicle, the flight plan configured such that the unmanned aerial vehicle and fields of view of the image capture device are restricted to the geographic area within the boundaries;
executing the flight plan;
orientating the image capture device by utilizing data about a geometric shape of the boundaries and data from attitude sensors to restrict the fields of view of the image capture device, thereby avoiding capturing images of areas outside of the boundaries while the unmanned aerial vehicle is flying the flight plan within the boundaries, and utilizing data about a structure within the geographic area within the boundaries, to ensure that the image capture device is oriented such that only the structure is in a frame of the one or more images taken by the image capture device when capturing the one or more images; and
capturing, with the image capture device, the one or more images while executing the flight plan, the one or more images restricted to fields of view within the boundaries of the geographic area, such that items outside of the boundaries are not captured in any of the one or more images, the one or more images comprising a first image and a second image each depicting areas less than a total of the geographic area within the boundaries.

2. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to automatically cause the unmanned aerial vehicle to execute the flight plan.

3. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to execute the flight plan in conjunction with an operator utilizing a human-machine interface module of a remote station, and where in the controller is configured to:
transmit one or more first non-transitory signal indicative of position of the unmanned aerial vehicle; and
receive, from the remote station, one or more second non-transitory signal indicative of instructions for navigation of the unmanned aerial vehicle to maintain the unmanned aerial vehicle and the fields of view of the image capture device within the boundaries.

4. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to:
utilize the boundaries of the geographic area to guide the unmanned aerial vehicle such that the fields of view of the image capture device of the unmanned aerial vehicle are within the boundaries.

5. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to:
receive the boundaries of the geographic area.

6. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to:
receive, from an operator, identification of two or more points on the boundaries; and
determine the boundaries based on the identified two or more points.

7. The unmanned aerial vehicle of claim 1 , wherein the unmanned aerial vehicle further comprises a navigation system, and wherein the controller is configured to:
utilize the navigation system and coordinates of the boundaries to determine the flight plan for the unmanned aerial vehicle that the unmanned aerial vehicle and fields of view of the image capture device are restricted to the geographic area within the boundaries.

8. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to:
receive geographical coordinates and/or altitude values that define the geometric shape on and/or above the earth of the geographical area that defines the boundaries.

9. The unmanned aerial vehicle of claim 8 , wherein the geometric shape is a three-dimensional polygon, and further comprising maintaining, by the controller, the unmanned aerial vehicle inside the three-dimensional polygon.

10. The unmanned aerial vehicle of claim 8 , wherein the geometric shape is defined by parcel data and/or building outlines.

11. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to:
compare position of the unmanned aerial vehicle, based on data from position sensors, with coordinates of the boundaries of the geographic area.

12. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to:
direct the unmanned aerial vehicle to adjust position and/or orientation to maintain a position of the unmanned aerial vehicle within the geographic area within the boundaries if a distance between the position of the unmanned aerial vehicle and the boundaries is less than or above a predetermined amount.

13. The unmanned aerial vehicle of claim 1 , wherein the controller is configured to:
direct the unmanned aerial vehicle to adjust position and/or orientation such that the field of view of the image capture device is solely within the geographic area within the boundaries.

14. A method for capturing images, comprising:
utilizing a controller programmed or hardwired to control fields of view of an image capture device of an unmanned aerial vehicle during flight of the unmanned aerial vehicle such that items outside of boundaries of a geographic area identified by coordinates of the geographic area are not captured in any of one or more images captured by the image capture device during the flight, by:
determining a flight plan of the unmanned aerial vehicle, the flight plan configured such that the unmanned aerial vehicle and fields of view of the image capture device are restricted to the geographic area within the boundaries;
executing the flight plan;
orientating the image capture device by utilizing data about a geometric shape of the boundaries and data from attitude sensors to restrict the fields of view of the image capture device, thereby avoiding capturing images of areas outside of the boundaries while the unmanned aerial vehicle is flying the flight plan within the boundaries, and utilizing data about a structure within the geographic area within the boundaries, to ensure that the image capture device is oriented such that only the structure is in a frame of the one or more images taken by the image capture device when capturing the one or more images; and
capturing, with the image capture device, the one or more images while executing the flight plan, the one or more images restricted to fields of view within the boundaries of the geographic area, such that items outside of the boundaries are not captured in any of the one or more images, the one or more images comprising a first image and a second image each depicting areas less than a total of the geographic area within the boundaries.

15. The method for capturing images of claim 14 , wherein executing the flight plan is carried out automatically by the controller of the unmanned aerial vehicle.

16. The method for capturing images of claim 14 , wherein executing the flight plan is at least partially carried out by an operator utilizing a human-machine interface module of a remote station, and further comprising:
receiving, by the remote station, one or more first non-transitory signal indicative of position of the unmanned aerial vehicle; and
transmitting, from the remote station to a communications system of the unmanned aerial vehicle, one or more second non-transitory signal indicative of instructions for navigation of the unmanned aerial vehicle to maintain the unmanned aerial

Assignees

• Pictometry Int Corp

Inventors

• Foster Mark A
• Gluffrida Frank
• Parchment Antony

Classifications

• G06F16/587

  using geographical or spatial information, e.g. location · CPC title

• G06T2207/10032

  Satellite or aerial image; Remote sensing · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• B64D47/08

  Arrangements of cameras · CPC title