Crop height estimation with unmanned aerial vehicles

Patent metadata

Field	Value
Publication number	US-9969492-B2
Application number	US-201615257441-A
Country	US
Kind code	B2
Filing date	Sep 6, 2016
Priority date	Sep 4, 2015
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

An unmanned aerial vehicle (UAV) can be configured for crop height estimation. In some examples, the UAV includes an aerial propulsion system, a laser scanner configured to face downwards while the UAV is in flight, and a control system. The laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maximum range. The control system causes the UAV to fly over an agricultural field and maintain, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed range of distances based on the maximum range of the laser scanner. The control system determines, using range data from the laser scanner, a crop height from the top of the crops to the ground.

First claim

What is claimed is:

1. An unmanned aerial vehicle (UAV) comprising:
an aerial propulsion system;
a laser scanner configured to face downwards while the UAV is in flight, wherein the laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maximum range;
a control system configured to perform operations comprising:
causing, using the aerial propulsion system, the UAV to fly over an agricultural field;
maintaining, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed range of distances based on the maximum range of the laser scanner; and
determining, using range data from the laser scanner, a crop height from the top of the crops to the ground; and

an inertial measurement unit (IMU), wherein determining the crop height comprises transforming the range data from a body frame of the UAV to a world frame using roll, pitch, and yaw data from the IMU to extract a plurality of z-components of the range data in the world frame.

2. The UAV of claim 1 , wherein determining the crop height comprises computing a percentile rank for each z-component and using the percentile ranks and the z-components to determine an estimate of the distance between the UAV and the top of the crops and an estimate of the crop height.

3. The UAV of claim 2 , wherein determining the estimate of the distance between the UAV and the top of the craps and the crop height comprises searching the percentile ranks to find the closest percentiles to existing estimates of the distance between the UAV and the top of the crops and the crop height.

4. An unmanned aerial vehicle (UAV) comprising:
an aerial propulsion system;
a laser scanner configured to face downwards while the UAV is in flight, wherein the laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maximum range; and
a control system configured to perform operations comprising:
causing, using the aerial propulsion system, the UAV to fly over an agricultural field;
maintaining, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed range of distances based on the maximum range of the laser scanner; and
determining, using range data from the laser scanner, a crop height from the top of the crops to the ground;

wherein the control system comprises a cone filter for decimating the range data and a median filter for removing one or more outliers in the range data.

5. The UAV of claim 1 , comprising a pressure sensor, wherein maintaining the distance between the UAV and the top of crops in the agricultural field to within the programmed range of distances comprises combining a height estimate based on the range data with a barometric pressure height estimate determined using the pressure sensor.

6. An unmanned aerial vehicle (UAV) comprising:
an aerial propulsion system;
a laser scanner configured to face downwards while the UAV is in flight, wherein the laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maximum range;
a control system configured to perform operations comprising:
causing, using the aerial propulsion system, the UAV to fly over an agricultural field;
maintaining, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed range of distances based on the maximum range of the laser scanner; and
determining, using range data from the laser scanner, a crop height from the top of the crops to the ground; and

a pressure sensor, wherein maintaining the distance between the UAV and the top of crops in the agricultural field to within the programmed range of distances comprises combining a height estimate based on the range data with a barometric pressure height estimate determined using the pressure sensor;
wherein maintaining the distance between the UAV and the top of crops in the agricultural field to within the programmed range of distances comprises applying a Kalman filter to a result of combining the height estimate based on the range data with the barometric pressure height estimate, and wherein maintaining the distance between the UAV and the top of crops in the agricultural field to within the programmed range of distances comprises executing a proportional-integral-derivative (PID) controller routine using a resulting height estimate of the Kalman filter.

7. The UAV of claim 1 , comprising a global positioning system (GPS) receiver, wherein the operations comprise georeferencing the crop height and/or the range data using the GPS receiver.

8. The UAV of claim 1 , wherein the operations comprise executing a row-following routine and causing the UAV to autonomously follow a row of crops using the range data from the laser scanner.

9. An unmanned aerial vehicle (UAV) comprising:
an aerial propulsion system;
a laser scanner configured to face downwards while the UAV is in flight, wherein the laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maximum range; and
a control system configured to perform operations comprising:
causing, using the aerial propulsion system, the UAV to fly over an agricultural field;
maintaining, using the aerial propulsion system and the laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed range of distances based on the maximum range of the laser scanner; and
determining, using range data from the laser scanner, a crop height from the top of the crops to the ground;

wherein the operations comprise executing a row-following routine and causing the UAV to autonomously follow a row of crops using the range data from the laser scanner;
wherein executing the row-following routine comprises determining a lateral distance to the row of crops using the range data from the laser scanner and using the lateral distance to determine a row center estimate to control the position of the UAV relative to the row of crops.

10. The UAV of claim 8 , wherein executing the row-following routine comprises using one or more periodic window filters to coarsely estimate one or more positions of crop stalks relative to the UAV.

11. The UAV of claim 8 , wherein executing the row-following routine comprises determining one or more positions of crop stalks using vertical and lateral spacing data of transformed range data to remove one or more spurious features from the transformed range data.

12. A method performed by a control system of an unmanned aerial vehicle (UAV), the method comprising:
causing, using an aerial propulsion system of the UAV, the UAV to fly over an agricultural field;
maintaining, using the aerial propulsion system and a laser scanner, a distance between the UAV and a top of crops in the agricultural field to within a programmed range of distances based on the maximum range of the laser scanner, wherein the laser scanner is configured to face downwards while the UAV is in flight, and wherein the laser scanner is configured to scan through a two-dimensional scan angle and is characterized by a maximum range; and
determining, using range data from the laser scanner, a crop height from the top of the crops to the ground;
wherein determining the crop height comprises transforming the range data from a body frame of the UAV to a world frame using roll, pitch, and yaw data from an inertial measurement unit (IMU) of the UAV to extract a plurality of z-components of the range data

Assignees

• Nutech Ventures

Inventors

• Detweiler Carrick
• Anthony David
• Elbaum Sebastian

Classifications

• A01M21/00

  Apparatus for the destruction of unwanted vegetation, e.g. weeds (control of undesirable vegetation on roads or permanent ways of railways E01H11/00) · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• G01S17/88

  Lidar systems specially adapted for specific applications · CPC title

• B64U2201/104

  using satellite radio beacon positioning systems, e.g. GPS · CPC title

• G01S17/42

  Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46) · CPC title