Sensor fusion in agricultural vehicle steering

Patent metadata

Field	Value
Publication number	US-12366860-B2
Application number	US-202117548497-A
Country	US
Kind code	B2
Filing date	Dec 11, 2021
Priority date	Dec 11, 2020
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

A row steering system of an agricultural machine is provided. The row steering system includes a first sensor assembly configured to detect a first orientation of the agricultural machine relative to a path reference in a field using a first sensor configured to measure a first characteristic. The system also includes a second sensor assembly configured to detect a second orientation of the agricultural machine using a second sensor configured to measure a second characteristic. The system further includes a control module including a first evaluation module to obtain a first confidence in the detected first orientation, a second evaluation module to obtain a second confidence in the detected second orientation, and a selector module to selectively provide one or more of the detected first orientation or the detected second orientation to a machine controller of the agricultural machine based on the first and second confidences.

First claim

The claimed invention is:

1. A row steering system of an agricultural machine, the row steering system comprising:
a first sensor assembly configured to detect a first orientation of the agricultural machine relative to a path reference in a field using a first sensor configured to measure a first characteristic;
a second sensor assembly configured to detect a second orientation of the agricultural machine relative to crop rows in the field using a second sensor configured to measure a second characteristic different than the first characteristic; and
one or more processors configured to:
calculate a first confidence in the detected first orientation using a combination of signal quality and line-fit quality of the detected first orientation, wherein the signal quality is determined based on differentiation of a crop or row indicator from a soil or furrow indicator achieving a differentiation threshold, and the line-fit quality is determined based on a comparison of a fitted line to calculated row positions;
calculate a second confidence in the detected second orientation using a combination of signal quality and line-fit quality of the detected second orientation; and
automatically control the agricultural machine based on the first and second confidences.

2. The row steering system of claim 1 , wherein the first sensor is an optical sensor and the second sensor is a radar sensor.

3. The row steering system of claim 1 , wherein the first and second sensors are optical sensors.

4. The row steering system of claim 1 , wherein the first and second sensors are radar sensors.

5. The row steering system of claim 1 , wherein the first sensor or the second sensor comprises at least one of an optical sensor, radar sensor, a global positioning sensor, an acoustic sensor, a LIDAR sensor, or a tactile sensor.

6. The row steering system of claim 1 , wherein the first sensor assembly is configured to couple to the agricultural machine at an elevated location relative to the path reference, and the first sensor is configured to detect the first orientation from the elevated location directed toward the path reference.

7. The row steering system of claim 6 , wherein the second sensor assembly is configured to couple to the agricultural machine at a lateral location relative to the path reference, and the second sensor is configured to detect the second orientation from the lateral location directed across the path reference.

8. The row steering system of claim 1 , wherein the first and second orientation comprise:
a translational difference between a location of the agricultural machine and the path reference; and
an angular difference between an angular orientation of the agricultural machine and the path reference.

9. The row steering system of claim 1 , wherein the one or more processors are further configured to:
weight the first and second orientations based on one or more of the respective first or second confidences;
determine a combined orientation including the weighted first and second orientations; and
selectively provide one of the detected first orientation, the detected second orientation, or the combined orientation to a machine controller.

10. The row steering system of claim 1 , wherein the one or more processors are further configured to:
compare the first confidence to the second confidence; and
selectively provide the first orientation to a machine controller responsive to the first confidence being larger than the second confidence or provide the second orientation to the machine controller responsive to the second confidence being larger than the first confidence.

11. The row steering system of claim 1 , wherein the path reference includes at least one of a guidance path, a guidance line, or one or more crop rows.

12. A system for steering an agricultural machine relative to guidance path, the system comprising:
a sensor module including:
a first sensor assembly configured to obtain a first orientation of the agricultural machine relative to the guidance path based on a first measured characteristic; and
a second sensor assembly configured to obtain a second orientation of the agricultural machine relative to the guidance path based on a second measured characteristic;

one or more processors configured to automatically control the agricultural machine, the one or more processors are configured to:
calculate a first confidence in the first orientation based on the first sensor assembly using a combination of signal quality and line-fit quality of the first orientation and calculate a second confidence in the second orientation based on the second sensor assembly using a combination of signal quality and line-fit quality of the second orientation, wherein the signal quality is determined based on differentiation of a crop or row indicator from a soil or furrow indicator achieving a differentiation threshold, and the line-fit quality is determined based on a comparison of a fitted line to calculated row positions;
generate a combined orientation of the agricultural machine based on a weighted combination of the first orientation and the second orientation;
assign first and second weights to respective first and second orientations based on one or more of the respective first or second confidences; and
generate the combined orientation using the weighted first and second orientations;

an interface configured to communicate the combined orientation; and
a machine controller configured to automatically control the agricultural machine using the combined orientation received from the interface.

13. The system of claim 12 , wherein:
the first orientation of the agricultural machine includes a first position of the agricultural machine relative to the guidance path and a first angle between the agricultural machine and the guidance path as observed with the first sensor assembly; and
the second orientation of the agricultural machine includes a second position of the agricultural machine relative to the guidance path and second angle between the agricultural machine and the guidance path as observed with the second sensor assembly.

14. The system of claim 13 , wherein the one or more processors are further configured to:
generate a composite position from the first and second positions based on the weighted first and second orientations;
generate a composite angle from the first and second angles based on the weighted first and second orientations; and
generate a composite orientation including the composite position and the composite angle.

15. The system of claim 14 , wherein the weighted first orientation and the weighted second orientation include first and second gains, respectively, and the first and second gains are normalized to sum to 1.

16. The system of claim 15 , wherein the weighted first orientation and the weighted second orientation are based on the first confidence and the second confidence, respectively.

17. The system of claim 14 , wherein the weighting module is configured to set a first gain to zero (0) and a second gain to one (1) responsive to first confidence falling below a specified threshold value.

18. The system of claim 14 , wherein the one or more processors are further configured to set a first gain to zero (0) and a second gain to one (1) responsive to the second confidence exceeding the first confidence by a threshold value.

19. The system of claim 14 , wherein the one or more processors are further configured to:
adjust the first weight of the first orientation accord

Assignees

• Raven Ind Inc

Inventors

• Weidenbach Alex John
• Mathews Jonathan Eugene

Classifications

• A01B1/00

  Hand tools (edge trimmers for lawns A01G3/06) · CPC title

• G05D1/243

  Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals (using passive navigation aids external to the vehicle G05D1/244; using signals from positioning sensors located off-board the vehicle G05D1/249) · CPC title

• G05D2111/30

  Radio signals · CPC title

• G01S17/88

  Lidar systems specially adapted for specific applications · CPC title

• G01S13/865

  Combination of radar systems with lidar systems · CPC title