Agricultural sprayer with real-time, on-machine target sensor

Patent metadata

Field	Value
Publication number	US-11832609-B2
Application number	US-202117172305-A
Country	US
Kind code	B2
Filing date	Feb 10, 2021
Priority date	Dec 21, 2020
Publication date	Dec 5, 2023
Grant date	Dec 5, 2023

Abstract

An agricultural applicator, that applies material to an agricultural field, includes an on-board, real-time image sensor that senses targets for the material to be applied. A controller controls applicators, such as nozzles or other applicators, to apply the material to the sensed targets.

First claim

What is claimed is:

1. An agricultural machine configured to travel across a field in a direction of travel, the agricultural machine comprising:
a material reservoir;
a controllable valve;
a pump configured to pump material from the material reservoir to the controllable valve;
an optical sensor configured to capture an image of a portion of the field ahead of the controllable valve in the direction of travel;
a row identification system configured to:
identify a crop row in the image;
generate an altered image based on the identified crop row in the image; and
identify a target based on the altered image; and

a valve controller configured to generate a valve control signal to control the controllable valve to apply the material to the target.

2. The agricultural machine of claim 1 and further including:
a target identification system configured to identify the target based on a location of the identified crop row in the image.

3. The agricultural machine of claim 2 wherein the target identification system is configured to identify, as the target, a location of the identified crop row in the image.

4. The agricultural machine of claim 1 , wherein the target identification system includes:
a weed locator configured to identify, as the target, a weed target.

5. The agricultural machine of claim 4 wherein the row identification system includes:
a row edge identifier configured to identify an edge of the identified crop row in the image.

6. The agricultural machine of claim 5 wherein the row identification system includes:
an overhang processor configured to:
compare a location of the weed target with the identified edge of the crop row;
determine whether the weed target connects to the crop row; and
output an overhang output based on the determination of whether the weed target is connected to the crop row, the valve controller configured to generate the valve control signal based on the overhang output.

7. The agricultural machine of claim 1 wherein the row identification system includes:
a segmentation system configured to segment the image based on expected row crop color to generate a segmented image that has color-based segments.

8. The agricultural machine of claim 7 wherein the image is represented on an image representation that includes a set of pixels arranged in rows and columns and wherein the row identification system includes:
a pixel value assignment system configured to assign a value to each pixel in the segmented image based on the color-based segments.

9. The agricultural machine of claim 8 wherein the row identification system includes:
a pixel accumulator configured to accumulate the values assigned to pixels in each column to generate a pixel accumulation structure.

10. The agricultural machine of claim 9 wherein the row identification system includes:
a peak processor configured to identify peaks in the pixel accumulation structure.

11. The agricultural machine of claim 10 wherein the row identification system includes:
a row spacing processor configured to:
compare a distance between identified peaks in the pixel accumulation structure to an expected row spacing to generate a spacing comparison result; and
generate a row identification output identifying row location, in the image, based on the identified peaks and the spacing comparison result.

12. The agricultural machine of claim 1 wherein the row identification system is configured to delete or mask the identified crop row to generate the altered image.

13. A method of controlling an agricultural machine that travels across a field in a direction of travel, the method comprising:
sensing an image of a portion of the field ahead of a controllable valve in the direction of travel, the controllable valve mounted on a boom carried by the agricultural machine and being controllable to apply material to the field, the material being pumped by a pump from a material reservoir to the controllable valve, wherein the image is represented on an image representation that includes a set of pixels arranged in rows and columns;
segmenting the image based on expected row crop color to generate a segmented image that has color-based segments;
assigning a value to each pixel in the segmented image based on the color-based segments;
accumulating the values assigned to pixels in each column to generate a pixel accumulation structure;
identifying peaks in the pixel accumulation structure;
comparing a distance between identified peaks in the pixel accumulation structure to an expected row spacing to generate a spacing comparison result;
generating a row identification output identifying crop rows and their locations, in the image, based on the identified peaks and the spacing comparison result; and
generating a valve control signal to control the controllable valve to apply the material to a target based on the row identification output.

14. The method of claim 13 and further comprising:
masking the identified crop rows in the image; and
identifying, as the target, a weed target in the image based on an unmasked portion of the image.

15. The method of claim 14 and further comprising:
identifying an edge of an identified crop row in the image;
comparing a location of the weed target in the image with the identified edge of the crop row, to determine whether the weed target connects to the crop row; and
outputting an overhang output based on the determination of whether the weed target is connected to the crop row, wherein generating a valve control signal comprises generating the valve control signal based on the overhang output.

16. An agricultural machine configured to travel across a field in a direction of travel, the agricultural machine comprising:
a material reservoir;
a controllable valve;
a pump configured to pump material from the material reservoir to the controllable valve;
an optical sensor configured to capture an image of a portion of the field ahead of the controllable valve in the direction of travel;
a segmentation system configured to segment the image based on expected row crop color to generate a segmented image that has color-based segments;
a pixel value assignment system configured to assign a value to each pixel in the segmented image based on the color-based segments;
a pixel accumulator configured to accumulate the values assigned to pixels in each column to generate a pixel accumulation structure;
a row identification system configured to identify a crop row in the image based on the pixel accumulation structure;
a target identification system configured to identify target based on a location of the identified crop row in the image; and
a valve controller configured to generate a valve control signal to control the controllable valve to apply the material to the target based on the identified crop row.

17. The agricultural machine of claim 16 wherein the row identification system includes:
a row masking component configured to mask the identified crop row in the image, the target identification system configured to identify the target in the image based on an unmasked portion of the image.

18. The agricultural machine of claim 17 , wherein the target identification system includes:
a weed locator configured to identify, as the target, a weed target in the unmasked portion of the image.

19. The agricultural machine of claim 16 wherein the target identification system is configured to identify, as the target, a location of the identified crop row.

Assignees

• Deere & Co

Inventors

• Humpal Richard A
• Rees Steven
• Boydell Broughton C
• Loukili Tarik
• Davis Travis J
• Pickett Terence D
• Buse Scott M

Classifications

• A01M7/0089 Primary

  Regulating or controlling systems (the delivery being related to the movement of a vehicle B05B9/06) · CPC title

• A01M7/0042

  Field sprayers, e.g. self-propelled, drawn or tractor-mounted · CPC title

• B05B12/122

  responsive to presence or shape of target (B05B12/124 takes precedence) · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06T7/11

  Region-based segmentation · CPC title