Agricultural work machine

Patent metadata

Field	Value
Publication number	US-11470776-B2
Application number	US-201916534242-A
Country	US
Kind code	B2
Filing date	Aug 7, 2019
Priority date	Aug 29, 2018
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

An agricultural work machine, in particular a harvester, has a header for performing agricultural work and having a control device which has at least one sensor unit for detecting a crop stream in and/or around the header and an image processing unit for processing images which are generated by the sensor unit based on the crop stream detected via sensor. The control device is configured to detect regions of like characteristics, components of the header and properties of the crop stream and is configured to use that which has been detected for open loop control and/or closed loop control of process sequences in the agricultural work machine.

First claim

What is claimed is:

1. An agricultural work machine, comprising: a header for performing agricultural work, and a control device which has at least one sensor unit configured for detecting a crop stream in and/or around the header and an image processing unit for processing images which are generated by the sensor unit based on the crop stream detected via the sensor, wherein the control device is configured to detect regions (A, B, G, H) of like characteristics, components (C, D, E, F) of the header and properties of the crop stream, and is configured to use that which has been detected for open loop control and/or closed loop control of process sequences in the agricultural work machine, wherein the image processing unit is configured to apply a method of velocity characteristic map determination and/or to use a method of line detection and/or to use at least one color filter for determining the regions (A, B, G, H) and/or components (C, D, E, F) and/or properties of the crop stream based on the images generated by the sensor unit, and wherein the image processing unit is configured to carry out an object detection by the method of velocity characteristic map determination and/or the method of line detection, accompanied by the use of at least one color filter, so that the object detection comprises distinguishing between biomass and mechanical objects, and/or wherein the object detection comprises distinguishing one or more regions (A, B, G, H) and one or more surface portions of machine parts of the components (C, D, E, F).

2. The agricultural work machine according to claim 1 , wherein the image processing unit is configured to determine as the region (A) a field stand in front of the header and to identify it as a field stand in front of the header, and/or to determine as the region (B) the field stand behind the header and to identify it as a field stand behind the header, and/or to determine as the component (C) a crop pickup device (of the header and to identify it as a crop pickup device, and/or to determine as the component (D) a crop cutting device of the header and to identify it as crop cutting device, and/or to determine as the component (E) a crop conveying device of the header and to identify it particularly as crop conveying device, and/or to determine as the component (F) a crop intake device of the header and to identify it as a crop intake device, to determine as the region (G) the crop stream inside of the crop pickup device and to identify it as a crop stream inside of the crop pickup device, and/or to determine as the region (H) the crop stream vertically above the crop cutting device of the header, and to identify it particularly as crop stream vertically above the crop cutting device.

3. The agricultural work machine according to claim 2 , wherein in order to identify a respective determined region (A, B, G, H) or a respective determined component (C, D, E, F), the image processing unit is configured to compare identification data which are associated with the respective region (A, B, G, H) or with the respective component (C, D, E, F) and which characterize the respective component and which are stored in the image processing unit.

4. The agricultural work machine according to claim 1 , wherein the image processing unit is configured to generate a velocity characteristic map which has produce flow velocities and/or velocities of surface portions of machine parts of the components of the header with the method of velocity characteristic map determination based on the images generated by the sensor unit.

5. The agricultural work machine according to claim 1 , wherein for producing the velocity characteristic map, the image processing unit is configured to group two consecutive images of an image sequence generated by the sensor unit to form an image pair, wherein a time interval between the images of the respective image pair is detected and/or predetermined by the image processing unit, and wherein each image of the respective image pair has an intensity pattern.

6. The agricultural work machine according to claim 5 , wherein for producing the velocity characteristic map, the image processing unit is configured to determine positional displacements of the intensity patterns between the images of the respective image pair, wherein the positional displacements comprise displacement amounts and displacement directions of the intensity patterns, so that the displacement amounts and displacement directions for each image pair are combined as vectors of a vector field of the respective image pair.

7. The agricultural work machine according to claim 6 , wherein the image processing unit is configured to calculate velocities from the displacement amounts of the intensity patterns between the images of the respective image pair and the time interval between the images of the respective image pair, so that the velocities are the produce flow velocities of the crop stream and/or the velocities of the surface portions of the machine parts of the components of the header.

8. The agricultural work machine according to claim 1 , wherein the image processing unit is configured to generate an edge image initially for the respective image in the method of line detection based on the images generated by the sensor unit and to determine straight lines in the edge image based on the respective edge image.

9. The agricultural work machine according to claim 8 , wherein the image processing unit is configured to group two consecutive images of an image sequence generated by the sensor unit to form an image pair with the method of line detection, wherein a time interval between the images of the respective image pair is detected and/or predetermined by the image processing unit, and wherein each image of the respective image pair has a line pattern comprising one or more straight lines.

10. The agricultural work machine according to claim 9 , wherein the image processing unit is configured to determine positional displacements of the line patterns between the images of the respective image pair with the method of line detection, wherein the positional displacements comprise displacement amounts.

11. The agricultural work machine according to claim 10 , wherein the image processing unit is configured to calculate velocities from the displacement amounts of the line patterns between the images of the respective image pair and a time interval between the images of the respective image pair, wherein the velocities are velocities of surface portions of the machine parts of the components of the header, and/or wherein a velocity is the velocity of a surface portion of a machine part of the crop pickup device.

12. The agricultural work machine according to claim 1 , wherein the image processing unit is configured to predetermine one or more regions as a reference region, and/or wherein the image processing unit is configured to predetermine one or more surface portions of machine parts of the components as a reference surface portion.

13. The agricultural work machine according to claim 12 , wherein the image processing unit is configured to use one or more reference regions and/or one or more reference surface portions as basis for a comparison with another region, and/or wherein the image processing unit is configured to use one or more reference regions and/or one or more reference surface portions as basis for a comparison with another surface portion of a machine part of a component.

14. The agricultural work machine according to claim 12 , wherein the image processing unit is configured to determine produce flow velocity in a region by comparing the region with one

Assignees

• Claas Selbstfahrende Erntemaschinen Gmbh

Inventors

• Barther Marvin
• Neitemeier Dennis
• Fischer Frédéric
• Kettelhoit Boris

Classifications

• G06V20/56

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G06T7/248

  involving reference images or patches · CPC title

• A01D41/141

  Automatic header control · CPC title

• G06T2207/30188

  Vegetation; Agriculture · CPC title

• A01D41/1271 Primary

  for measuring crop flow · CPC title