Obtaining and augmenting agricultural data and generating an augmented display

Patent metadata

Field	Value
Publication number	US-12439840-B2
Application number	US-202217669030-A
Country	US
Kind code	B2
Filing date	Feb 10, 2022
Priority date	Aug 11, 2021
Publication date	Oct 14, 2025
Grant date	Oct 14, 2025

Abstract

A geographic position of an agricultural machine is captured. Agricultural data is received that corresponds to a geographic position. Georeferenced visual indicia are displayed that are indicative of the received agricultural data.

First claim

What is claimed is:

1. A computer-implemented method of automatically controlling an agricultural system, comprising:
receiving predictive visual data indicative of an expected visualization of a geographic location on an agricultural worksite;
receiving an actual visual representation of the geographic location;
comparing the expected visualization of the geographic location to the actual visual representation of the geographic location to identify an anomaly;
identifying a severity level of the identified anomaly:
generating a geographically referenced anomaly indicator indicative of the severity level of the identified anomaly;
generating an enhanced display, the enhanced display showing the geographic location enhanced with the geographically referenced anomaly indicator; and
automatically controlling an agricultural machine in the agricultural system based on the geographically referenced anomaly indicator.

2. The computer-implemented method of claim 1 and further comprising:
detecting a user interaction with the enhanced display;
processing the detected user interaction to identify additional anomaly information corresponding to the identified anomaly; and
modifying the enhanced display with the additional anomaly information.

3. The computer-implemented method of claim 2 wherein processing the detected user interaction comprises:
performing diagnostic processing to identify, as the additional anomaly information, a diagnostic factor contributing to a possible cause of the anomaly; and
generating a diagnostic factor display element, wherein modifying the enhanced display comprises adding the diagnostic factor display element to the enhanced display.

4. The computer-implemented method of claim 2 wherein processing the detected user interaction comprises:
performing prognosis processing to identify remedial information indicative of a possible remedy for the anomaly; and
generating a possible remedy display element, wherein modifying the enhanced display comprises adding the possible remedy display element to the enhanced display.

5. The computer-implemented method of claim 4 wherein the identified anomaly corresponds to a crop characteristic anomaly, and where the severity level of the identified anomaly corresponds to a severity level of the crop characteristic anomaly.

6. The computer-implemented method of claim 1 wherein identifying the severity level of the identified anomaly comprises:
generating a metric value indicative of a measure of difference between the expected visualization and the actual visual representation of the geographic location;
comparing the metric value to a metric threshold value to obtain a metric difference value; and
identifying the severity level of the identified anomaly based on the metric difference value.

7. The computer-implemented method of claim 1 wherein receiving the predictive visual data comprises:
identifying a neighboring geographic location adjacent the geographic location; and
generating the predictive visual data based on a visualization of the neighboring geographic location.

8. The computer-implemented method of claim 1 wherein generating the geographically referenced anomaly indicator comprises:
generating a geometric shaped display element, a geometric shape of the geometric shaped display element being indicative of the geographically referenced anomaly indicator.

9. The computer-implemented method of claim 1 wherein generating the geographically referenced anomaly indicator comprises:
generating a display element having visual indicia, the visual indicia of the display element being indicative of the geographically referenced anomaly indicator.

10. The computer-implemented method of claim 1 wherein receiving predictive visual data indicative of the expected visualization of the geographic location on the agricultural worksite comprises:
obtaining a prior state of the geographic location and prior conditions that affect the prior state;
generating a predictive state of the geographic location based on the prior state and the prior conditions; and
generating the predictive visual data based on the predictive state of the geographic location.

11. The computer-implemented method of claim 1 wherein generating the enhanced display showing the geographic location includes simultaneously showing the geographically referenced anomaly indicator and a data display including geographically referenced planting characteristics.

12. An agricultural system, comprising:
an expected state identification system identifying predictive visual data indicative of an expected visualization of a geographic location on an agricultural worksite;
a comparison system receiving an actual visual representation of the geographic location, the comparison system configured to generate a metric value indicative of a measure of difference between the expected visualization of the geographic location and the actual visual representation of the geographic location to generate a comparison result;
an anomaly identifier identifying an anomaly based on the comparison result;
an anomaly output system generating a geographically referenced anomaly indicator indicative of the anomaly;
a display generation system generating an enhanced display, the enhanced display showing the geographic location enhanced with the geographically referenced anomaly indicator; and
a control system configured to automatically control an agricultural machine in the agricultural system based on the geographically referenced anomaly indicator shown in the enhanced display.

13. The agricultural system of claim 12 and further comprising:
a user interaction detector configured to detect a user interaction with the enhanced display;
a workflow processing system configured to process the detected user interaction to identify additional anomaly information corresponding to the identified anomaly; and
a display output system configured to modify the enhanced display with the additional anomaly information.

14. The agricultural system of claim 13 wherein the workflow processing system comprises:
a diagnostic system configured to perform diagnostic processing to identify, as the additional anomaly information, a diagnostic factor contributing to a possible cause of the anomaly and generate a diagnostic factor display element, the display generation system modifying the enhanced display by adding the diagnostic factor display element to the enhanced display.

15. The agricultural system of claim 14 wherein the workflow processing system comprises:
a prognosis system configured to perform prognosis processing to identify remedial information indicative of a possible remedy for the anomaly and generate a possible remedy display element, the display generation system modifying the enhanced display by adding the possible remedy display element to the enhanced display.

16. The agricultural system of claim 12 wherein the comparison system is configured to compare the metric value to a metric threshold value to obtain a metric difference value and wherein the anomaly identifier is configured to identify a severity level of the identified anomaly based on the comparison result.

17. The agricultural system of claim 12 wherein the display generation system is configured to generate, as the geographically referenced anomaly indicator, a geometric shaped display element, a geometric shape of the geometric shaped display element being indicative of the geographically referenced anomaly indicator.

18. The agricultural system

Assignees

• Deere & Co

Inventors

• Anderson Noel W
• Hubner Cary S
• Mcdonald Brandon M
• Ogden Nathan
• Sprabery Brittany
• Mahrt Sean A
• Schinckel Sarah L
• Moran Mark D

Classifications

• H04W4/185

  by embedding added-value information into content, e.g. geo-tagging · CPC title

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title

• G06T2207/30188

  Vegetation; Agriculture · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title