Work vehicle vision system with contextual task icons

Patent metadata

Field	Value
Publication number	US-11993209-B2
Application number	US-202217673038-A
Country	US
Kind code	B2
Filing date	Feb 16, 2022
Priority date	Mar 24, 2021
Publication date	May 28, 2024
Grant date	May 28, 2024

Abstract

A multi-camera vision system is utilized onboard a work vehicle having an operator cabin and an apparatus associated with performance of a work task. The system includes: one or more display devices defining a plurality of display areas and a plurality of cameras carried by the work vehicle and coupled to display feeds at the display areas. A first camera of the cameras is oriented to selectively provide a first selected feed of at least a portion of the apparatus during performance of the work task. A controller is configured to display the first selected feed of the selected feeds with an insert, overlay, or icon that indicates the origin and orientation of the first camera as the first selected feed depicts performance of the work task by the apparatus.

First claim

What is claimed is:

1. A multi-camera vision system utilized onboard a work vehicle having an operator cabin and an apparatus in the form of a work implement associated with performance of a work task, the multi-camera vision system comprising:
a plurality of display devices within the operator cabin defining a plurality of display areas arranged at a first side of the work vehicle, a second side of the work vehicle, and a central location of the work vehicle between the first and second sides relative to an operator field of view (FOV);
a plurality of cameras carried by the work vehicle and coupled to the plurality of display devices to display feeds at the plurality of display areas, wherein the plurality of cameras are at or trained on the first side, the second side, and the central location between the first and second sides relative to the operator FOV, including a first camera selectively providing a first selected feed of at least a portion of the apparatus during performance of the work task and including a second camera providing a second selected feed of an area other than the apparatus;
a sensor configured to provide sensor data indicative of a position or a status of the apparatus; and
a controller having processing architecture configured to control, or receive control instructions regarding, the selection of feeds to display at the plurality of display areas, the controller is configured to display a standard set of feeds from the associated first side, second side, and central location of the plurality of cameras at the plurality of display devices so that the associated feeds are arranged at the first side, the second side, and the central location, respectively, relative to the operator FOV, and wherein the controller is configured to display the standard set of feeds each with an insert, overlay, or icon that indicates an origin and orientation of the associated camera including for the first camera providing the first selected feed depicting performance of the work task by the apparatus;
wherein the controller is configured to operate in a non-working mode in which the controller is configured to display a second selected feed from the second camera in at least one of the plurality of display areas and in a working mode in which the controller is configured to display the first selected feed from the first camera in at least one of the plurality of display areas; and
wherein the controller is configured to process the sensor data and automatically switch between the non-working mode and the working mode based on the position or status of the apparatus to display either the first selected feed or the second selected feed.

2. The multi-camera vision system of claim 1 , wherein the first camera is supported on a chassis of the work vehicle.

3. The multi-camera vision system of claim 1 , wherein the first camera is supported on the apparatus.

4. The multi-camera vision system of claim 1 , wherein the apparatus is a first apparatus and the work vehicle includes a second apparatus associated with the performance of the work task; and
wherein the second camera is oriented to selectively provide the second selected feed of at least a portion of the second apparatus during performance of the work task.

5. The multi-camera vision system of claim 1 , wherein the icon is a camera icon indicating the origin of each of the associated cameras.

6. The multi-camera vision system of claim 1 , wherein the icon is an arrow indicating the orientation of each of the associated cameras.

7. The multi-camera vision system of claim 1 ,
wherein the apparatus of the work vehicle includes an unloading auger configured to unload material from the work vehicle into cooperating equipment during an unloading function as part of the work task;
wherein the first camera is directed toward the unloading auger or cooperating equipment to generate the first selected feed during the unloading function; and
wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the unloading function.

8. The multi-camera vision system of claim 1 ,
wherein the apparatus of the work vehicle includes an agricultural boom configured to support agricultural equipment in an unfolded position during an agricultural function as part of the work task;
wherein the first camera is positioned on the agricultural boom to generate the first selected feed during the agricultural function; and
wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the agricultural function.

9. The multi-camera vision system of claim 1 ,
wherein the apparatus of the work vehicle includes an agricultural tank configured to hold agricultural material for use during an agricultural function as part of the work task;
wherein the first camera is positioned towards the agricultural tank to generate the first selected feed during the agricultural function; and
wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the agricultural function.

10. The multi-vision system of claim 1 , wherein the plurality of cameras includes a front camera oriented in a direction of travel, a first side forward-facing camera, and a second side forward-facing camera.

11. The multi-vision system of claim 1 , wherein the plurality of cameras includes a first side mirror camera and a second side mirror camera.

12. The multi-vision system of claim 1 , wherein the plurality of cameras includes a first side camera oriented in a first transverse direction and a second side camera oriented in a second transverse direction.

13. The multi-vision system of claim 1 , wherein the plurality of cameras includes a first side camera on a first C-post of the work vehicle and a second side camera on a second C-post of the work vehicle.

14. The multi-vision system of claim 1 , wherein the plurality of cameras includes a rear-facing camera.

15. A work vehicle, comprising:
a chassis;
an operator cabin supported by the chassis;
an apparatus in the form of a work implement supported by the chassis and associated with performance of a work task; and
a multi-camera vision system comprising:
a plurality of display devices within the operator cabin defining a plurality of display areas arranged at a first side of the work vehicle, a second side of the work vehicle, and a central location of the work vehicle between the first and second sides relative to an operator field of view (FOV);
a plurality of cameras carried by the work vehicle and coupled to the plurality of display devices to display feeds at the plurality of display areas, wherein the plurality of cameras are at or trained on the first side, the second side, and the central location between the first and second sides relative to the operator FOV, including a first camera selectively providing a first selected feed of at least a portion of the apparatus during performance of the work task and including a second camera providing a second selected feed of an area other than the apparatus;
a sensor configured to provide sensor data indicative of a position or a status of the apparatus; and
a controller having processing architecture configured to control, or receive control instructions regarding, the selection of feeds to display at the plurality of display areas, the controller is configured to display a standard set of feeds from the associated first side, second side, and central location of

Assignees

• Deere & Co
• Univ Iowa State Res Found Inc

Inventors

• Huenink Brian M
• Shuler Jeremy B
• Flanders Jake
• Hoffman Christopher M

Classifications

• B60R1/27 Primary

  providing all-round vision, e.g. using omnidirectional cameras · CPC title

• A01B76/00

  Parts, details or accessories of agricultural machines or implements, not provided for in groups A01B51/00 - A01B75/00 · CPC title

• B60R1/0605

  specially adapted for mounting on trucks, e.g. by C-shaped support means · CPC title

• B60R1/12

  Mirror assemblies combined with other articles, e.g. clocks · CPC title

• B60R1/22

  for viewing an area outside the vehicle, e.g. the exterior of the vehicle · CPC title