Display device, shovel, and information processing apparatus

Patent metadata

Field	Value
Publication number	US-12325980-B2
Application number	US-202117451914-A
Country	US
Kind code	B2
Filing date	Oct 22, 2021
Priority date	Apr 26, 2019
Publication date	Jun 10, 2025
Grant date	Jun 10, 2025

Abstract

A display device is provided. The display device displays an image captured by a first camera of a plurality of cameras, the captured image representing a situation around a shovel, and when a predetermined object is detected within an imaging range of a second camera that is different from the first camera, the display device displays an image representing that the predetermined object is detected outside a range of the displayed captured image of the first camera.

First claim

What is claimed is:

1. A display device,
wherein the display device is configured to display a through-the-lens image captured by a camera, the captured image representing a situation around a shovel, and when an object is detected based on an output of a distance sensor, display an indicator image within the displayed captured image of the camera, the indicator image pointing to a direction in which the detected object is present when an area in the captured image of the camera is viewed from the shovel, and
wherein the display device is configured to, when a predetermined object is detected within an imaging range of the camera based on the captured image of the camera and the output of the distance sensor, display, within the displayed captured image of the camera,
an image of the predetermined object,
a frame image over the image of the predetermined object, the frame image indicating a position of the predetermined object, and
the indicator image separately from the image of the predetermined object and the frame image, the indicator image pointing to a direction in which the predetermined object is present when the area in the captured image of the camera is viewed from the shovel, the indicator image being displayed at a lower end of the displayed captured image of the camera.

2. The display device according to claim 1 , wherein the display device is configured to, when the predetermined object is detected outside the imaging range of the camera based on the output of the distance sensor, display the indicator image within the displayed captured image of the camera, the indicator image pointing to a direction in which the predetermined object is present when the area in the captured image of the camera is viewed from the shovel, the indicator image pointing outward of the displayed captured image.

3. The display device according to claim 2 , wherein the display device is configured to, when the predetermined object is detected outside the imaging range of the camera, display the indicator image within the displayed captured image of the camera without displaying the image of the predetermined object or the frame image.

4. The display device according to claim 1 , wherein the display device is configured to superimpose the indicator image on the displayed captured image of the camera.

5. The display device according to claim 1 , wherein the indicator image includes a gap, the displayed captured image of the camera being exposed through the gap.

6. The display device according to claim 1 , wherein the display device is configured to change a manner of displaying the indicator image in accordance with a distance between the predetermined object and the shovel.

7. The display device according to claim 1 , wherein the display device is configured to, when the predetermined object is detected outside the imaging range of the camera based on the output of the distance sensor, cause the captured image of the camera to remain displayed until an operation for changing a display content is performed.

8. The display device according to claim 1 , wherein the display device is configured to, when the predetermined object is detected within the imaging range of the camera, display the indicator image pointing inward of the displayed captured image of the camera.

9. The display device according to claim 1 , wherein the display device is configured to display the indicator image having an arrow shape or a triangular shape.

10. The display device according to claim 1 , wherein the distance sensor is one of a LIDAR sensor, a millimeter wave radar, and an ultrasonic sensor.

11. A shovel comprising:
the display device according to claim 1 ; and
a cabin,
wherein the display device is provided within the cabin.

12. An information processing apparatus comprising:
the display device according to claim 1 ; and
an operation device for remote operation of the shovel.

Assignees

• Sumitomo Construction Machinery Co Ltd

Inventors

• Izumikawa Takeya
• Morimoto Takaaki
• Nakayama Atsushi
• Tsuji Keiichi
• Sato Yusuke
• Umeda Takashi

Classifications

• B60R1/27

  providing all-round vision, e.g. using omnidirectional cameras · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• E02F9/24

  Safety devices {, e.g. for preventing overload (E02F9/226 takes precedence)} · CPC title

• B60R2300/8093

  for obstacle warning · CPC title

• B60R2300/8033

  for pedestrian protection · CPC title