Operating machine information display system

Patent metadata

Field	Value
Publication number	US-2022043617-A1
Application number	US-201917275858-A
Country	US
Kind code	A1
Filing date	Sep 2, 2019
Priority date	Sep 26, 2018
Publication date	Feb 10, 2022
Grant date	—

Abstract

An operating machine information acquisition unit acquires information on an operating machine, including position information on the operating machine. A terminal device is carried by a worker around the operating machine, capable of displaying information, and includes a terminal device information acquisition unit. The terminal device information acquisition unit acquires position information and orientation information of the terminal device. A calculation unit causes the terminal device to display state information relating to a state of the operating machine based on the position information of the operating machine and the position information and the orientation information of the terminal device.

First claim

1 . An operating machine information display system that displays information on an operating machine, the operating machine information display system comprising:
an operating machine information acquisition unit that acquires information on the operating machine, the information including position information of the operating machine; a terminal device that is carried by a worker around the operating machine and capable of displaying information; and a calculation unit, wherein the terminal device includes a terminal device information acquisition unit that acquires position information and orientation information of the terminal device, and the calculation unit causes the terminal device to display state information relating to a state of the operating machine based on the position information of the operating machine acquired by the operating machine information acquisition unit and the position information and the orientation information of the terminal device acquired by the terminal device information acquisition unit.

2 . The operating machine information display system according to claim 1 , wherein the calculation unit determines display information to be displayed on the terminal device based on a parameter indicating degree of attention acquired from the state information.

3 . The operating machine information display system according to claim 2 , wherein
the parameter indicating the degree of attention includes information indicating an attention area which is an area around the operating machine, and the calculation unit determines the display information based on the information indicating the attention area.

4 . The operating machine information display system according to claim 3 , wherein
the terminal device information acquisition unit further acquires the orientation information of the terminal device, and the terminal device displays the attention area so that the attention area is superimposed on an image captured by the terminal device, or displays the attention area so that the attention area overlaps a foreground seen by the worker through the terminal device by using the orientation information.

5 . The operating machine information display system according to claim 3 , wherein
the terminal device information acquisition unit further acquires the orientation information of the terminal device, the operating machine information display system further comprising a display switching unit that switches between a first display mode and a second display mode, which are modes relating to display of the terminal device, wherein in a case where the first display mode is selected by the display switching unit, the terminal device displays the attention area so that the attention area is superimposed on an image captured by the terminal device or so that the attention area is superimposed on a foreground seen by the worker through the terminal device by using the orientation information, and in a case where the second display mode is selected by the display switching unit, the terminal device hides the attention area, or reduces an information amount of display of the attention area as compared with a case where the first display mode is selected.

6 . The operating machine information display system according to claim 3 , wherein the terminal device displays information relating to whether or not the terminal device exists inside the attention area.

7 . The operating machine information display system according to claim 6 , wherein in a case of displaying the attention area, the terminal device changes a display color of the attention area depending on whether or not the terminal device exists inside the attention area.

8 . The operating machine information display system according to claim 3 , wherein
the operating machine information acquisition unit further acquires orientation information indicating orientation of the operating machine, and the calculation unit sets the attention area based on the orientation information.

9 . The operating machine information display system according to claim 3 , wherein
the operating machine information acquisition unit acquires an operation amount of the operating machine, and the calculation unit sets the attention area so that the attention area becomes wider as the operation amount of the operating machine increases.

10 . The operating machine information display system according to claim 3 , wherein
the operating machine information acquisition unit further acquires an operating speed of the operating machine, and the calculation unit sets the attention area so that the attention area becomes wider as the operating speed of the operating machine increases.

11 . The operating machine information display system according to claim 10 , wherein
the operating machine further includes a lower travelling body and an upper slewing body, the operating machine information acquisition unit further acquires a slewing speed of the upper slewing body with respect to the lower travelling body, and the calculation unit sets the attention area so that the attention area becomes wider as the slewing speed acquired by the operating machine information acquisition unit increases.

12 . The operating machine information display system according to claim 10 , wherein
the operating machine information acquisition unit further acquires a travelling speed of the operating machine, and the calculation unit sets the attention area so that the attention area becomes wider as the travelling speed acquired by the operating machine information acquisition unit increases.

13 . The operating machine information display system according to claim 10 , wherein
the operating machine further includes an operating machine main body and an attachment, the operating machine information acquisition unit further acquires an attachment speed, which is a speed of the attachment with respect to the machine main body, and the calculation unit sets the attention area so that the attention area becomes wider as the attachment speed acquired by the operating machine information acquisition unit increases.

14 . The operating machine information display system according to claim 9 , wherein
the operating machine further includes an operating machine main body and an attachment, the operating machine information acquisition unit further acquires posture information indicating a posture of the attachment with respect to the machine main body, and the calculation unit changes size of the attention area based on the posture information acquired by the operating machine information acquisition unit.

15 . The operating machine information display system according to claim 9 , wherein in a case where the terminal device displays the attention area and the calculation unit changes size of the attention area, the terminal device changes a display color of the attention area.

16 . The operating machine information display system according to claim 1 , further comprising an operator output device configured to be usable by an operator of the operating machine,
wherein the operator output device displays position information of the terminal device.

17 . The operating machine information display system according to claim 3 , further comprising an operator output device configured to be usable by an operator of the operating machine,
wherein the operator output device outputs a warning in a case where the terminal device exists inside the attention area.

Assignees

• Kobelco Constr Mach Co Ltd

Inventors

• Kamimura Yusuke
• Yamazaki Yoichiro

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• F16P3/147 Primary

  using electro-magnetic technology, e.g. tags or radar · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• E02F9/205

  Remotely operated machines, e.g. unmanned vehicles (E02F3/8866 takes precedence) · CPC title