Control device, control method, and computer readable medium

Patent metadata

Field	Value
Publication number	US-11544937-B2
Application number	US-202016843935-A
Country	US
Kind code	B2
Filing date	Apr 9, 2020
Priority date	Apr 11, 2019
Publication date	Jan 3, 2023
Grant date	Jan 3, 2023

Abstract

A control device includes a specifying unit that specifies one of a plurality of detection objects on the basis of a state of an industrial vehicle when the plurality of detection objects are detected around the industrial vehicle, and a control unit that causes a notification to be performed for the one detection object specified by the specifying unit in an aspect different from those of other detected detection objects.

First claim

What is claimed is:

1. A control device comprising:
a specifying unit configured to specify one of a plurality of detection objects on the basis of a state of an industrial vehicle when the plurality of detection objects are detected around the industrial vehicle on the basis of a captured image of an image-capturing device including a plurality of cameras;
a surroundings display unit including a display that is configured to display a bird's-eye view image of surroundings of the industrial vehicle created from the captured image of the image-capturing device;
a display unit including a plurality of lamps provided along an outer periphery of the display; and
a control unit configured to cause, among the plurality of lamps, one lamp corresponding to a region which is in the bird's-eye view image displayed in the display and in which the image of the one detection object specified by the specifying unit is captured to light up or be turned off in an aspect different from another lamp corresponding to a region in which an image of the other detected detection object is captured on the basis of information on the camera that has captured an image of the one detection object specified by the specifying unit and the captured image used for specifying of the detection object.

2. The control device according to claim 1 ,
wherein the state includes at least one of a distance between the industrial vehicle and the detection object, a steering angle of a wheel of the industrial vehicle, and a traveling direction of the industrial vehicle.

3. The control device according to claim 1 ,
wherein the control unit displays the one detection object specified by the specifying unit on a display unit in an aspect different from those of the other detected detection objects.

4. The control device according to claim 1 ,
wherein the control unit displays the captured image used for specifying of the one detection object on a display unit on the basis of the information on the camera that has captured an image of the one detection object specified by the specifying unit.

5. The control device according to claim 4 ,
wherein the control unit specifies a position of the detection object to be displayed on the display unit on the basis of a position of the detection object in the captured image and the information on the camera.

6. The control device according to claim 1 ,
wherein the control unit outputs a sound different from the other detection object from a speaker corresponding to a position of the one detection object specified by the specifying unit.

7. A control method of controlling a detection object notification system including:
a surroundings display unit including a display that is configured to display a bird's-eye view image of surroundings of the industrial vehicle created from a captured image of an image-capturing device including a plurality of cameras; and
a display unit including a plurality of lamps provided along an outer periphery of the display,
the control method comprising the steps of:
specifying one of a plurality of detection objects on the basis of a state of an industrial vehicle when the plurality of detection objects are detected around the industrial vehicle on the basis of the captured image of the image-capturing device; and
causing, among the plurality of lamps, one lamp corresponding to a region which is in the bird's-eye view image displayed in the display and in which the image of the one detection object specified is captured to light up or be turned off in an aspect different from another lamp corresponding to a region in which an image of the other detected detection object is captured on the basis of information on the camera that has captured an image of the one specified detection object and the captured image used for specifying of the detection object.

8. A non-transitory tangible computer readable medium storing a program for causing a computer in a detection object notification system including:
a surroundings display unit including a display that is configured to display a bird's-eye view image of surroundings of the industrial vehicle created from a captured image of an image-capturing device including a plurality of cameras; and
a display unit including a plurality of lamps provided along an outer periphery of the display, to:
specify one of a plurality of detection objects on the basis of a state of an industrial vehicle when the plurality of detection objects are detected around the industrial vehicle on the basis of a captured image of the image-capturing device including the plurality of cameras; and
cause, among the plurality of lamps, one lamp corresponding to a region which is in the bird's-eye view image displayed in the display and in which the image of the one detection object specified is captured to light up or be turned off in an aspect different from another lamp corresponding to a region in which an image of the other detected detection object is captured on the basis of information on the camera that has captured an image of the one specified detection object and the captured image used for specifying of the detection object.

Assignees

• Mitsubishi Logisnext Co Ltd

Inventors

• Minami Shogo
• Shiizaki Koji
• Ando Akira
• Kodaira Hajime
• Sugimoto Kiichi
• Nakao Kenta
• Iio Satoshi

Classifications

• G08G1/166

  for active traffic, e.g. moving vehicles, pedestrians, bikes · CPC title

• E02F9/261

  Surveying the work-site to be treated · CPC title

• B66F17/003

  for fork-lift trucks · CPC title

• G06V20/58 Primary

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• E02F9/24 Primary

  Safety devices {, e.g. for preventing overload (E02F9/226 takes precedence)} · CPC title