Information presentation system, terminal device, and recording medium

Patent metadata

Field	Value
Publication number	US-12026417-B2
Application number	US-202118269703-A
Country	US
Kind code	B2
Filing date	Mar 11, 2021
Priority date	Jan 15, 2021
Publication date	Jul 2, 2024
Grant date	Jul 2, 2024

Abstract

An information presentation system includes a controller that controls a device included in a production line, a terminal including a display and a camera that captures an image of the device, and a server that communicates with the controller and the terminal. The camera has an image capture range including a view field of the display. The controller transmits a light emission command to the device, the light emission command causing a light emitter included in the device to emit light in a predetermined light emission pattern. The terminal displays information regarding the device in association with a display position in a display area of the display, the display position corresponding to a position of a partial image representing the light emission pattern in a captured image of the camera.

First claim

The invention claimed is:

1. An information presentation system comprising: a controller configured to control a device included in a production line; a terminal including a display and a camera configured to capture an image of the device; and a server configured to communicate with the controller and the terminal, wherein the camera has an image capture range including a view field of the display, the controller includes a module configured to transmit a light emission command to the device, the light emission command causing a light emitting unit included in the device to emit light in a predetermined light emission pattern, and the terminal includes a module configured to display information regarding the device in association with a display position in a display area of the display, the display position corresponding to a position of a partial image representing the light emission pattern in a captured image of the camera; and wherein the controller further includes a module configured to cause a light emitting unit included in another device near the device to emit light in a pattern different from the light emission pattern.

2. The information presentation system according to claim 1 , wherein the information regarding the device includes information indicating a state of the device.

3. The information presentation system according to claim 1 , wherein the server transmits a notification for specifying the light emission pattern to the controller.

4. The information presentation system according to claim 1 , wherein the server includes:
an image processing module configured to process the captured image received from the terminal, and detect a position of the partial image representing the light emission pattern in the captured image; and
a module configured to transmit the position of the partial image detected by the image processing module to the terminal.

5. The information presentation system according to claim 1 , wherein
the server transmits a notification for specifying the light emission pattern to the terminal, and
the terminal further includes an image processing module configured to process the captured image of the camera, and detect a position of the partial image representing the light emission pattern in the captured image.

6. The information presentation system according to claim 1 , wherein the server determines the light emission pattern based on identification information of the device.

7. The information presentation system according to claim 1 , wherein the server determines the light emission pattern based on a state of the device.

8. The information presentation system according to claim 6 , wherein the controller determines a state of the device based on a state value output from the device, and transmits a notification of the determined state to the server.

9. The information presentation system according to claim 6 , wherein
the controller transmits a database operation command to the server, the database operation command being for storing information indicating a state of the device in a database included in the server, and
the server determines the state of the device based on the information stored in the database.

10. The information presentation system according to claim 1 , wherein the controller outputs the light emission command to a device designated based on a user operation.

11. The information presentation system according to claim 1 , wherein
the terminal further includes a gaze sensor configured to detect a gazing direction of a user operating the terminal, and
an image capturing direction of the camera coincides with the gazing direction.

12. A terminal device comprising: a module configured to communicate with a controller that controls a device included in a production line; a display; and a camera configured to capture an image of the device, wherein the camera has an image capture range including a view field of the display, the device includes a light source configured to emit light in a predetermined light emission pattern based on a light emission command from the controller, and the terminal device further includes a module configured to display information regarding the device in association with a display position in a display area of the display, the display position corresponding to a position of a partial image representing the light emission pattern in a captured image of the camera; and wherein the controller further includes a module configured to cause a light emitting unit included in another device near the device to emit light in a pattern different from the light emission pattern.

13. A non-transitory machine-readable recording medium having stored thereon a program which, when executed by a processor, causes the processor included in a terminal device to perform an information presentation method, wherein the terminal device includes: a module configured to communicate with a controller that controls a device included in a production line; a display; and a camera configured to capture an image of the device, the camera has an image capture range including a view field of the display, the device includes a light source configured to emit light in a predetermined light emission pattern based on a light emission command from the controller, and the information presentation method includes: acquiring a position that is a display position in a display area of the display and that is a position of a partial image representing the light emission pattern in a captured image of the camera; and controlling the display to display information regarding the device in association with the acquired display position in the display area of the display; and wherein the controller further includes a module configured to cause a light emitting unit included in another device near the device to emit light in a pattern different from the light emission pattern.

Assignees

• Omron Tateisi Electronics Co

Inventors

• Kobayashi Yoshiaki
• NAGATA Yuta
• Watanabe Yuya

Classifications

• G05B19/418

  Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] · CPC title

• G09G5/10

  Intensity circuits · CPC title

• G09G3/32

  semiconductive, e.g. using light-emitting diodes [LED] · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G09G2340/125

  wherein one of the images is motion video · CPC title