Display system, display device, information display method, and program

Patent metadata

Field	Value
Publication number	US-10133532-B2
Application number	US-201615264740-A
Country	US
Kind code	B2
Filing date	Sep 14, 2016
Priority date	Sep 25, 2015
Publication date	Nov 20, 2018
Grant date	Nov 20, 2018

Abstract

In a display system, a projector detects an operation, generates guide information indicating the detected operation, and transmits the guide information to an HMD, and the HMD receives the guide information transmitted from the projector and displays an image corresponding to the operation of the projector and an image indicating a point of view or line-of-sight direction of an operator carrying out the operation, on the basis of the guide information.

First claim

What is claimed is:

1. A display system comprising a first display device and a second display device,
the first display device comprising:
a first display unit which displays an image in a first display area;
a first image pickup unit;
a first communication unit which carries out communication with the second display device; and
a first control unit which causes the first communication unit to receive guide information from the second display device and causes the first display unit to display an image based on the guide information,

the second display device comprising:
a second display unit which displays an image in a second display area;
a second communication unit which carries out communication with the first display device;
an operation detection unit which detects an operation; and
a second control unit which generates guide information indicating an operation detected by the operation detection unit and causes the second communication unit to transmit the guide information,

wherein the first control unit causes the first display unit to display an image corresponding to an operation detected by the operation detection unit of the second display device and an image indicating a point of view or line-of-sight direction of an operator carrying out the operation, on the basis of the guide information received from the second display device.

2. The display system according to claim 1 , wherein
the second control unit generates the guide information including information which indicates an operation detected by the operation detection unit, with reference to the point of view or line-of-sight direction of the operator carrying out the operation.

3. The display system according to claim 1 , wherein
the first display unit displays an image in the first display area including an object arrangement area where an object to be worked on is arranged, and
the first control unit causes an image to be displayed at a position corresponding to the object to be worked on arranged in the object arrangement area.

4. The display system according to claim 3 , wherein
the first image pickup unit picks up an image of an image pickup range including at least a part of the object arrangement area, and
the first control unit specifies a display position of an image corresponding to the position of the object to be worked on, on the basis of a pickup image picked up by the first image pickup unit.

5. The display system according to claim 3 , wherein
the first control unit causes the first display unit to display an image indicating the image pickup range of the first image pickup unit.

6. The display system according to claim 1 , wherein
the first control unit causes an image of an operating body to be displayed corresponding to an operation position of an operation detected by the operation detection unit of the second display device, on the basis of the guide information received from the second display device.

7. The display system according to claim 1 , wherein
the first control unit causes an image indicating an operation position of an operation detected by the operation detection unit of the second display device and an image of an operating body to be displayed, on the basis of the guide information received from the second display device.

8. The display system according to claim 6 , wherein
the image of the operating body displayed by the first display device on the basis of the guide information is an image of a tool or apparatus involved in work to be carried out using the first display device.

9. The display system according to claim 8 , wherein
the second control unit acquires an image of a tool or apparatus involved in work to be carried out using the first display device, as the image of the operating body corresponding to the operation detected by the operation detection unit, generates the guide information including the acquired image of the operating body, and causes the second communication unit to transmit the guide information.

10. The display system according to claim 1 , wherein
the first control unit generates guide target information on the basis of the pickup image picked up by the first image pickup unit and causes the first communication unit to transmit the guide target information to the second display device, and
the second control unit causes the second communication unit to receive the guide target information from the first display device, causes the second display unit to display an image on the basis of the guide target information, and generates the guide information including information indicating an operation detected by the operation detection unit while the image based on the guide target information is displayed.

11. The display system according to claim 10 , wherein
the second display device has a second image pickup unit which picks up an image of a range including at least a part of a detection area detected by the operation detection unit, and
the second control unit generates information indicating an operation detected by the operation detection unit on the basis of a pickup image picked up by the second image pickup unit and generates the guide information including the generated information.

12. The display system according to claim 1 , wherein
the second control unit generates the guide information including an image of an operating body corresponding to an operation detected by the operation detection unit.

13. The display system according to claim 1 , wherein
the first control unit causes the first display unit to display an image which gives guidance on an operation to an operator operating the first display device, on the basis of the guide information received from the second display device.

14. The display system according to claim 1 , wherein
the first display device has an external information detection unit which is formed as a separate unit from the first display unit and which detects information,
the first control unit causes the first communication unit to transmit processing information including the information detected by the external information detection unit to the second display device, and
the second control unit causes the second communication unit to receive the processing information from the first display device, and causes the second display unit to display an image based on the processing information.

15. The display system according to claim 14 , wherein
the external information detection unit includes at least one of a reading unit which reads information formed as an image and a motion detection unit having a motion sensor.

16. The display system according to claim 14 , wherein
the external information detection unit includes a third image pickup unit formed as a separate unit from the first image pickup unit,
the first control unit causes the first communication unit to transmit, to the second display device, processing information including a pickup image picked up by the third image pickup unit, and
the second control unit causes the second display unit to display the pickup image picked up by the third image pickup unit included in the processing information received by the second communication unit from the first display device.

17. The display system according to claim 16 , wherein
the first control unit causes the first communication unit to transmit, to the second display device, processing information including the pickup image picked up by the first image pickup unit and the pickup image picked up by the third image pickup unit, and
the second c

Assignees

• Seiko Epson Corp

Inventors

• Takano Masahide
• Yamazaki Akio
• Kobayashi Shinichi

Classifications

• G09G3/003

  to produce spatial visual effects · CPC title

• G09G3/002

  to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT · CPC title

• G06F2200/1637

  Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title