Display device, control method for display device, and computer program

Patent metadata

Field	Value
Publication number	US-10018848-B2
Application number	US-201615092925-A
Country	US
Kind code	B2
Filing date	Apr 7, 2016
Priority date	Apr 21, 2015
Publication date	Jul 10, 2018
Grant date	Jul 10, 2018

Abstract

A virtual image display device configuring a display device includes a display section configured to display an image while enabling visual recognition of an outside scene. The virtual image display device includes an image pickup section configured to pickup an image in an image pickup range that overlaps a range visually recognized through the display section. The virtual image display device includes a coupling section including at least one movable section and configured to couple the image pickup section to the display section. The display device is capable of acquiring a motion amount in the movable section with a control section.

First claim

What is claimed is:

1. A display device comprising:
a display configured to electrically display an image while enabling visual recognition of real world outside scenery;
a camera configured to capture an image in an image pickup range that overlaps a range visually recognized through the display;
a coupling structure that includes at least one movable portion and that is configured to couple the camera to the display;
a sensor that detects a motion amount;
a memory that stores calibration data including a positional relationship between the camera and the display; and
a processor configured to:
derive another positional relationship between the camera and the display or a change in the positional relationship between the camera and the display, based at least on the detected motion amount, so as to update, in the memory, the calibration data containing the positional relationship between the camera and the display; and
adjust a display position of a virtual image in the display on the basis of the updated calibration data stored in the memory;

wherein the sensor is provided in the at least one movable portion and is configured to detect a motion amount in the movable portion as the detected motion amount.

2. The display device according to claim 1 , wherein the at least one movable portion includes a turnable turning portion, and the sensor detects a turning amount in the turnable turning portion.

3. The display device according to claim 1 , wherein the at least one movable portion is configured to be capable of moving stepwise, and the sensor detects the motion in the at least one movable portion stepwise.

4. The display device according to claim 1 , further comprising a driving structure configured to move the at least one movable portion,
wherein the processor is further configured to:
acquire a motion amount in the movable portion based at least on a motion amount of the driving structure.

5. The display device according to claim 4 , wherein the driving structure moves the movable section stepwise.

6. A display device comprising:
a display configured to electrically display an image for display while enabling visual recognition of real world outside scenery;
a camera configured to capture an image in an image pickup range that overlaps a range visually recognized through the display;
a coupling structure that includes at least one movable portion and that is configured to couple the camera to the display;
a first sensor configured to detect a movement of the display;
a second sensor configured to detect a movement of the camera;
a memory that stores calibration data including a positional relationship between the camera and the display; and
a processor configured to: derive another positional relationship between the camera and the display or a change in the another positional relationship between the camera and the display, based at least on the detected movement of the display and the detected movement of the camera, so as to update, in the memory, the calibration data containing the positional relationship between the camera and the display stored in advance.

7. The display device according to claim 6 , wherein the first sensor is a first inertial sensor fixed to the display, and the second sensor is a second inertial sensor fixed to the camera.

8. The display device according to claim 6 , further comprising:
a third sensor, which is a motion-amount detecting sensor, provided in the at least one movable portion and that is configured to detect a motion amount in the at least one movable portion,
wherein the processor is further configured to detect the positional relationship between the camera and the display based at least on the detected movement of the display, the detected movement of the camera, and the detected motion amount of the at least one movable portion.

9. A control method for a display device, the control method comprising:
controlling the display device,
wherein the display device comprises:
a display configured to electrically display an image for display while enabling visual recognition of a real world outside scene;
a camera configured to capture an image in an image pickup range of the camera that overlaps a range visually recognized through the display;
a coupling structure that includes at least one movable portion and that is configured to couple the camera to the display;
a sensor that detects a motion amount, and
a memory that stores calibration data including a positional relationship between the camera and the display, and

the controlling of the display device comprises:
deriving another positional relationship between the camera and the display or a change in the another positional relationship between the camera and the display, based at least on the detected motion amount, so as to update, in the memory, the calibration data containing the positional relationship between the camera and the display; and
adjusting a display position of a virtual image in the display on the basis of the updated calibration data stored in the memory;

wherein the sensor is provided in the at least one movable portion and is configured to detect a motion amount in the movable portion as the detected motion amount.

10. A control method for a display device, the control method comprising:
controlling the display device,
wherein the display device comprises:
a display configured to an image for display while enabling visual recognition of a real world outside scene;
a camera configured to capture an image in an image pickup range of the camera that overlaps a range visually recognized through the display;
a coupling structure that includes at least one movable portion and that is configured to couple the camera to the display;
a first sensor configured to detect a movement of the display; and
a second sensor configured to detect a movement of the camera; and
a memory that stores calibration data including a positional relationship between the camera and the display, and

the controlling of the display device comprises:
deriving another positional relationship between the camera and the display or a change in the another positional relationship between the camera and the display, based at least on the detected movement of the display and the detected movement of the camera, so as to update, in the memory, the calibration data containing the positional relationship between the camera and the display stored in advance.

11. A non-transitory computer readable medium comprising computer program instructions that, when executed by a processor of a display device, cause the processor of the display device to:
control the display device,
wherein the display device includes:
a display configured to electrically display an image for display while enabling visual recognition of a real world outside scene;
a camera configured to capture an image in an image pickup range of the camera that overlaps a range visually recognized through the display;
a coupling structure that includes at least one movable portion and that is configured to couple the camera to the display;
a sensor that detects a motion amount; and
a memory that stores calibration data including a positional relationship between the camera and the display, and

the computer program instructions, when executed by the processor of the display device, cause the processor of the display device to control the display device to:
derive another positional relationship between the camera and the display or a change in the another positional relationship between the camera and the display, based at least on the detected motion amount, so as to update, in the memory, the ca

Assignees

• Seiko Epson Corp

Inventors

• CHENCHEV Margarit
• Fu Guoyi
• Li Jia
• Sato Shinya

Classifications

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G02B27/0176

  characterised by mechanical features · CPC title

• G02B2027/0154

  with movable elements · CPC title