Display system

Patent metadata

Field	Value
Publication number	US-10334169-B2
Application number	US-201615213939-A
Country	US
Kind code	B2
Filing date	Jul 19, 2016
Priority date	Aug 3, 2015
Publication date	Jun 25, 2019
Grant date	Jun 25, 2019

Abstract

When a movement of an image pickup section detected by a sensor satisfies a predetermined condition, a data processing section sets, in a reference cutout position set in advance, a specified position of a cutout region for cutting out an image and generates the image data for display. When the movement does not satisfy the predetermined condition, the data processing section shifts the specified position from the reference cutout position in a direction opposite to the movement of the image pickup section from a reference position and generates the image data for display.

First claim

What is claimed is:

1. A display system for use with a user, the display system comprising:
a camera configured to record an image;
a sensor configured to detect a movement of the camera;
and a processor programmed to:
cut out a predetermined cutout region of the image and generate image data to be displayed, including:
setting a reference cutout position for specifying a position of the cutout region based on a region of attention that is determined based on a direction of a visual line or an opening/closing state of at least one pupil of the user,
when the detected movement of the camera satisfies a predetermined condition: (i) setting a specified position in the reference cutout position for cutting out the image, (ii) cutting out the cutout region of the image at the specified position, and (iii) generating the image data,
when the detected movement does not satisfy the predetermined condition: (1) shifting the specified position from the reference cutout position in a direction opposite to the movement of the camera from a reference position, and (2) generating the image data; and
when a second image represented by a second version of image data for display generated when the predetermined condition is satisfied is displayed on the display device after a first image represented by a first version of the image data for display generated when the predetermined condition is not satisfied, (a) generating image data for interpolation display for interpolating a difference between the first image and the second image, and (b) inserting the image data for interpolation display between the first and second versions of image data for display arranged in time series,
curtailing a plurality of images picked up by the camera and generated at a first frame rate and transmitting the image data for display at a second frame rate lower than the first frame rate,
selecting image data for interpolation serving as the image data located between image data serving as a base of the first version of image data for display and image data serving as a base of the second version of image data for display and scheduled to be curtailed at the second frame rate,
cutting out an image represented by the image data for interpolation in the cutout region centering on the reference cutout position, and
generating the image data for interpolation display; and

transmit the generated image data to a display that displays the generated image data.

2. The display system according to claim 1 , wherein the predetermined condition is a condition in which a moving amount of the camera from the reference position is continuously equal to or larger than a predetermined threshold at a predetermined time or more.

3. The display system according to claim 1 , wherein the processor sets, with respect to image data serving as a base of at least a singularity of the image data for display located, in time series, between a first version of the image data serving as a base of the first version of image data for display and a second version of image data serving as a base of the second version of image data for display, the specified position to interpolate the movement of the camera from the generation of the first version of image data to the generation of the second version of image data and generates the image data for interpolation display.

4. The display system according to claim 1 , further comprising:
a distance detecting sensor configured to detect a distance between the camera and a predetermined target object included in the image, wherein
the processor is further programmed to:
change a size of the cutout region according to the distance detected by the distance detecting section.

5. The display system according to claim 4 , wherein the processor sets the cutout region larger as the distance is larger.

6. The display system according to claim 4 , wherein the distance detecting sensor detects the distance by comparing an actual size of the predetermined target object and a size of the predetermined target object in the image.

7. The display system according to claim 1 , wherein same identification information is given to each of image data representing the image and detection information of the sensor at time when the image data is generated.

8. The display system according to claim 1 , further comprising
an information processing device configured to acquire the image recorded by the camera, wherein
the processor is provided in the information processing device.

9. The display system according to claim 1 , further comprising
an image display device including a display configured to display a virtual image and capable of transmitting an image of an outside world, wherein
the processor is provided in the image display device.

10. The display system according to claim 1 , further comprising
a display device configured to display an image for display represented by the image data for display, wherein
the processor is provided in the display device.

11. A display system for use with a user, the display system comprising:
a camera configured to record an image;
a sensor configured to detect a movement of the camera; and
a processor configured to:
cut out a predetermined cutout region of the image and generate image data for display, including:
when the movement of the camera detected by the sensor satisfies a predetermined condition: (i) set a specified position in the reference cutout position, (ii) cutting out the image based on the specified position, and (iii) generate the image data for display, and
when the movement does not satisfy the predetermined condition, shift the specified position from the reference cutout position in a direction opposite to the movement of the camera from a reference position and generate the image data for display; and

transmit the image data for display to a display device, wherein:

when a second image represented by a second version of image data for display generated when the predetermined condition is satisfied is displayed on the display device after a first image represented by a first version of the image data for display generated when the predetermined condition is not satisfied, generate image data for interpolation display for interpolating a difference between the first image and the second image, and insert the image data for interpolation display between the first and second versions of image data for display arranged in time series.

12. A display system for use with a user, the display system comprising:
a camera configured to record an image;
a sensor configured to detect a movement of the camera;
a distance sensor configured to detect a distance between the camera and a predetermined target object included in the image; and
a processor configured to:
change a size of a predetermined cutout region of the image according to the distance detected by the distance sensor,
cut out the cutout region and generate image data for display, including:
when the movement of the camera detected by the sensor satisfies a predetermined condition: (i) set a specified position in the reference cutout position, (ii) cutting out the image based on the specified position, and (iii) generate the image data for display, and
when the movement does not satisfy the predetermined condition, shift the specified position from the reference cutout position in a direction opposite to the movement of the camera from a reference position and generate the image data for display; and

transmit the image data for display to a display device.

Assignees

• Seiko Epson Corp

Inventors

• Kobayashi Shinichi

Classifications

• G02B2027/0141

  characterised by the informative content of the display · CPC title

• G02B27/017 Primary

  Head mounted · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title