Method of controlling head-mounted display system

Patent metadata

Field	Value
Publication number	US-9779702-B2
Application number	US-201615296345-A
Country	US
Kind code	B2
Filing date	Oct 18, 2016
Priority date	Aug 27, 2015
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

A method for providing, to a head-mounted display, a virtual space into which a user is immersed includes the step of generating a virtual space into which a user is immersed. A basic sightline of the user is determined. A main image is selected from among a plurality of display objects. The main image is caused to be displayed in the virtual space in such a manner as to be associated with the basic sightline. The virtual space is outputted to the head-mounted display. The basic sightline moves in response to a motion of the head-mounted display in a pitch direction, in a yaw direction, and in a roll direction. The main image is so placed as to be tilted such that the basic sightline forms an angle of smaller than 90° with the main image in a plane including the yaw direction and the roll direction.

First claim

The invention claimed is:

1. A method for providing, to a head-mounted display with use of a control circuit and a storage section, a virtual space into which a user is immersed, the control circuit being configured to carry out the steps of:
generating a virtual space into which a user is immersed;
determining a basic sightline of the user;
selecting a main image from among a plurality of display objects;
causing the main image to be displayed in the virtual space in such a manner as to be associated with the basic sightline; and
outputting the virtual space to the head-mounted display,
the basic sightline moving in response to a motion of the head-mounted display in a pitch direction, in a yaw direction, and in a roll direction,
the main image being so placed as to be tilted such that the basic sightline forms an angle of smaller than 90° with the main image in a plane including the yaw direction and the roll direction,
the virtual space being a three-dimensional space generated by placing, along a hemispherical plane, a panoramic image stored in the storage section, the plurality of display objects being placed along the hemispherical plane.

2. The method according to claim 1 , wherein
the main image contains two or more of the display objects making up a given content, wherein the two or more of the display objects are consecutive display objects.

3. The method according to claim 2 , wherein
the plurality of display objects are placed in a manner like a spiral along the hemispherical plane, and two or more of the display objects which two or more are placed adjacent to each other in a circumferential direction of the spiral are consecutive display objects.

4. The method according to claim 2 , wherein
the control circuit is configured to further carry out the steps of:
accepting a first action from the user; and,
in response to the first action, causing a display object previously displayed in a main view to be displayed in one of sub-views without an emphasis in the virtual space, and causing a display object proceeding to or subsequent to the display object previously displayed in the main view to be displayed in the main view in the virtual space.

5. The method according to claim 4 , wherein
the control circuit is configured to further carry out the step of:
making a shift to a first mode in which the basic sightline is associated with a main image displayed in the main view,
wherein the first action is accepted when a given user's operation is accepted in the first mode.

6. The method according to claim 5 , wherein
in a case where a movement of the basic sightline occurs in the first mode, the main image is moved from one location to another location in pursuit of the basic sightline, and none of the display objects is placed in the location from which the main image is moved in the virtual space.

7. The method according to claim 1 , wherein
the main image is so placed as to be tilted such that the basic sightline forms an angle of larger than 60° but smaller than 85° with the main image in the plane including the yaw direction and the roll direction.

8. The method according to claim 1 , wherein
the main image is moved in response to movement of the basic sightline, while maintaining an angular relationship between the basic sightline and the main image.

9. The method according to claim 1 , wherein
the basic sightline intersects a basic position of the main image, and
the basic position is located at a position shifted in the yaw direction from a center of the main image.

10. The method according to claim 1 , wherein
a starting point of the basic sightline intersects a normal to the main image.

11. The method according to claim 1 , further comprising the steps of:
setting a basic region based on the main image; and
in a case where the basic sightline is moved to a position falling outside the basic region, moving the main image so that the basic sightline is located within the basic region.

12. The method according to claim 11 , wherein
the basic region is so set as to encompass the main image.

13. The method according to claim 1 , wherein
the control circuit is configured to further carry out the steps of:
accepting a second action from the user; and,
in response to the second action, causing a selected one of the display objects displayed in sub-views without emphasis in the virtual space to be displayed in a main view in the virtual space, and causing a display object previously displayed in the main view to be displayed in one of the sub-views in the virtual space.

14. The method according to claim 13 , wherein
the control circuit is configured to further carry out the step of:
making a shift to a second mode in which the basic sightline is not associated with a main image displayed in the main view,
wherein the second action is accepted when a given user's operation is accepted in the second mode.

15. The method according to claim 1 , wherein
the control circuit is configured to further carry out the steps of:
making a shift to a first mode in which the basic sightline is associated with a main image displayed in a main view; and
making a shift to a second mode in which the basic sightline is not associated with the main image displayed in the main view,
wherein a mode is switchable between the first mode and the second mode.

16. The method according to claim 1 , wherein
the control circuit is configured to further carry out the steps of:
causing the display objects other than a display object displayed in a main view to be displayed in sub-views without emphasis in the virtual space;
causing a selected one of the display objects displayed in the sub-views in the virtual space to be displayed in the main view in the virtual space; and
causing a display object previously displayed in the main view to be displayed in one of the sub-views in the virtual space, while updating displays of display objects previously displayed in the sub-views in the virtual space.

17. The method according to claim 16 , wherein
the control circuit is configured to further carry out the step of:
in updating displays of the display objects previously displayed in the sub-views in the virtual space, performing processing for reducing visual effects on content items shown by the display objects.

18. The method according to claim 17 , wherein
the control circuit is configured such that
during the processing for reducing visual effects of the display objects, a visual effect of the virtual space image is not reduced.

19. A non-transitory computer-readable recording medium in which a computer program is stored
the computer program being a program for providing, to a head-mounted display with use of a control circuit and a storage section, a virtual space into which a user is immersed, the program being configured to cause the control circuit to carry out the steps of:
generating a virtual space into which the user is immersed;
determining a basic sightline of the user;
selecting a main image from among a plurality of display objects;
causing the main image to be displayed in the virtual space in such a manner as to be associated with the basic sightline; and
outputting the virtual space to the head-mounted display,
the basic sightline moving in response to a motion of the head-mounted display in a pitch direction, in a yaw direction, and in a roll direction,
the main image being so placed as to be tilted such that the basic sightline forms an angle of smaller than 90

Assignees

• Colopl Inc

Inventors

• Matsuyama Satoshi

Classifications

• G09G5/00

  Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) · CPC title

• G09G2340/0464

  Positioning · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G09G5/377

  for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title