Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method

Patent metadata

Field	Value
Publication number	US-9749672-B2
Application number	US-201615245451-A
Country	US
Kind code	B2
Filing date	Aug 24, 2016
Priority date	Jun 1, 2012
Publication date	Aug 29, 2017
Grant date	Aug 29, 2017

Abstract

An example information processing device displays a partial area of a panoramic video on a display device. The information processing device obtains range information with which it is possible to identify a display range of the panoramic video to be displayed and/or to identify a position within the display range. The obtained range information is information regarding a display range determined based on an input made on a predetermined input device while the panoramic video is played. Where the panoramic video is output using the display device, the information processing device outputs the panoramic video while changing output content thereof in accordance with the obtained range information.

First claim

What is claimed is:

1. A non-transitory computer-readable storage medium comprising an information processing program to be executed by a computer of an information processing device for displaying a virtual image on a first display device, wherein the information processing program instructs the computer to:
obtain range information enabling identification of a display range and/or enabling identification of a position within the display range, wherein the display range is determined based on an input made on a predetermined input device in an environment where it is possible to obtain a virtual image regarding a virtual world having a range wider than a range to be displayed on a second display device, and where it is possible to display the virtual image on the second display device, and wherein the range information indicates history of a display range that has been displayed; and
output the virtual image to the first display device while changing output content thereof in accordance with the obtained range information indicating the history of the display range that has been displayed, wherein
the obtained range information is stored in a storage device as history information indicating the history of the display range that has been displayed,
information based on the history information is output after the history information is stored, and
the history information stored in the storage device is information, in which time information enabling identification of a time in the virtual image is associated with range information enabling identification of a display range at the time and/or a position within the display range.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein
the information processing program further instructs the computer to determine a display range of a virtual image in the first display device based on a user input; and
the virtual image of the display range determined based on the user input is displayed on the first display device, and history-related information produced based on the history information is output.

3. The non-transitory computer-readable storage medium according to claim 2 , wherein the history-related information output together with the virtual image represents a direction of the display range identified by the range information included in the history information with respect to a current display range in the first display device.

4. The non-transitory computer-readable storage medium according to claim 2 , wherein the output history-related information represents a display frequency for a predetermined range in the virtual image obtained from the history information.

5. The non-transitory computer-readable storage medium according to claim 4 , wherein the history-related information represents a display frequency determined in accordance with the number of pieces of history information that satisfy a predetermined condition regarding the time information and the range information.

6. The non-transitory computer-readable storage medium according to claim 1 , wherein when display of the virtual image is completed on the second display device, a virtual image of a display range determined based on the range information stored as the history information during the display is displayed on the first display device as a still image or a video.

7. The non-transitory computer-readable storage medium according to claim 6 , wherein
range information representing the display range and/or a position within the display range is obtained as the history information;
the information processing program further instructs the computer to determine whether or not an object appearing in the virtual image is included in a display range identified by the history information so as to select an object to be output based on a result of the determination; and
a virtual image including the selected object therein is displayed on the first display device as a still image or a video.

8. The non-transitory computer-readable storage medium according to claim 6 , wherein
the information processing program further instructs the computer to determine whether or not an object is included within a display range during display of the virtual image on the second display device so as to select an object to be output based on a result of the determination;
information representing the selected object is obtained as the range information; and
a virtual image of a display range including therein the object represented by the range information is displayed on the first display device as a still image or a video.

9. The non-transitory computer-readable storage medium according to claim 6 , wherein
a virtual image of a display range, determined based on a plurality of pieces of history information, is displayed on the first display device as a still image or a video.

10. The non-transitory computer-readable storage medium according to claim 1 , wherein the second display device is the same as the first display device.

11. The non-transitory computer-readable storage medium according to claim 1 , wherein the second display device is different from the first display device.

12. The non-transitory computer-readable storage medium according to claim 11 , wherein the information processing program further instructs the computer to:
determine the display range based on an input made on the predetermined input device while the virtual image is displayed on the second display device; and
display the virtual image of the determined display range on the first display device while the virtual image is displayed on the second display device.

13. The non-transitory computer-readable storage medium according to claim 1 , wherein a virtual image of a display range determined based on the range information is displayed on the first display device.

14. The non-transitory computer-readable storage medium according to claim 13 , wherein:
range information regarding a virtual image displayed on a second display device different from the first display device is obtained; and
the virtual image is displayed on the first display device while reducing a change in the display range determined based on the range information.

15. The non-transitory computer-readable storage medium according to claim 1 , wherein:
the obtained range information represents a position specified by a user while the virtual image is displayed on the second display device; and
an image representing a position on a virtual image determined based on the range information is displayed on the first display device together with the virtual image.

16. The non-transitory computer-readable storage medium according to claim 1 , wherein an image representing a viewing direction corresponding to a display range or a position based on the range information is displayed on the first display device.

17. The non-transitory computer-readable storage medium according to claim 1 , wherein an image representing a space represented by the virtual image and a position in the space corresponding to a position on the virtual image based on the range information is displayed on the first display device.

18. The non-transitory computer-readable storage medium according to claim 1 , wherein the range information is obtained from an external device via a network.

19. The non-transitory computer-readable storage medium according to claim 1 , wherein:
user information representing a user who has made an input regarding the range information is further obtained;

Assignees

• Suzuki Toshiaki
• Kawase Shigefumi
• Nintendo Co Ltd
• Hal Laboratory Inc

Inventors

• Suzuki Toshiaki
• Kawase Shigefumi

Classifications

• G11B27/322

  used signal is digitally coded · CPC title

• H04N21/41407

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• H04N9/87

  Regeneration of colour television signals (H04N9/80 takes precedence) · CPC title

• G11B27/005

  Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783) · CPC title