Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method

Patent metadata

Field	Value
Publication number	US-9485484-B2
Application number	US-201313869401-A
Country	US
Kind code	B2
Filing date	Apr 24, 2013
Priority date	Jun 1, 2012
Publication date	Nov 1, 2016
Grant date	Nov 1, 2016

Abstract

An example information processing device displays a partial area of a panoramic video on a display device. The information processing device obtains range information with which it is possible to identify a display range of the panoramic video to be displayed and/or to identify a position within the display range. The obtained range information is information regarding a display range determined based on an input made on a predetermined input device while the panoramic video is played. Where the panoramic video is output using the display device, the information processing device outputs the panoramic video while changing output content thereof in accordance with the obtained range information.

First claim

What is claimed is:

1. A non-transitory computer-readable storage medium comprising an information processing program to be executed by a computer of an information processing device for displaying a partial area of a panoramic video on a display device, wherein the information processing program instructs the computer to:
obtain range information determined based on an input made on a predetermined input device while the panoramic video is played, the range information indicating history of a display range of the panoramic video at a point in time the panoramic video was viewed by a user, wherein it is possible with the range information to identify the display range of the panoramic video to be displayed and/or to identify a position within the display range; and
output at least a part of the panoramic video while changing output content thereof in accordance with the obtained range information that indicates the history of the display range of the panoramic video at the point in time the panoramic video was viewed by the user.

2. The storage medium according to claim 1 , wherein
the obtained range information is stored in a storage device as history information indicating the history of the display range of the panoramic video viewed by the user; and
information based on the history information is output after the history information is stored.

3. The non-transitory computer-readable storage medium according to claim 2 , wherein the history information stored in the storage device is information in which time information, related to the point in time the panoramic video was viewed by the user, is associated with range information, wherein it is possible with the time information to identify a playback time point in the panoramic video, and wherein it is possible with the range information to identify a display range at the playback time point and/or a position within the display range.

4. The non-transitory computer-readable storage medium according to claim 3 , wherein
the information processing program further instructs the computer to determine the display range based on a user input; and
a panoramic video of a display range determined based on the user input is displayed on the display device, and history-related information produced based on the history information is output.

5. The non-transitory computer-readable storage medium according to claim 4 , wherein the history-related information output together with the panoramic video represents a direction of the display range identified by the range information included in the history information with respect to a current display range.

6. The non-transitory computer-readable storage medium according to claim 4 , wherein the output history-related information represents a display frequency for a predetermined range in the panoramic video obtained from the history information.

7. The non-transitory computer-readable storage medium according to claim 6 , wherein the history-related information represents a display frequency determined in accordance with the number of pieces of history information that satisfy a predetermined condition regarding the time information and the range information.

8. The non-transitory computer-readable storage medium according to claim 6 , wherein the history-related information represents a display frequency determined in accordance with the number of pieces of range information that satisfy a predetermined condition regarding a position on a panoramic image.

9. The non-transitory computer-readable storage medium according to claim 4 , wherein
the panoramic video is stored in the storage device together with object information representing a position and/or a range of an object appearing in the panoramic video; and
history-related information output together with the panoramic video represents a display frequency of the object calculated based on the object information and the history information.

10. The non-transitory computer-readable storage medium according to claim 2 , wherein when playback of the panoramic video is completed, a panoramic image of a display range determined based on the range information stored as the history information during the playback is displayed on the display device as a still image or a video.

11. The non-transitory computer-readable storage medium according to claim 10 , wherein
range information representing the display range and/or a position within the display range is obtained as the history information;
the information processing program further instructs the computer to determine whether or not an object appearing in the panoramic video is included in a display range identified by the history information so as to select an object to be output based on a result of the determination; and
a panoramic image including the selected object therein is displayed on the display device as a still image or a video.

12. The non-transitory computer-readable storage medium according to claim 10 , wherein
the information processing program further instructs the computer to determine whether or not an object is included within a display range during playback of the panoramic video so as to select an object to be output based on a result of the determination;
information representing the selected object is obtained as the range information; and
a panoramic image of a display range including therein the object represented by the range information is displayed on the display device as a still image or a video.

13. The non-transitory computer-readable storage medium according to claim 10 , wherein
the history information stored in the storage device is information in which time information, related to the point in time the panoramic video was viewed by the user, is associated with range information, wherein it is possible with the time information to identify a playback time point in the panoramic video, and wherein it is possible with the range information to identify a display range at the playback time point and/or a position within the display range; and
a panoramic image of a display range determined based on a plurality of pieces of history information is displayed on the display device as a still image or a video.

14. The non-transitory computer-readable storage medium according to claim 2 , wherein range information regarding a panoramic video played on the display device is obtained.

15. The non-transitory computer-readable storage medium according to claim 2 , wherein range information regarding a panoramic video played on another display device different from the display device is obtained.

16. The non-transitory computer-readable storage medium according to claim 15 , wherein the information processing program further instructs the computer to:
determine the display range based on an input made on the predetermined input device while the panoramic video is displayed on the display device; and
display the panoramic video of the determined display range on the other display device while the panoramic video is displayed on the display device.

17. The non-transitory computer-readable storage medium according to claim 1 , wherein a panoramic video of a display range determined based on the range information is displayed on the display device.

18. The non-transitory computer-readable storage medium according to claim 1 , wherein an image representing a viewing direction corresponding to a display range or a position based on the range information is displayed on the display device.

19. The non-transitory computer

Assignees

• Suzuki Toshiaki
• Kawase Shigefumi
• Nintendo Co Ltd
• Hal Laboratory Inc

Inventors

• Suzuki Toshiaki
• Kawase Shigefumi

Classifications

• H04N5/76 Primary

  Television signal recording · CPC title

• H04N21/6587

  Control parameters, e.g. trick play commands, viewpoint selection · CPC title

• G11B27/005

  Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783) · CPC title

• G11B20/10

  Digital recording or reproducing · CPC title

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title