Information processing device and information processing method

Patent metadata

Field	Value
Publication number	US-9250704-B2
Application number	US-200913255351-A
Country	US
Kind code	B2
Filing date	Dec 18, 2009
Priority date	Mar 25, 2009
Publication date	Feb 2, 2016
Grant date	Feb 2, 2016

Abstract

First a standard image to which a link is defined is displayed. If a user operates a input device and if the viewpoint enters into the first link boundary, and if the information indicating that a resume operation is required does not exist the first frame of moving image data is read out and displayed on the display device as a still image. If the viewpoint enters into the second link boundary, playing back and displaying of the moving image and is started. If the viewpoint moves out from the second link boundary, a frame displayed when the playback of the moving image is suspended is displayed as a still image and the resume point is stored. If the viewpoint moves out of the first link boundary, a standard image is displayed.

First claim

The invention claimed is:

1. An information processing device comprising:
a storage device configured to store hierarchical data that comprises image data of different resolutions that is hierarchized in order of resolution;
an input information acquisition unit configured to acknowledge a user request for movement of a viewpoint in a virtual space which is defined by an image plane and a distance from the image plane;
a display image processing unit configured to create a display image from the hierarchical data by changing an area to be displayed in response to the request to move the viewpoint; and
an object execution unit configured to execute a process that is associated with a predetermined area of an image, when the viewpoint meets a condition for activating the process,
wherein the condition is defined by the positional relationship between the predetermined area defined on the image plane and an area that is determined by the viewpoint and that is displayed on a screen,
wherein at a plurality of viewpoint positions at which the display image includes the predetermined area, the predetermined area is displayed in emphasis indicating selection availability, and at other viewpoint positions at which the display image includes the predetermined area, the predetermined area is not displayed in the emphasis;
wherein when the user request includes a selection of the predetermined area when the predetermined area is displayed in emphasis, the viewpoint is moved to the predetermined area such that the condition is met; and
wherein the emphasis includes at least one of highlighting the predetermined area and changing one or more colors of the predetermined area.

2. The information processing device according to claim 1 , wherein the condition requires that the ratio of a part of the area displayed on the screen, the part protruding from the predetermined area, is equal to or less than a predefined value.

3. The information processing device according to claim 1 , wherein the condition requires that the ratio of a part of the predetermined area to the predetermined area, the part protruding from the area displayed on the screen, is equal to or less than a predefined value.

4. The information processing device according to claim 1 , wherein when the viewpoint meets the condition defined in association with the predetermined area, the object execution unit reads from a memory at least one of either moving image data or audio data that is associated with the predetermined area, plays back the moving image data or audio data, and outputs the moving image data or audio data.

5. The information processing device according to claim 4 , wherein
when the viewpoint meets a first condition defined in association with the predetermined area, the object execution unit plays back one piece of frame data included in the moving image data and outputs the frame data, and
when the viewpoint further meets a second condition defined in association with the predetermined area, the object execution unit outputs the moving image data that is played-back.

6. The information processing device according to claim 4 , wherein
when the viewpoint departs from the condition, the object execution unit suspends the playback of the data that have been being played back until that moment and stores a suspension point into the memory, and
when the viewpoint meets the condition defined as being associated with the same predetermined area again, the object execution unit starts playing back the data from the suspension point and outputs the data.

7. The information processing device according to claim 6 , wherein when a same moving image or same audio data is associated with a plurality of areas, the object execution unit stores into the memory a suspension point common for the plurality of areas.

8. The information processing device according to claim 1 , wherein when the viewpoint meets a condition defined in association with the predetermined area, the object execution unit applies a display on the predetermined area, the display designating that a site on a network associated to the predetermined area is accessible.

9. An information processing method comprising:
reading from a memory hierarchical data that comprises image data of different resolutions that is hierarchized in order of resolution and outputting the data to a display device;
acknowledging a user request for movement of a viewpoint in a virtual space which is defined by an image plane and a distance from the image plane;
changing an area to be displayed on the display device in response to the request to move the viewpoint; and
executing a process defined as being associated with a predetermined area of an image, when the viewpoint meets a condition for activating the process,
wherein the condition is defined by the positional relationship between the predetermined area defined on the image plane and an area that is determined by the viewpoint and that is displayed on a screen,
wherein at a plurality of viewpoint positions at which the display image includes the predetermined area, the predetermined area is displayed in emphasis indicating selection availability, and at other viewpoint positions at which the display image includes the predetermined area, the predetermined area is not displayed in the emphasis;
wherein when the user request includes a selection of the predetermined area when the predetermined area is displayed in emphasis, the viewpoint is moved to the predetermined area such that the condition is met; and
wherein the emphasis includes at least one of highlighting the predetermined area and changing one or more colors of the predetermined area.

10. The information processing method according to claim 9 , wherein the executing comprises:
when the viewpoint meets a first condition defined as being associated with the predetermined area, playing back and outputting one piece of frame data, which is included in moving image data that is associated with the predetermined area; and
when the viewpoint further meets a second condition defined as being associated with the predetermined area, outputting the moving image data that is played-back.

11. A computer program embedded in a non-transitory, computer-readable recording medium, comprising:
a module configured to read from a memory hierarchical data that comprises image data of different resolutions that is hierarchized in order of resolution and configured to display the data on a display device;
a module configured to acknowledge a user request for movement of a viewpoint in a virtual space which is defined by an image plane and a distance from the image plane;
a module configured to change an area to be displayed on the display device in response to the request to move the viewpoint; and
a module configured to execute a process defined as being associated with a predetermined area of an image, when the viewpoint meets a condition for activating the process,
wherein the condition is defined by the positional relationship between the predetermined area defined on the image plane and an area that is determined by the viewpoint and that is displayed on a screen;
wherein at a plurality of viewpoint positions at which the display image includes the predetermined area, the predetermined area is displayed in emphasis indicating selection availability, and at other viewpoint positions at which the display image includes the predetermined area, the predetermined area is not displayed in the emphasis;
wherein when the user request includes a selection of the predetermined area when the predetermined area is displayed in emphasis, the viewpoint is moved to the predetermined area such that t

Assignees

• Shinohara Takayuki
• Morisada Hidehiko
• Lin Yute
• Sony Corp
• Sony Computer Entertainment Inc

Inventors

• Shinohara Takayuki
• Morisada Hidehiko
• Lin Yute

Classifications

• G09G2340/04

  Changes in size, position or resolution of an image · CPC title

• H04N1/3935

  with modification of image resolution, i.e. determining the values of picture elements at new relative positions · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title