Image processing apparatus, image processing method, and data structure of image file

Patent metadata

Field	Value
Publication number	US-9697638-B2
Application number	US-201214344119-A
Country	US
Kind code	B2
Filing date	Jun 11, 2012
Priority date	Sep 22, 2011
Publication date	Jul 4, 2017
Grant date	Jul 4, 2017

Abstract

Two sets of image data, a first image and a second image, are prepared as image data. If image controlling information is received, an image setting controlling section determines, on the basis of this information, area dividing information which allocates one of the first image and the second image to each of the areas into which an image plane is divided in the same coordinate system. A decoding section decodes the two sets of image data for the respective first and second image that were loaded into a main memory, determines which image data to adopt for each pixel based on the area dividing information, and writes the adopted image data to a buffer memory. The decoding process and writing process are carried out in tile image units of a predetermined size using a working memory.

First claim

The invention claimed is:

1. An image processing apparatus, comprising:
an image data storage unit in which data of a plurality of images having a common coordinate system are stored;
an image setting controlling section configured to determine area dividing information which allocates, to each area into which an image plane is divided in the coordinate system, one of the data of the plural images stored in the image data storage unit,
wherein the area dividing information includes information which maps, for each of the areas, the plural image data and alpha values representative of transparencies of the plural image data to each other;
a decoding section configured to determine, based on the area dividing information, data to be adopted from among decoded data of the images for individual pixels and write the adopted data into a buffer memory corresponding to the image plane to produce a display image in which part of the plural images exist in a mixed manner and another part is hidden,
wherein the unhidden part of the image is gradually increased in response to a change in a user status,
wherein the decoding section synthesizes, where the area dividing information has the alpha values set therein, the decoded data of the images for individual pixels based on the alpha values and writes the synthesized data into the buffer memory corresponding to the image plane,
wherein said image processing apparatus is configured to perform a switching operation that switches from displaying a first image to displaying a second image when a user moves a display area that defines a user viewpoint into a predefined link area of said first display image, wherein said link area is defined by a frame parameter stored in a data structure comprising four different fields, including a link source image frame field that includes the frame parameter, a valid scale range field, a link destination file field that designates the second image, and a link destination image frame field that designates the display area in the second image after image switching occurs; and
a display image processing section configured to output data of the display image to a display apparatus.

2. The image processing apparatus according to claim 1 , wherein
the image setting controlling section receives image controlling information for determination of a timing at which an image is to be changed from the outside and updates the area dividing information based on the received information, and
the decoding section changes the display image in response to the updating of the area dividing information.

3. The image processing apparatus according to claim 2 , wherein the image setting controlling section receives information relating to a degree of progress of a game being executed separately as the image controlling information.

4. The image processing apparatus according to claim 1 , wherein the decoding section decodes the data of the plural images, temporarily stores the decoded data into individually corresponding working memories, and then repeats a process of reading out the data to be adopted from the working memories and writing the data to be adopted into the buffer memory based on the area dividing information in a unit of an area of each of tile images into which the image plane is divided in a predetermined size to produce the display image.

5. The image processing apparatus according to claim 1 , wherein said first display image resides in a first tier of a tree data structure and comprises one or more predefined areas each linked to a corresponding image in a second tier of said tree data structure.

6. The image processing apparatus according to claim 5 , wherein said corresponding image has a different resolution than said first display image.

7. The image processing apparatus according to claim 5 , wherein said corresponding image represents a different image than said first display image.

8. The image processing apparatus according to claim 5 , wherein each image in said second tier comprises one or more predefined areas each linked to corresponding image in a subsequent tier of said tree data structure.

9. The image processing apparatus according to claim 5 , wherein a last tier of said tree data structure comprises leaf nodes, wherein each image in a next-to-last tier comprises one or more predefined areas each linked to a corresponding image in said last tier of said tree data structure.

10. The image processing apparatus according to claim 9 , wherein images in said leaf nodes are traversed sequentially and an image in a predetermined leaf node comprises a predefined area with a return link to the image in the next-to-last tier that was the source of the link to the image in said last tier.

11. The image processing apparatus according to claim 10 , wherein an image in a different predetermined leaf node comprises a predefined area with a link to an image in the next-to-last tier that was not the source of the link to the image in said last tier.

12. The image processing apparatus according to claim 1 , wherein at least one content file is stored in said image data storage unit, said content file comprises:
image data for at least said first and second display images, said image data residing in nodes of a data structure; and
link setting files comprising link information defining a link relationship between said predefined area of said first display image and said second display image.

13. The image processing apparatus according to claim 1 , wherein image data of images estimated to be required later are loaded into said buffer memory of said image processing apparatus.

14. An image processing method, comprising the steps of:
reading out and decoding data of a plurality of images having a common coordinate system from a storage apparatus;
determining area dividing information which allocates, to each of areas into which an image plane is divided in the coordinate system, one of the data of the plural images, wherein the area dividing information includes information which maps, for each of the areas, the plural image data and alpha values representative of transparencies of the plural image data to each other;
determining, based on the area dividing information, data to be adopted from among decoded data of the images for individual pixels and writing the determined data into a buffer memory to produce a display image in which part of the plural images exist in a mixed manner and another part is hidden,
wherein the unhidden part of the image is gradually increased in response to a change in a user status,
synthesizing, where the area dividing information has the alpha values set therein, the decoded data of the images for individual pixels based on the alpha values and writing the synthesized data into the buffer memory corresponding to the image plane;
performing a switching operation that switches from displaying a first image to displaying a second image when a user moves a display area that defines a user viewpoint into a predefined link area of said first display image, wherein said link area is defined by a frame parameter stored in a data structure comprising four different fields, including a link source image frame field that includes the frame parameter, a valid scale range field, a link destination file field that designates the second image, and a link destination image frame field that designates the display area in the second image after image switching occurs; and
outputting data of the display image to a display apparatus.

15. An apparatus comprising a microprocessor operating under the control of a computer program fo

Assignees

• Shinohara Takayuki
• Sony Corp
• Sony Interactive Entertainment Inc

Inventors

• Shinohara Takayuki

Classifications

• G09G2340/12

  Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels · CPC title

• G09G2340/14

  Solving problems related to the presentation of information to be displayed · CPC title

• G09G2340/10

  Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels · CPC title

• G09G2340/045

  Zooming at least part of an image, i.e. enlarging it or shrinking it · CPC title

• G09G5/14

  Display of multiple viewports · CPC title