Image processing system for multiple viewpoint parallax image group

Patent metadata

Field	Value
Publication number	US-9479753-B2
Application number	US-201213552056-A
Country	US
Kind code	B2
Filing date	Jul 18, 2012
Priority date	Jul 19, 2011
Publication date	Oct 25, 2016
Grant date	Oct 25, 2016

Abstract

An image processing system according to an embodiment includes a stereoscopic display device, a receiving unit, and a display controller. The stereoscopic display device displays a stereoscopic image that is capable of being viewed stereoscopically using a parallax image group as a plurality of parallax images generated by performing rendering processing on volume data as three-dimensional medical image data. The receiving unit receives a region of interest in the stereoscopic image. The display controller causes the stereoscopic display device to display the parallax image group that has been generated by performing the rendering processing on the volume data based on a plurality of viewpoint positions of which sight line directions intersect with one another at a position of the volume data that corresponds to the region of interest received by the receiving unit.

First claim

What is claimed is:

1. An image processing system, comprising:
a stereoscopic display configured to display a stereoscopic image that is capable of being viewed stereoscopically using a parallax image group as a plurality of parallax images generated by performing rendering processing on volume data being obtained from a scan of an object as three-dimensional medical image data; and
a processor configured to
receive a request to change a focus position on the stereoscopic image stereoscopically displayed on the stereoscopic display,
determine a position of the volume data corresponding to the changed focus position and determine new viewpoint positions of which sight line directions intersect with one another at the determined position of the volume data corresponding to the changed focus position, and
cause the stereoscopic display to display a new parallax image group that has been generated by performing the rendering processing on the volume data based on the determined new viewpoint positions, a focus of the new parallax image group being the determined position of the volume data corresponding to the changed focus position.

2. The image processing system according to claim 1 , wherein
the processor is further configured to generate the new parallax image group by performing the rendering processing on the volume data based on the determined new viewpoint positions; and
the processor causes the stereoscopic display to display the generated new parallax image group.

3. The image processing system according to claim 2 , further comprising a medical device that is used for a subject present in a three-dimensional space corresponding to a coordinate system of the volume data and on which a position sensor that acquires a position of the medical device in the three-dimensional space is provided, wherein
the processor receives a position of the medical device acquired by the position sensor as the changed focus position.

4. The image processing system according to claim 2 , wherein the processor generates a parallax image group including an image indicating the changed focus position.

5. The image processing system according to claim 2 , wherein the processor receives a predetermined three-dimensional region specified in a stereoscopic image space in which a stereoscopic image is displayed by the stereoscopic display as the changed focus position, and
the processor further determines a parallax angle at which a stereoscopic image is capable of being displayed in the received three-dimensional region, and performs the rendering processing on the volume data further based on the determined parallax angle to generate the new parallax image group.

6. The image processing system according to claim 1 , further comprising a memory configured to store a plurality of parallax image groups corresponding to predetermined positions that have been generated by changing the predetermined position and performing the rendering processing a plurality of times by the processor that performs the rendering processing on the volume data based on a plurality of viewpoint positions of which the sight line directions intersect with one another at the predetermined position, wherein
the processor acquires a parallax image group corresponding to the determined plurality of viewpoint positions from the memory, and causes the stereoscopic display to display the acquired parallax image group as the new parallax image group.

7. The image processing system according to claim 6 , further comprising a medical device that is used for a subject present in a three-dimensional space corresponding to a coordinate system of the volume data and on which a position sensor that acquires a position of the medical device in the three-dimensional space is provided, wherein
the processor receives a position of the medical device acquired by the position sensor as the changed focus position.

8. The image processing system according to claim 6 , wherein the processor generates a parallax image group including an image indicating the changed focus position.

9. The image processing system according to claim 1 , wherein the processor causes only a region corresponding to the vicinity of the changed focus position in the stereoscopic image to be displayed.

10. The image processing system according to claim 1 , wherein the stereoscopic display displays a cross-sectional image obtained from the volume data in parallel together with the stereoscopic image, and
the processor receives the request to change the focus position in the cross-sectional image.

11. The image processing system according to claim 1 , wherein the stereoscopic display displays a flat image on which a depth direction of the stereoscopic image is drawn out in parallel together with the stereoscopic image, and
the processor
receives the request to change the focus position, a size in the depth direction, or a display target region on the flat image,
determines a rendering condition on which the received request has been reflected, and
causes the stereoscopic display to display the new parallax image group generated from the volume data under the determined rendering condition on which the received request has been reflected.

12. An image processing device, comprising:
a stereoscopic display configured to display a stereoscopic image that is capable of being viewed stereoscopically using a parallax image group as a plurality of parallax images generated by performing rendering processing on volume data being obtained from a scan of an object as three-dimensional medical image data; and
a processor configured to receive a request to change a focus position on the stereoscopic image stereoscopically displayed on the stereoscopic display, determine a position of the volume data corresponding to the changed focus position and determine new viewpoint positions of which sight line directions intersect with one another at the determined position of the volume data corresponding to the changed focus position, and cause the stereoscopic display to display a new parallax image group that has been generated by performing the rendering processing on the volume data based on the determined new viewpoint positions, a focus of the new parallax image group being the determined position of the volume data corresponding to the changed focus position.

13. An image processing method by an image processing system including a stereoscopic display configured to display a stereoscopic image that is capable of being viewed stereoscopically using a parallax image group as a plurality of parallax images generated by performing rendering processing on volume data being obtained from a scan of an object as three-dimensional medical image data, the image processing method comprising:
receiving, by a processor, a request to change a focus position on the stereoscopic image stereoscopically displayed on the stereoscopic display;
determining a position of the volume data corresponding to the changed focus position and determining new viewpoint positions of which sight line directions intersect with one another at the determined position of the volume data corresponding to the changed focus position, and
causing, by the processor, the stereoscopic display to display a new parallax image group that has been generated by performing the rendering processing on the volume data based on the determined new viewpoint positions, a focus of the new parallax image group being the determined position of the volume data corresponding to the changed focus position.

14. A medical image diagnostic device, comprising:
a stereoscopic display configured t

Assignees

• Tsukagoshi Shinsuke
• Tsutsumi Takashi
• Taniguchi Akira
• Toshiba Medical Sys Corp

Inventors

• Tsukagoshi Shinsuke
• Tsutsumi Takashi
• Taniguchi Akira

Classifications

• H04N13/305

  using lenticular lenses, e.g. arrangements of cylindrical lenses · CPC title

• G02B30/27

  involving lenticular arrays · CPC title

• H04N13/349

  Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking (for viewing without the aid of special glasses using fly-eye lenses H04N13/307) · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• H04N13/117 Primary

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title