Illumination in rendering of anatomy with functional information

Patent metadata

Field	Value
Publication number	US-10354438-B2
Application number	US-201514843347-A
Country	US
Kind code	B2
Filing date	Sep 2, 2015
Priority date	Sep 2, 2015
Publication date	Jul 16, 2019
Grant date	Jul 16, 2019

Abstract

Functional and anatomical information are combined in medical imaging. The functional information is treated as a light source illuminating surrounding anatomy, not just along a viewing direction. As a result, rendered images of the anatomy include highlighting or visual lighting queues showing locations of biological activity using global illumination.

First claim

We claim:

1. A system for medical imaging of functional and anatomical information, the system comprising:
an emission imaging system configured to measure the functional information representing a volume of a patient, wherein the emission imaging system is a positron emission tomography or a single photon emission computed tomography system;
a medical imager configured to measure the anatomical information representing the volume of the patient, wherein the medical imager is a computed tomography or magnetic resonance system;
a graphics rendering processor configured to render an image of the volume of the patient from the anatomical information with global illumination, the functional information designating locations of light sources for the global illumination in the rendering from the anatomical information where the global illumination transports light from the locations designated from the functional information to surrounding anatomy represented in the anatomical information; and
a display configured to display the image of the volume of the patient.

2. The system of claim 1 wherein the functional information is a first set of voxels representing emissions from a tracer in the patient and wherein the anatomical information is a second set of voxels representing scalar measures of anatomy of the patient.

3. The system of claim 1 wherein the graphics rendering processor is configured to render the image with Monte Carlo path tracing.

4. The system of claim 1 wherein the graphics rendering processor is configured to render the image with the global illumination comprising the locations of functional information being the light sources from within the volume.

5. The system of claim 1 wherein the graphics rendering processor is configured to render the image with the global illumination comprising transporting the light to the anatomy as surrounding anatomy locations spaced from a line from a camera to a pixel location.

6. The system of claim 1 wherein the graphics rendering processor being configured to render the image comprises being configured to map an anatomy sample from the anatomical information for a location to a base color and opacity with a first transfer function and map a functional sample from the functional information for the location to a light color and light intensity with a second transfer function.

7. The system of claim 6 wherein the graphics rendering processor being configured to render the image further comprises being configured to accumulate the base color and opacity from the location and other locations along a path and modify the base color with the light color and light intensity.

8. The system of claim 7 wherein the graphics rendering processor being configured to modify comprises being configured to add the light color and light intensity as an emissive property for the location.

9. The system of claim 7 wherein the graphics rendering processor being configured to modify comprises being configured to terminate the path at the location and add the light color and light intensity to results of the accumulation for the path as terminated.

10. The system of claim 1 wherein the graphics rendering processor being configured to render comprises being configured to render a sequence of images with the global illumination varying cyclically through the sequence.

11. The system of claim 1 further comprising a user input, wherein the graphics rendering processor being configured to render with a strength of the global illumination being responsive to a control by the user from the user input.

Assignees

• Siemens Healthcare Gmbh

Inventors

• Engel Klaus
• Williams James

Classifications

• G16H50/20

  for computer-aided diagnosis, e.g. based on medical expert systems · CPC title

• G06T15/55

  Radiosity · CPC title

• A61B6/5235

  combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT · CPC title

• A61B5/0035

  adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title