Image processing system and method

Patent metadata

Field	Value
Publication number	US-11694386-B2
Application number	US-201917271929-A
Country	US
Kind code	B2
Filing date	Aug 22, 2019
Priority date	Aug 30, 2018
Publication date	Jul 4, 2023
Grant date	Jul 4, 2023

Abstract

A System for image processing (IPS), in particular for lung imaging. The system (IPS) comprises an interface (IN) for receiving at least a part of a 3D image volume (VL) acquired by PAT an imaging apparatus (IA 1 ) of a lung (LG) of a subject (PAT) by exposing the subject (PAT) to a first interrogating signal. A layer definer (LD) of the system (IPS) is configured to define, in the 3D image volume, a layer object (LO) that includes a representation of a surface (S) of the lung (LG). A renderer (REN) of the system (IPS) is configured to render at least a part of the layer object (LO) in 3D at a rendering view (V p ) for visualization on a display device (DD).

First claim

The invention claimed is:

1. A system for image-based navigation, the system comprising:
an input interface configured to receive i) at least a part of a three-dimensional (3D) image volume based on image data of a lung of a subject acquired pre-operatively by a first imaging modality and ii) a second image the lung in a deflated state dynamically acquired by a second imaging modality during an operation; and
a processor configured to:
define, in the 3D image volume, a layer object that includes a pattern on a surface of the lung that is representative of at least one of a lung vessel or a septum,
identify the pattern in the second image of the lung,
match the second image of the lung in the deflated state to the 3D image volume based on the pattern,
render a rendering view of the 3D image volume matched to the second image, and
display a visualization of the rendering view.

2. The system of claim 1 , wherein the processor is configured to confine rendering of the layer object to a part of the layer object, or the processor is configured to set voxels within the layer object to provide a higher contribution to pixels in the rendering view than voxels outside the layer object.

3. The system of claim 1 , wherein the processor is configured to define a thickness of the layer object based on a penetration depth of an interrogation signal of the second imaging modality.

4. The system of claim 1 , wherein the processor is configured to define the layer object by segmenting the lung into sub-volumes and deriving a mask image from the sub-volumes based on a defined thickness for the layer object.

5. The system of claim 1 , wherein the processor is configured to define the layer object using a volume reformatting technique.

6. The system of claim 1 , wherein the processor is configured to render the pattern with color-value or grey-value encoding that is different from a surrounding in which the pattern is at least partly embedded.

7. The system of claim 1 , wherein the processor is configured to set a transparency of the rendered layer object to occlude a distal portion of the layer object or the processor is configured to prune the layer object to exclude the distal portion from being rendered.

8. The system of claim 1 , further comprising a display device interface configured to affect the display of the visualization of the rendering view and the second image on at least one display device.

9. The system of claim 1 , wherein the processor is configured to color-value or grey-value encode vessels of the layer object so that veins are differentiated from arteries in the visualization of the rendering view, based on oxygenized hemoglobin or deoxygenized hemoglobin being present in a corresponding portion of the lung during imaging of the lung.

10. The system of claim 1 , further comprising at least one of the first imaging modality, the second imaging modality, or at least one display device.

11. A method of image-based navigation, the method comprising:
receiving i) at least a part of a 3D image volume of a lung of a subject based on image data acquired pre-operatively by a first imaging modality and ii) a second image of the lung in a deflated state dynamically acquired by a second imaging modality during an operation;
defining, in the 3D image volume, a layer object that includes a pattern on the surface of the lung that is representative of a lung vessel or a septum;
identifying the pattern in the second image;
matching the second image of the lung in the deflated state to the 3D image volume based on the pattern;
rendering a rendering view of the 3D image volume matched to the second image; and
displaying a visualization of the rendering view.

12. The method of claim 11 , further comprising confining rendering of the layer object to at least a part of the layer object or setting voxels within the layer object to provide a higher contribution to pixels in the rendering view than voxels outside the layer object.

13. A non-transitory computer readable medium having stored thereon instructions, which, when being executed by at least one processor, cause the at least one processor to:
receive i) at least a part of a 3D image volume of a lung of a subject based on image data acquired pre-operatively by a first imaging modality and ii) a second image of the lung in a deflated state acquired dynamically by a second imaging modality during an operation;
define, in the 3D image volume, a layer object that includes a pattern on the surface of the lung that is representative of at least one of a lung vessel or a septum;
identify the pattern in the second image;
match the second image of the lung in the deflated state to the 3D image volume based on the pattern;
render a rendering view of the 3D image volume matched to the second image; and
display a visualization of the rendering view.

14. The method of claim 11 , further comprising defining a thickness of the layer object based on a penetration depth of an interrogation signal of the second imaging modality.

15. The method of claim 11 , further comprising defining the layer object by segmenting the lung into sub-volumes and deriving a mask image from the sub-volumes based on a defined thickness for the layer object.

16. The method of claim 11 , further comprising defining the layer object using a volume reformatting technique.

17. The method of claim 11 , further comprising rendering the pattern with color-value or grey-value encoding that is different from a surrounding in which the pattern is at least partly embedded.

18. The method of claim 11 , further comprising setting a transparency of the rendered layer object to occlude a distal portion of the layer object or pruning the layer object to exclude the distal portion from being rendered.

19. The method of claim 11 , further comprising color-value or grey-value encoding vessels so that veins are differentiated from arteries, in the visualization of the rendering view, based on oxygenized hemoglobin or deoxygenized hemoglobin being present in a corresponding portion of the lung during imaging of the lung.

Assignees

• Koninklijke Philips Nv

Inventors

• Sabczynski Jörg
• Mueller Manfred
• Wiemker Rafael

Classifications

• G06T7/0012

  Biomedical image inspection · CPC title

• G06T2207/30061

  Lung · CPC title

• A61B2090/364

  Correlation of different images or relation of image positions in respect to the body · CPC title

• G06T2210/41

  Medical · CPC title

• A61B34/10

  Computer-aided planning, simulation or modelling of surgical operations · CPC title