Automated segmentation of tri-plane images for real time ultrasonic imaging

Patent metadata

Field	Value
Publication number	US-10123781-B2
Application number	US-201415032719-A
Country	US
Kind code	B2
Filing date	Nov 4, 2014
Priority date	Nov 5, 2013
Publication date	Nov 13, 2018
Grant date	Nov 13, 2018

Abstract

An ultrasonic diagnostic imaging system and method enable the automatic acquisition of standard view planes of the heart in real time, such as the AP4, AP3, and AP2 views. A 3D image of the heart is acquired and the processed in conjunction with a geometrical heart model. The heart model is fitted to the heart in its acquired pose to segment the desired image planes from the 3D image data. During successive image acquisition intervals the image planes are tracked through successive image data as multi-plane system to update a display of the multiple images. The successive image acquisitions can be volume image acquisitions or multi-plane acquisitions of just the tracked image planes during each acquisition interval.

First claim

What is claimed is:

1. An ultrasonic diagnostic imaging system which acquires a plurality of standard view planes of a heart comprising:
a matrix array probe configured to acquire a 3D volume image data of the heart;
a memory comprising data of a geometrical heart model;
a segmentation and tracking processor configured to:
automatically register the heart image data and the heart model;
determine an initial orientation of the heart model based on the heart image data;
generate a fitted heart model by transforming the heart model to fit the heart image data based on the determined initial orientation; and
segment from the heart image data a plurality of predetermined view planes that are determined based on key landmarks in the heart model, wherein an orientation of each of the plurality of predetermined view planes is determined relative to the fitted heart model; and

an image display that is responsive to the segmentation and tracking processor and configured to display images of the plurality of view planes,
wherein the segmentation and tracking processor is further operable to track acquisition of successive images of the plurality of view planes for updating of the displayed images.

2. The ultrasonic diagnostic imaging system of claim 1 , wherein the segmentation and tracking processor is configured to track the plurality of view planes as a multi-plane system.

3. The ultrasonic diagnostic imaging system of claim 2 , wherein the plurality of predetermined view planes further comprise three image planes; and wherein the segmentation and tracking processor is configured to track the three image planes as a tri-plane system.

4. The ultrasonic diagnostic imaging system of claim 3 , wherein the three image planes further comprise an AP4 view plane, an AP3 view plane, and an AP2 view plane.

5. The ultrasonic diagnostic imaging system of claim 2 , wherein the segmentation and tracking processor is configured to track the plurality of view planes by rigid transformation.

6. The ultrasonic diagnostic imaging system of claim 5 , wherein the plurality of predetermined view planes further comprise three image planes; and wherein the segmentation and tracking processor is configured to track the three image planes as a tri-plane system.

7. The ultrasonic diagnostic imaging system of claim 1 , wherein the segmentation and tracking processor is configured to track the plurality of predetermined view planes through a plurality of successively acquired 3D heart images.

8. The ultrasonic diagnostic imaging system of claim 1 , wherein the segmentation and tracking processor is configured to track the plurality of predetermined view planes by controlling a scan direction of successively acquired image planes.

9. The ultrasonic diagnostic imaging system of claim 1 , wherein the segmentation and tracking processor is further operable to periodically update registration of heart image data and heart model data.

10. A method for acquiring a plurality of standard view plane of a heart comprising:
acquiring 3D volume image data of the heart with a matrix array probe;
registering the image data of the heart with data of a geometrical heart model stored in memory;
determining an initial orientation of the heart model based on the heart image data;
generating a fitted heart model by transforming the heart model to fit the heart image data based on the determined initial orientation;
segmenting from the heart image data a plurality of predetermined view planes that are determined based on key landmarks in the heart model, wherein an orientation of each of the plurality of predetermined view planes is determined relative to the fitted heart model;
displaying images of the plurality of view planes on an image display; and
tracking acquisition of successive images of the plurality of view planes for updating of the displayed images.

11. The method of claim 10 , further comprising tracking the plurality of view planes as a multi-plane system.

12. The method of claim 11 , wherein the multiplane system is tracked by rigid transformation.

13. The method of claim 10 , further comprising: successively acquiring 3D volume image data; and tracking the plurality of view planes in the successively acquired 3D volume image data.

14. The method of claim 10 , further comprising steering the direction of scan planes in successive acquisition intervals.

15. The method of claim 14 , further comprising periodically updating registration of heart image data with data of the geometrical heart model.

16. The ultrasonic diagnostic imaging system of claim 1 , wherein the heart model comprises a 3D geometric surface mesh.

17. The ultrasonic diagnostic imaging system of claim 16 , wherein the 3D geometric surface mesh comprises a plurality of triangular elements.

18. The ultrasonic diagnostic imaging system of claim 3 , wherein a first and a second view plane of the plurality of view planes are spaced approximately 90 degrees apart, wherein the second and a third view plane of the plurality of view planes are spaced approximately 135 degrees apart.

19. The ultrasonic diagnostic imaging system of claim 1 , wherein the matrix array probe comprises a two-dimensional array.

20. The ultrasonic diagnostic imaging system of claim 1 , wherein at least two of the plurality of predetermined view planes intersect along a line passing through the heart model.

Assignees

• Koninklijke Philips Nv

Inventors

• Schneider Robert Joseph
• Bianchi Mary Kay
• Brooks Robin S
• Cardinale Michael Daniel
• Prater David
• Rivera V Lydia
• Salgo Ivan
• Settlemier Scott Holland
• Williams Jean Margaret

Classifications

• G01S7/52074

  Composite displays, e.g. split-screen displays; Combination of multiple images or of images and alphanumeric tabular information · CPC title

• G01S15/8993

  Three dimensional imaging systems · CPC title

• A61B8/5276

  due to motion · CPC title

• G06T7/75

  involving models · CPC title

• G06T2207/10136

  3D ultrasound image · CPC title