Synthetic images for biopsy control

Patent metadata

Field	Value
Publication number	US-10463333-B2
Application number	US-201615377465-A
Country	US
Kind code	B2
Filing date	Dec 13, 2016
Priority date	Dec 13, 2016
Publication date	Nov 5, 2019
Grant date	Nov 5, 2019

Abstract

Abstract systems and methods of biopsy control include reconstructing a 3D volume from a plurality of tomosynthesis projection images and producing a plurality of synthetic stereo images from the plurality of tomosynthesis projection images. At least the synthetic stereo images are presented on a graphical display to a clinician to facilitate at least one input of a biopsy location for biopsy control.

First claim

The invention claimed is:

1. A method of generating images for biopsy control, the method comprising:
receiving a plurality of tomosynthesis projection images, each tomosynthesis projection image having a respective focal point;
reconstructing a three-dimensional (3D) volume from the plurality of tomosynthesis projection images;
producing at least two two-dimensional (2D) synthetic stereo projection images from at least some of the plurality of tomosynthesis projection images, each 2D synthetic stereo projection image having a different focal point from an other 2D synthetic stereo projection image of the at least two 2D synthetic stereo projection images; and
presenting the at least two 2D synthetic stereo projection images on a graphical display to a clinician for receiving at least one input for biopsy control.

2. The method of claim 1 , further comprising mapping pixels of the 2D synthetic stereo projection images to a 3D volume obtained from a prior DBT acquisition, a CE-DBT acquisition, a MRI or an ultrasound acquisition to produce a navigation map for each of the 2D synthetic stereo projection images.

3. The method of claim 2 , wherein locations mapped in the navigation map are voxels of the 3D volume obtained from the tomosynthesis projection images.

4. The method of claim 3 ,
wherein the navigation map contains height information for each pixel obtained from a synthetic 2D generation process or a reprojection operation of the 3D volume.

5. The method of claim 1 , further comprising:
receiving a user input selecting a point in a 2D synthetic stereo projection image of the at least two 2D synthetic stereo projection images;
reading the navigation map associated to the 2D synthetic stereo projection image at the user input position;
identifying a plane through the 3D volume;
computing a plane location corresponding to the user input position in the identified plane;
presenting the identified plane on the graphical display with indication of the plane location;
reprojecting the plane location on another 2D synthetic stereo projection image; and
displaying the other 2D synthetic stereo projection image with the reprojected location.

6. The method of claim 5 wherein upon receiving a new location to update the position of the location in the identified plane or in the 2D synthetic stereo projection images, the new location is automatically updated in the identified plane and in the 2D synthetic stereo projection images.

7. The method of claim 1 , further comprising:
determining a field of view in each of the plurality of tomosynthesis projection images; and
producing at least the plurality of 2D synthetic stereo projection images or the 3D volume by discarding areas out of the field of view in at least one of the plurality of tomosynthesis projection images.

8. The method of claim 7 , wherein the field of view is at least one of a biopsy window, a paddle area, or an intermediate field of view.

9. The method of claim 1 , further comprising:
identifying an object that projects into the field of view in at least one of the plurality of tomosynthesis projection images; and
producing at least the plurality of synthetic stereo image or the 3D volume in discarding the identified object area in at least one of the plurality of tomosynthesis projection images.

10. The method of claim 9 , further comprising:
identifying at least one of a coordinate, an orientation, or a trajectory of a biopsy needle in the 3D volume and/or in the synthetic stereo images; and
presenting on the graphical display at least one of the synthetic stereo images or the 3D volume in combination with at least one of the coordinate, the orientation, and the trajectory of the needle.

11. The method of claim 1 wherein the at least two 2D synthetic stereo projection images are produced by enhancing one baseline projection image using at least a subset of the plurality of tomosynthesis projection images.

12. The method of claim 11 wherein the baseline projection image is obtained from a volume representing the object.

13. The method of claim 11 wherein the baseline projection image is obtained by interpolating a subset of the tomosynthesis projections.

14. The method of claim 11 wherein the baseline projection image is selected from among the plurality of tomosynthesis projection images.

15. The method of claim 14 wherein enhancing the baseline projection image further comprises:
filtering at least a subset of the tomosynthesis projection images;
reconstructing a volume from the filtered tomosynthesis projection images;
reprojecting the volume; and
combining the volume reprojection with the baseline projection image or a filtered version of the baseline projection image.

16. The method of claim 11 further comprising:
determining a field of view position in the baseline projection image; and
enhancing the baseline projection image in an area delimited by the field of view.

17. A system for biopsy control, the system comprising:
an acquisition unit comprising a radiation source and an X-ray detector, the radiation source movable relative to the X-ray detector to acquire a plurality of projection images at different angulations and each having a respective focal point;
a graphical display configured to present medical images;
a control unit communicatively connected to the acquisition unit that operates the acquisition unit to acquire the plurality of projection images and the control unit processes the plurality of projection images to produce a plurality of two-dimensional (2D) synthetic stereo projection images, each 2D synthetic stereo projection image of the plurality having a different focal point from the other 2D synthetic stereo projection images, the control unit communicatively connected to the graphical display to visually present at least one 2D synthetic stereo projection image from the plurality of 2D synthetic stereo projection images on the graphical display; and
a biopsy robot communicatively connected to the control unit, wherein the control unit receives a user input of a biopsy location based upon the visually presented the at least one 2D synthetic stereo projection image and the control unit operates the biopsy robot to biopsy the biopsy location.

18. The system of claim 17 wherein the acquisition unit comprises a compression paddle with a biopsy window there through and the control unit determines the biopsy window position in each of the plurality of tomosynthesis projection images, extracts image data from within the biopsy window from each of the plurality of tomosynthesis projection images, and produces the plurality of 2D synthetic stereo projection images using the extracted image data of at least one tomosynthesis projection image.

19. The system of claim 17 , wherein the control unit further identifies a needle area in the plurality of tomosynthesis projection images and, processes the needle area in each of the plurality of tomosynthesis projection images to attenuate artifacts due to the needle.

20. The system of claim 17 , wherein the control unit creates a navigation map mapping the 2D synthetic stereo projection images to the reconstructed 3D volume, and upon receiving at least one user input, navigating between a presentation of a 2D synthetic stereo projection image of the plurality of 2D synthetic stereo projection images on the graphical display to a presentation of at least one 3D tomosynthesis slice of the 3D reconstruction on the graphical display.

21.

Assignees

• Gen Electric

Inventors

• Bernard Sylvain
• Palma Giovanni

Classifications

• G06T12/30

  Image post-processing, e.g. metal artefact correction · CPC title

• A61B34/30

  Surgical robots · CPC title

• A61B6/502 Primary

  for diagnosis of breast, i.e. mammography · CPC title

• A61B6/025

  Tomosynthesis · CPC title

• A61B6/5258

  involving detection or reduction of artifacts or noise · CPC title