Method and system for enhanced frame rate upconversion in ultrasound imaging

Patent metadata

Field	Value
Publication number	US-9384568-B2
Application number	US-201414476179-A
Country	US
Kind code	B2
Filing date	Sep 3, 2014
Priority date	Sep 3, 2014
Publication date	Jul 5, 2016
Grant date	Jul 5, 2016

Abstract

Various embodiments include systems and methods for providing motion blur reduction to one or more three-dimensional (3D) images, and/or for improving accuracy of motion-compensated frame up-interpolations. The motion blur reduction may comprise application of iterative motion estimation, starting with an initial block size and with reduced block size in each iteration, with a final velocity vector being determined by summing displacement vectors from all iterations. Accuracy of motion-compensated frame up-interpolations may be improved by use of lower resolution frames (or portions of frames), which may be used in generating information used in enhancing motion related features or characteristics of motion-compensated frames.

First claim

What is claimed is:

1. A method, comprising:
applying by a processor of an ultrasound system, motion blur reduction to one or more three-dimensional (3D) images, the motion blur reduction comprising:
applying motion estimation based on an initial block size;
iteratively applying motion estimation for one or more other iterations,

wherein block size associated with each iteration is reduced in relation to block size of a previous iteration; and
determining a final velocity vector by summing displacement vectors from all iterations; and

applying by the processor of the ultrasound system, improvement to motion-compensated frames, by:
obtaining for motion-compensated frames or portions thereof, corresponding lower resolution frames or portions of a frame; and
processing the motion-compensated frames or the portions thereof, to enhance motion related characteristics in the motion-compensated frames, based on information obtained from the obtained lower resolution frames or the portion of a frames.

2. The method according to claim 1 , comprising applying the motion blur reduction during frame rate upconversion.

3. The method according to claim 2 , comprising applying the motion blur reduction to interpolated frames during the frame rate upconversion.

4. The method according to claim 1 , comprising applying the motion estimation based on dual motion estimation (DME).

5. The method according to claim 1 , comprising applying vector median filtering to velocity vectors obtained during motion blur reduction.

6. The method according to claim 1 , comprising applying a vector field corresponding to velocity vectors obtained during motion blur reduction as an input in an optical flow processing.

7. The method according to claim 1 , comprising applying overlapped block motion compensation interpolation to each image to which motion blur reduction is applied, to remove blockiness artifacts.

8. The method according to claim 1 , comprising processing the motion-compensated frames or portions thereof based on information obtained from tracking of motion of structures between motion-compensated frames or portions thereof and lower resolution frames or the portions of a frame.

9. The method according to claim 8 , comprising obtaining the lower resolution frames or portions of a frame on per-frame or per-beam interleaved acquisition scheme.

10. A system, comprising:
an ultrasound device comprising a processor operable to:
apply motion blur reduction to one or more three-dimensional (3D) images, the motion blur reduction comprising:
applying motion estimation based on an initial block size;
iteratively applying motion estimation for one or more other iterations, wherein block size associated with each iteration is reduced in relation to block size of a previous iteration; and
determining a final velocity vector by summing displacement vectors from all iterations; and

apply improvement to motion-compensated frames, by:
obtaining for motion-compensated frames or portions thereof, corresponding lower resolution frames or portions of a frame; and
processing the motion-compensated frames or the portions thereof, to enhance motion related characteristics in the motion-compensated frames, based on information obtained from the obtained lower resolution frames or the portion of a frames.

11. The system according to claim 10 , wherein the processor is operable to apply the motion blur reduction during frame rate upconversion.

12. The system according to claim 11 , wherein the processor is operable to apply the motion blur reduction to interpolated frames during the frame rate upconversion.

13. The system according to claim 10 , wherein the processor is operable to apply the motion estimation based on dual motion estimation (DME).

14. The system according to claim 10 , wherein the processor is operable to apply vector median filtering to velocity vectors obtained during motion blur reduction.

15. The system according to claim 10 , wherein the processor is operable to apply a vector field corresponding to velocity vectors obtained during motion blur reduction as an input in an optical flow processing.

16. The system according to claim 10 , wherein the processor is operable to apply overlapped block motion compensation interpolation to each image to which motion blur reduction is applied, to remove blockiness artifacts.

17. The system according to claim 10 , comprising processing the motion-compensated frames or portions thereof based on information obtained from tracking of motion of structures between motion-compensated frames or portions thereof and lower resolution frames or the portions of a frame.

18. The system according to claim 17 , comprising obtaining the lower resolution frames or portions of a frame on per-frame or per-beam interleaved acquisition scheme.

19. A non-transitory computer readable medium having stored thereon, a computer program having at least one code section, the at least one code section being executable by a machine for causing the machine to perform steps comprising:
applying motion blur reduction to one or more three-dimensional (3D) images, the motion blur reduction comprising:
applying motion estimation based on an initial block size;
iteratively applying motion estimation for one or more other iterations, wherein block size associated with each iteration is reduced in relation to block size of a previous iteration; and
determining a final velocity vector by summing displacement vectors from all iterations; and

applying improvement to motion-compensated frames, by:
obtaining for motion-compensated frames or portions thereof, corresponding lower resolution frames or portions of a frame; and
processing the motion-compensated frames or the portions thereof, to enhance motion related characteristics in the motion-compensated frames, based on information obtained from the obtained lower resolution frames or the portion of a frames.

Assignees

• Gen Electric

Inventors

• Steen Erik Normann
• Snare Sten Roar
• Mirarkolaei Hani Nozari

Classifications

• G06T12/30 Primary

  Image post-processing, e.g. metal artefact correction · CPC title

• G06T2207/20201

  Motion blur correction · CPC title

• G06T2207/10136

  3D ultrasound image · CPC title

• G06T11/008 Primary

  Physics · mapped topic

• G01S7/52017

  particularly adapted to short-range imaging (G01S7/53 takes precedence) · CPC title