System and method for real-time image registration

Patent metadata

Field	Value
Publication number	US-9406133-B2
Application number	US-201514596927-A
Country	US
Kind code	B2
Filing date	Jan 14, 2015
Priority date	Jan 21, 2014
Publication date	Aug 2, 2016
Grant date	Aug 2, 2016

Abstract

A method for image registration includes the steps of: providing a computer and an imager; acquiring and processing a reference image frame including a plurality of reference strips; acquiring and correcting a target frame by the steps of: acquiring one or more target frame strips of the target frame; comparing the one or more target frame strips in real-time to one or more corresponding strips of the reference frame based on a calculated registration of a specific target frame strip from a previous target frame; correcting a registration of the one or more target frame strips; repeating steps until a last strip of the target frame; repeating the steps of acquiring and correcting a target frame until a last target frame is acquired; and saving processed image based on a plurality of corrected target frames to a non-volatile memory. A system to perform the method is also described.

First claim

What is claimed is:

1. A method for image registration comprising the steps of:
providing a computer and an imager, said computer configured to receive a plurality of image frames from said imager;
acquiring and processing a reference image frame comprising a plurality of reference strips;
acquiring and correcting a target frame by the steps of:
acquiring one or more target frame strips of said target frame;
comparing said one or more target frame strips in real-time to one or more corresponding strips of said reference frame based on a calculated registration of a specific target frame strip from a previous target frame;
correcting a registration of said one or more target frame strips;
repeating steps from said step of acquiring one or more target frame strips to said step of correcting a registration until a last strip of said target frame;

repeating said steps of acquiring and correcting a target frame until a last target frame is acquired; and
saving a processed image based on a plurality of corrected target frames to a non-volatile memory.

2. The method of claim 1 , wherein said specific strip comprises a center strip.

3. The method of claim 1 , wherein said plurality of corrected target frames are averaged together to create an averaged image with a signal to noise ratio (S/N) higher than the S/N of each individual target frame.

4. The method of claim 1 , wherein a detected motion of one or more strips of said target frame exceeding a motion threshold causes said target frame to be not included in said plurality of corrected target frames.

5. The method of claim 4 , wherein following said detected motion of one or more strips of said target frame which exceeds said motion threshold, a recovery process uses a two dimensional FFT of an entire target frame image to recover from a large motion.

6. The method of claim 4 wherein said detected motion comprises a saccade threshold or a blink threshold.

7. The method of claim 1 , further comprising the step of removing a distortion or warping of said one or more target frame strips before said step of calculating the registration of each strip.

8. The method of claim 1 , further comprising the step of removing noise from said one or more target frame strips by convolution before said step of calculating said registration of each strip.

9. The method of claim 1 , further comprising the step of enhancing an image feature of said one or more target frame strips before said step of calculating said registration of each strip.

10. The method of claim 1 , wherein said step of acquiring and processing a reference image frame comprises applying a two dimensional FFT to each strip of said reference frame and saving a two dimensional FFT result to a memory.

11. The method of claim 1 , wherein said step of acquiring and processing a reference image frame comprises applying a two dimensional FFT to a number of combined strips of said reference frame and saving a two dimensional FFT result to a memory.

12. The method of claim 1 , wherein said step of acquiring and processing a reference image frame comprises applying a two dimensional FFT to an entire frame of said reference frame and saving a two dimensional FFT result to a memory.

13. The method of claim 1 , wherein said step of comparing said one or more target frame strips in real-time to one or more corresponding strips of said reference frame further comprises comparing a two dimensional FFT of said one or more target frame strips to a two dimensional FFT one or more reference strips by a cross-correlation operation.

14. The method of claim 1 , wherein said step of comparing said one or more target frame strips in real-time to one or more corresponding strips of said reference frame further comprises comparing a two dimensional FFT of said one or more target frame strips to a two dimensional FFT one or more reference strips by a spatial domain cross correlation operation.

15. A real-time image processing system comprising:
an imager configured to acquire a plurality of image frames; and
a computer communicatively coupled to said imager, said computer configured by program code stored in a non-volatile memory to receive said plurality of image frames in real-time as strips of said image frames and to process said strips in real-time so as to correct a registration of said one or more strips by comparing one or more target frame strips in real-time to one or more corresponding strips of a reference frame based on a calculated registration of a specific target frame strip from a previous target frame, and to combine a plurality of registration corrected target frames to provide a processed image saved to a non-volatile memory, said processed image having a S/N ratio higher than the S/N of each individual target frame.

16. The real-time image processing system of claim 15 , wherein said imager comprises a LASER scanning imager.

17. The real-time image processing system of claim 15 , wherein said imager comprises an imaging device comprising a plurality of detector cells.

18. The real-time image processing system of claim 15 , wherein said imager comprises semiconductor imaging device.

19. The real-time image processing system of claim 15 , wherein said system further comprises at least one adaptive element having a controllable position, wherein said controllable position is updated during acquisition of one or more target frames based on a real-time target frame strip registration process.

20. The real-time image processing system of claim 19 , wherein said adaptive element comprises a controllable mirror.

21. The real-time image processing system of claim 19 , wherein said imager comprises an adaptive optics scanning light ophthalmoscope (AOSLO).

22. The real-time image processing system of claim 19 , wherein said imager comprises a satellite imager.

23. The real-time image processing system of claim 15 , wherein said image processing system comprises a 3D imager.

Assignees

• Yang Qiang
• Univ Rochester

Inventors

• Yang Qiang

Classifications

• G06V10/751

  Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching · CPC title

• G06T5/50 Primary

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T2207/20216

  Image averaging · CPC title

• G06K9/6202

  Physics · mapped topic

• G06T7/0038 Primary

  Physics · mapped topic