Non-vector space sensing and control systems and methods for video rate imaging and manipulation

Patent metadata

Field	Value
Publication number	US-9575307-B2
Application number	US-201314384608-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Mar 29, 2012
Publication date	Feb 21, 2017
Grant date	Feb 21, 2017

Abstract

Compressive sensing based video rate imaging techniques are presented. Rather than scan the entire image, the imaging system only scans part of the topography of the sample as a compressed scan. After the data has been collected, an algorithm for image reconstruction is applied for recovering the image. Because compressive sensing is used, the imaging rate is increased from several minutes per frame to seconds per frame. Non-vector space control techniques are also presented. No-vector space control use image or compressive data as the input and feedback to generate a closed-loop motion control. Compressive sensing technique provides an efficient data reduction method to retain the essential information in the original image. The non-vector space control method can be used as motion control method with compressive feedback without or with noise.

First claim

What is claimed is:

1. A method of producing video rate images of a subject, comprising:
moving a tip of a scanning probe microscope over an area of the subject;
generating a first signal based on a position of the tip during the movement;
selectively sampling the first signal during the movement;
generating a first image of the area of the subject using the samples taken during the movement of the tip over the area of the subject;
moving the tip over part of the area of the subject at a rate that corresponds to producing video rate images,
wherein the movement of the tip over part of the area of the subject is performed following a predetermined scanning pattern;
generating a second signal based on the position of the tip during the movement over part of the area of the subject;
selectively sampling the second signal generated during the movement of the tip over part of the area of the subject;
generating a second image of the area of the subject from the samples taken during the movement of the tip over part of the area of the subject, where the second image is generated based in part on the first image and the predetermined scanning pattern and using a total variation minimization norm function; and
displaying the second image.

2. The method of claim 1 further comprising reconstructing the second image from the samples taken by constraining solution to have a small number of nonzero coefficients.

3. The method of claim 1 further comprising:
determining a first set of points based on a goal image;
determining a second set of points based on the second image;
determining a distance between the first and second sets; and
moving the tip based on the distance.

4. The method of claim 3 wherein the distance is a Hausdorff distance between the first and second sets.

5. The method of claim 3 further comprising controlling movement of the tip based on driving the distance to less than a threshold value.

6. The method of claim 5 further comprising, after the moving of the tip based on the distance:
moving the tip over part of the area of the subject, following the predetermined scanning pattern during a period;
generating a third signal based on the position of the tip during the movement over part of the area of the subject during the period;
sampling the third signal generated during the movement of the tip over part of the area of the subject during the period;
generating a third image of the area of the subject using the samples taken during the movement of the tip over part of the area of the subject during the period; and
refreshing the display to display the third image.

7. The method of claim 6 further comprising, after the movement of the tip along the predetermined scanning pattern during the period:
determining the first set of points based on the goal image;
determining the second set of points based on the third image;
determining the distance between the first and second sets; and
moving the tip based on the distance.

8. The method of claim 1 wherein the predetermined scanning pattern includes equally spaced horizontal or vertical lines for the movement of the tip.

9. The method of claim 1 wherein the predetermined scanning pattern includes concentric rectangles for the movement of the tip.

10. The method of claim 1 wherein the predetermined scanning pattern includes a saw tooth pattern.

11. The method of claim 1 wherein the predetermined scanning pattern includes a random trajectory pattern.

12. A method of producing video rate images of a subject, comprising:
moving a tip of a scanning probe microscope over an area of the subject;
generating a first image of the area of the subject based on a first set of samples of a height of the tip during the movement over the area of the subject;
moving the tip over part of the area of the subject at a rate that corresponds to producing video rate images, wherein the movement of the tip over part of the area of the subject is performed following a predetermined scanning pattern;
generating a second image of the area of the subject based on a second set of samples of the height of the tip during the movement over part of the area of the subject; wherein the second image is generated using the predetermined scanning pattern and a total variation minimization norm function; and
displaying the second image on a display.

13. The method of claim 12 wherein the reconstruction function is a compressive sensing image reconstruction function.

14. The method of claim 12 further comprising:
determining a first set of points based on a goal image;
determining a second set of points based on the second image;
determining a distance between the first and second sets; and
moving the tip based on the distance.

15. The method of claim 14 wherein the distance is a set distance between the first and second sets.

16. The method of claim 14 further comprising controlling movement of the tip based on driving the distance to less than a threshold value.

17. The method of claim 16 further comprising, after the moving of the tip based on the distance:
moving the tip along the predetermined scanning pattern during a period;
generating a third image based on:
a third set of samples of the height of the tip during the movement along the predetermined scanning pattern during the period;
the predetermined scanning pattern; and
the reconstruction function; and

refreshing the display to display the third image.

18. The method of claim 17 further comprising, after the movement of the tip along the predetermined scanning pattern during the period:
determining the first set of points based on the goal image;
determining a third set of points based on the third image;
determining the distance between the first and third sets; and
moving the tip based on the distance.

19. The method of claim 12 wherein the predetermined scanning pattern includes equally spaced horizontal or vertical lines for the movement of the tip.

20. The method of claim 12 wherein the predetermined scanning pattern includes concentric rectangles for the movement of the tip.

21. The method of claim 12 wherein the predetermined scanning pattern includes a saw tooth pattern.

22. The method of claim 12 wherein the predetermined scanning pattern includes a random trajectory pattern.

23. A system for producing video rate images of a subject, comprising:
a control module that drives movement of a tip of a scanning probe microscope over an area of the subject and that, after the movement of the tip over the area of the subject, drives movement of the tip over part of the area of the subject at a rate that corresponds to producing video rate images,
wherein the control module drives movement of the tip over part of the area of the subject following a predetermined scanning pattern;
an imaging module that generates a first image of the area of the subject based on a first set of samples of a height of the tip during the movement over the area of the subject and that generates a second image of the area of the subject based on a second set of samples of the height of the tip during the movement over part of the area of the subject, wherein the second image is generated using the predetermined scanning pattern and a total variation minimization norm function; and
a user interface module that displays the second image on a display.

24. The system of claim 23 wherein the recon

Assignees

• Univ Michigan State

Inventors

• Xi Ning
• Song Bo
• Zhao Jianguo
• Lai Wai Chiu King

Classifications

• G01Q30/04

  Display or data processing devices · CPC title

• G02B21/365 Primary

  Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence) · CPC title

• B82Y35/00 Primary

  Methods or apparatus for measurement or analysis of nanostructures · CPC title

• G01Q10/06

  Circuits or algorithms therefor · CPC title

• G06T1/0007

  Image acquisition · CPC title