Robust feature identification for image-based object recognition

Patent metadata

Field	Value
Publication number	US-10331970-B2
Application number	US-201615379111-A
Country	US
Kind code	B2
Filing date	Dec 14, 2016
Priority date	Apr 24, 2014
Publication date	Jun 25, 2019
Grant date	Jun 25, 2019

Abstract

Techniques are provided that include identifying robust features within a training image. Training features are generated by applying a feature detection algorithm to the training image, each training feature having a training feature location within the training image. At least a portion of the training image is transformed into a transformed image in accordance with a predefined image transformation. Transform features are generated by applying the feature detection algorithm to the transformed image, each transform feature having a transform feature location within the transformed image. The training feature locations of the training features are mapped to corresponding training feature transformed locations within the transformed image in accordance with the predefined image transformation, and a robust feature set is compiled by selecting robust features, wherein each robust feature represents a training feature having a training feature transformed location proximal to a transform feature location of one of the transform features.

First claim

What is claimed is:

1. An image feature detection device comprising:
a tangible, non-transitory, computer-readable memory configured to store:
robust feature detection software instructions including at least one implementation of a feature detection algorithm; and
at least one medical training image; and

at least one processor coupled with the memory and, upon execution of the robust feature detection software instructions, is configured to operate as a feature detector to:
generate training features from the at least one medical training image according to the at least one implementation of the feature detection algorithm where each training feature has a corresponding training feature location within the at least one medical training image;
transform at least a portion of the at least one medical training image according to an image transformation that includes at least a scale transform, thereby forming a transformed image portion;
generate transform features from the transformed image portion according to the at least one implementation of the feature detection algorithm where each transform feature has a corresponding transform feature location within the transformed image portion; and
store in the memory a set of robust features, wherein each robust feature in the set represents a training feature, based on the image transform, having a training feature transformed location proximal to a transform feature location.

2. The device of claim 1 , wherein the image transformation is user-selectable.

3. The device of claim 1 , wherein the image transformation comprises an image perturbation.

4. The device of claim 1 , wherein the image transformation comprises an image processing transform.

5. The device of claim 4 , wherein the image processing transform includes at least one the following: a Gaussian filter, a color transform, an edge enhancing transform, and a lossy compression.

6. The device of claim 1 , wherein the image transformation comprises a geometric transform.

7. The device of claim 6 , wherein the geometric transform comprises at least one of the following: a skewing, a rotation, and a shearing.

8. The device of claim 1 , wherein the scale transform comprises an up-scaling.

9. The device of claim 1 , wherein the scale transform comprises a down-scaling.

10. The device of claim 1 , wherein the scale transform comprises a linear scaling.

11. The device of claim 1 , wherein the scale transform comprises a scaling factor of at least two.

12. The device of claim 1 , wherein the scale transform comprises a scaling factor based on subject matter of the at least one medical training image.

13. The device of claim 1 , wherein the at least one medical training image comprises a near-sequence image.

14. The device of claim 1 , wherein the at least the portion of the at least one medical training image comprises a patch.

15. The device of claim 1 , wherein the at least one medical training image comprises an x-ray.

16. The device of claim 1 , wherein the at least one medical training image comprises a medical diagnostic image.

17. The device of claim 1 , wherein the at least one medical training image comprises at least one video frame.

18. The device of claim 1 , wherein each robust feature comprises a robustness measure with respect to the image transformation.

19. The device of claim 18 , wherein the robustness measure reflects subject matter characteristics of the at least one medical training image.

20. The device of claim 1 , wherein the at least one medical training image is a member of a test library of medical images.

21. The device of claim 1 , wherein the at least one implementation of the feature detection algorithm includes an implementation of one of the following: a scale-invariant feature transform (SIFT), Fast Retina Keypoint (FREAK), Histograms of Oriented Gradient (HOG), Speeded Up Robust Features (SURF), DAISY, Binary Robust Invariant Scalable Keypoints (BRISK), FAST, Binary Robust Independent Elementary Features (BRIEF), Harris Corners, Edges, Gradient Location and Orientation Histogram (GLOH), Energy of image Gradient (EOG), an edge detection algorithm, and Transform Invariant Low-rank Textures (TILT) feature detection algorithm.

Assignees

• Nant Holdings Ip Llc

Inventors

• Song Bing
• Lin Liwen
• Jaber Mustafa

Classifications

• G06V10/75

  Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries · CPC title

• G06V10/50 Primary

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06V10/42

  Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title