Image processing including adjoin feature based object detection, and/or bilateral symmetric object segmentation

Patent metadata

Field	Value
Publication number	US-10074034-B2
Application number	US-201314124233-A
Country	US
Kind code	B2
Filing date	Jun 14, 2013
Priority date	Jun 14, 2013
Publication date	Sep 11, 2018
Grant date	Sep 11, 2018

Abstract

Apparatuses, methods and storage medium associated with processing an image are disclosed herein. In embodiments, a method for processing one or more images may include generating a plurality of pairs of keypoint features for a pair of images. Each pair of keypoint features may include a keypoint feature from each image. Further, for each pair of keypoint features, corresponding adjoin features may be generated. Additionally, for each pair of keypoint features, whether the adjoin features are similar may be determined. Whether the pair of images have at least one similar object may also be determined, based at least in part on a result of the determination of similarity between the corresponding adjoin features. Other embodiments may be described and claimed.

First claim

What is claimed is:

1. A method for processing one or more images, comprising:
generating, by a computing device, a plurality of pairs of keypoint features, with each pair of keypoint features including a first keypoint feature from a first of the one or more images, and a second keypoint feature from a second of the one or more images;
generating, by the computing device, for each pair of keypoint features, a first plurality of adjoin features for the first keypoint feature of the keypoint feature pair, and a corresponding second plurality of adjoin features for the second keypoint feature of the keypoint feature pair, wherein the first plurality of adjoin features for the first keypoint feature are immediately adjacent to and circularly surround the first keypoint feature, and the second plurality of adjoin features for the second keypoint feature are immediately adjacent to and circularly surround the second keypoint feature;
determining, by the computing device, for each pair of keypoint features, whether an immediately adjacent adjoin feature of the first keypoint feature of the keypoint feature pair is similar to the corresponding immediately adjacent adjoin feature of the second keypoint feature of the keypoint feature pair; and
determining, by the computing device, whether the first and the second image have at least one similar object, based at least in part on a result of the determination of similarity between the corresponding immediately adjacent and circularly surrounding adjoin features of the first and second keypoint features of the keypoint feature pairs;
wherein the first and second plurality of immediately adjacent and circularly surrounding adjoin features are generated based at least in part on an adjoin feature order; and wherein given a first keypoint feature of s i defined by at least [X i , r i , θ i ,] T , an adjoin feature order of K, the K immediately adjacent and circularly surrounding adjoin features of s i comprises s i * k defined by at least [X* k i , r i , θ i ,] T , where X* k i is defined by at least [X i , r i and α k ], where α k =θ i +2πk/K, k=1,2, . . . K−1, r i and θ i are point size and orientation of the keypoint feature s i .

2. The method of claim 1 , wherein generating a plurality of pairs of keypoint features comprises:
identifying a first plurality of keypoint features of the first image;
identifying a second plurality of keypoint features of the second image; and
pairing the first and second plurality of keypoint features of the first and second images.

3. The method of claim 1 , wherein determining whether the first and second images have at least one similar object comprises:
generating a set of similar keypoint feature pairs, wherein the keypoint features of a similar keypoint feature pair are determined to be similar based at least in part on a result of the determination of similarity between the corresponding immediately adjacent and circularly surrounding adjoin features of the keypoint features of the similar keypoint feature pairs; and
outputting the set of similar keypoint feature pairs.

4. The method of claim 3 , further comprising highlighting, by the computing device, at least an object in the first image based at least in part on some of the keypoint features of the first image that are members of the set of similar keypoint feature pairs.

5. The method of claim 4 , wherein highlighting comprises bounding the object with a geometric primitive.

6. The method of claim 1 , wherein the first and second plurality of immediately adjacent and circularly surrounding adjoin features are generated based at least in part on an adjoin feature order; and wherein given a first keypoint feature of s i =[X i , r i , θ i , f(X i , r i , θ i )] T , an adjoin feature order of K, the K immediately adjacent and circularly surrounding adjoin features of s i comprises s i * k =[X i * k ,r i ,θ i ,f(X i * k ,r i ,θ)] T where X* k i , =X i +2r i [cos(α k ), sin(α k )] T , α k =θ i +2πk/K, k=1,2, . . . K−1, r i and θ i are point size and orientation of the keypoint feature s i , and f(X* k i , r i , θ i ) comprises local spatial relationships of keypoint feature s i .

7. At least one non-transitory storage medium comprising a plurality of instructions configured to cause an apparatus, in response to execution of the instructions by an apparatus, to perform processing of a plurality of images, wherein performance of the processing includes:
generation of a plurality of pairs of keypoint features, with each pair of keypoint features including a first keypoint feature from a first of the one or more images, and a second keypoint feature from a second of the one or more images;
for each pair of keypoint features, generation of a first plurality of adjoin features for the first keypoint feature of the keypoint feature pair, and a corresponding second plurality of adjoin features for the second keypoint feature of the keypoint feature pair, wherein the first plurality of adjoin features for the first keypoint feature are immediately adjacent and circularly surrounding the first keypoint feature, and the second plurality of adjoin features for the second keypoint feature are immediately adjacent and circularly surrounding the second keypoint feature;
for each pair of keypoint features, determination of whether an adjoin feature of the first keypoint feature of the keypoint feature pair is similar to the corresponding adjoin feature of the second keypoint feature of the keypoint feature pair; and
determination of whether the first and the second image have at least one similar object, based at least in part on a result of the determination of similarity between the corresponding immediately adjacent and circularly surrounding adjoin features of the first and second keypoint features of the keypoint feature pairs;
wherein the first and second plurality of immediately adjacent and circularly surrounding adjoin features are generated based at least in part on an adjoin feature order; and wherein given a first keypoint feature of s i defined by at least [X i , r i , θ i ,] T , an adjoin feature order of K, the K immediately adjacent and circularly surrounding adjoin features of s i comprises s i * k defined by at least [X* k i , r i , θ i ,] T , where X* k i is defined by at least [X i , r i and α k ], where α k =θ i +2πk/K, k=1,2, . . .K−1, r i and θ i are point size and orientation of the keypoint feature s i .

8. The storage medium of claim 7 , wherein generation of a plurality of pairs of keypoint features comprises:
identification of a first plurality of keypoint features of the first image;
identification of a second plurality of keypoint features of the second image; and
performance of pairing of the first and second plurality of keypoint features of the first and second images.

9. The storage medium of claim 7 , wherein determination of whether the first and the second image have at least one similar object comprises:
generation of a set of similar keypoint feature pairs, wherein the keypoint features of a similar keypoint feature pair are determined to be similar based at least in part on a result of the determination of similarity between the corresponding immediately adjacent and circularly surrounding adjoin features of the keypoint features of the similar keypoint feature pairs; and
output of the set of similar keypoint feature pairs.

10. The storage medium of claim 9 , wherein process one or more images further includes highlight at least an object in the first image based at least in part on some of the keypoint features of the first image that are members of the set of similar keypoint feature pairs.

11. The storag

Assignees

• Intel Corp

Inventors

• Wang Tao
• Fu Lianrui
• Li Qiang
• Li Jianguo
• Chen Yurong
• Peng Ya-Ti
• Zhang Yimin
• Yao Anbang

Classifications

• G06V10/757

  Matching configurations of points or features · CPC title

• G06V10/75 Primary

  Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries · CPC title

• G06K9/6211 Primary

  Physics · mapped topic

• G06K9/68

  Physics · mapped topic