Line segment tracking in computer vision applications

Patent metadata

Field	Value
Publication number	US-2015269436-A1
Application number	US-201514657821-A
Country	US
Kind code	A1
Filing date	Mar 13, 2015
Priority date	Mar 18, 2014
Publication date	Sep 24, 2015
Grant date	—

Abstract

Techniques are disclosed for tracking objects in computer vision (CV) applications, involving identifying line segments in an image and using iterative approach of computing and analyzing spatial and angular distribution of different sets of line segments to identify a set of line segments with relatively high spatial and/or angular distribution, which can reduce the likelihood of error in tracking. Some techniques may further employ a quality check of the selected line segments. An estimation of a device's pose (translation and orientation) may be calculated from tracked line segments.

First claim

What is claimed is:

1 . A method of line segment detection and matching in a computer vision application, the method comprising:
receiving at least one image of a physical environment; identifying a plurality of line segments in the at least one image of the physical environment; (i) selecting a first subset of the plurality of line segments in the image; (ii) computing an angular distribution and a spatial distribution of the first subset of the plurality of line segments; (iii) determining whether the angular distribution and the spatial distribution of the first subset of the plurality of line segments satisfy predetermined angular and spatial criteria; repeating (i), (ii), and (iii) with one or more new subsets of the of the plurality of line segments until a qualifying subset of the plurality of line segments is determined, the qualifying subset having a computed angular distribution and spatial distribution satisfying the predetermined angular and spatial criteria; and providing the qualifying subset of the plurality of line segments.

2 . The method of claim 1 , further comprising determining a quality value for each line segment of the plurality of line segments, wherein selecting the first subset of the plurality of line segments is based on the quality value for each line segment.

3 . The method of claim 2 , wherein the quality value for each line segment of the plurality of line segments is based on at least one of:
a number of times the line segment has been observed in a series of successive images, a length of the line segment, a contrast value of the line segment, or an inverse reprojection error of the line segment.

4 . The method of claim 2 , wherein selecting the first subset of the plurality of line segments in the image further comprises dividing the image into a plurality of regions, and wherein selecting the first subset of the plurality of line segments is further based on a region in which each line segment is disposed.

5 . The method of claim 4 , further comprising separating a line segment into multiple line segments, wherein a location of the separation is based on at least one boarder between regions of the plurality of regions.

6 . The method of claim 1 , wherein the image is captured with a camera of a mobile device, further comprising calculating a pose of the mobile device based on the qualifying subset.

7 . The method of claim 1 , further comprising, for each repetition of (i), (ii), and (iii), determining a value representative of a combination of the angular distribution and the spatial distribution.

8 . The method of claim 7 , further comprising determining a value for each of a plurality of subsets of the plurality of line segments, wherein the value of the qualifying subset represents the highest combined angular distribution and spatial distribution of the plurality of subsets.

9 . The method of claim 1 , further comprising computing a reprojection error of the qualifying subset.

10 . The method of claim 9 , wherein the qualifying subset is a first qualifying subset, the method further comprising repeating (i), (ii), and (iii) to determine a second qualifying subset if the reprojection error of the first qualifying subset fails to satisfy a threshold condition.

11 . The method of claim 1 , wherein the plurality of line segments correspond to a plurality of edges in the image.

12 . An apparatus enabling line segment detection and matching in a computer vision application, the apparatus comprising:
a memory; a camera configured to capture an image of a physical environment; a processing unit communicatively coupled with the memory and the camera and configured to:
receive at least one image of a physical environment;
identify a plurality of line segments in the at least one image of the physical environment;
(i) select a first subset of the plurality of line segments in the image; (ii) compute an angular distribution and a spatial distribution of the first subset of the plurality of line segments; (iii) determine whether the angular distribution and the spatial distribution of the first subset of the plurality of line segments satisfy predetermined angular and spatial criteria; repeat (i), (ii), and (iii) with one or more new subsets of the of the plurality of line segments until a qualifying subset of the plurality of line segments is determined, the qualifying subset having a computed angular distribution and spatial distribution satisfying the predetermined angular and spatial criteria; and
provide the qualifying subset of the plurality of line segments.

13 . The apparatus of claim 12 , wherein the processing unit is further configured to determine a quality value for each line segment of the plurality of line segments, wherein selecting the first subset of the plurality of line segments is based on the quality value for each line segment.

14 . The apparatus of claim 13 , wherein the processing unit is further configured to determine the quality value for each line segment of the plurality of line segments based on at least one of:
a number of times the line segment has been observed in a series of successive images, a length of the line segment, a contrast value of the line segment, or an inverse reprojection error of the line segment.

15 . The apparatus of claim 13 , wherein the processing unit is further configured to select the first subset of the plurality of line segments in the image further comprises dividing the image into a plurality of regions, and wherein selecting the first subset of the plurality of line segments is further based on a region in which each line segment is disposed.

16 . The apparatus of claim 15 , wherein the processing unit is further configured to separate a line segment into multiple line segments, wherein a location of the separation is based on at least one boarder between regions of the plurality of regions.

17 . The apparatus of claim 12 , wherein the processing unit is further configured to calculate a pose of the apparatus based on the qualifying subset.

18 . The apparatus of claim 12 , wherein the processing unit is further configured to, for each repetition of (i), (ii), and (iii), determine a value representative of a combination of the angular distribution and the spatial distribution.

19 . The apparatus of claim 18 , wherein the processing unit is further configured to determine a value for each of a plurality of subsets of the plurality of line segments, wherein the value of the qualifying subset represents the highest combined angular distribution and spatial distribution of the plurality of subsets.

20 . The apparatus of claim 12 , wherein the processing unit is further configured to compute a reprojection error of the qualifying subset.

21 . The apparatus of claim 20 , wherein the qualifying subset is a first qualifying subset, the processing unit further configured to repeat (i), (ii), and (iii) to determine a second qualifying subset if the reprojection error of the first qualifying subset fails to satisfy a threshold condition.

22 . A device comprising:
means for receiving at least one image of a physical environment; means for identifying a plurality of line segments in the at least one image of the physical environment; means for performing the following functions:
(iv) selecting a first subset of the plurality of line segments in the image;
(v) computing an angular distribution and a spatial distribution of

Assignees

• Qualcomm Inc

Inventors

• Kim Kiyoung
• Reitmayr Gerhard

Classifications

• G06T7/246 Primary

  using feature-based methods, e.g. the tracking of corners or segments · CPC title

• G06T7/0089

  Physics · mapped topic

• G06K9/00624 Primary

  Physics · mapped topic

• G06T2207/30244

  Camera pose · CPC title