Optical data processing device, optical data processing system, optical data processing method, and optical data processing program

Patent metadata

Field	Value
Publication number	US-9977983-B2
Application number	US-201314420401-A
Country	US
Kind code	B2
Filing date	Jun 20, 2013
Priority date	Aug 9, 2012
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

A processing for specifying a correspondence relationship of feature points between two sets of optical data can be highly precise and efficiently carried out. The correspondence relationship of the perpendicular edges is obtained based on the assumption that the object is a building, in the processing for integrating the three-dimensional model obtained from the point cloud position data and the three-dimensional model obtained from the stereophotographic image. In this case, one perpendicular edge is defined by the relative position relationship with the other perpendicular edge, and the correspondence relationship is high-precisely and rapidly searched.

First claim

The invention claimed is:

1. An optical data processing device comprising:
processing circuitry configured to:
extract at least three three-dimensional edges that extend in a specific and same direction from a first three-dimensional model, as a first group of three-dimensional edges, and for extracting at least three three-dimensional edges that extend in the specific and same direction from a second three-dimensional model, as a second group of three-dimensional edges,
specify a relative position against other plural three-dimensional edges in each of the first group of three-dimensional edges and a relative position against other plural three-dimensional edges in each of the second group of three-dimensional edges,
calculate a similarity between the relative position in each of the first group of three-dimensional edges and the relative position in each of the second group of three-dimensional edges, and
select one edge in the second group of three-dimensional edges corresponding to one edge in the first group of three-dimensional edges based on the similarity,

wherein each relative position is specified based on a distance between a target three-dimensional edge and a respective of the other plural three-dimensional edges and an angle direction of the respective of the other plural three-dimensional edges viewed from the target three-dimensional edge, and
wherein each relative position is defined by a combination of multiple vectors in which a specific three-dimensional edge and other multiple three-dimensional edges are connected.

2. The optical data processing device according to claim 1 , wherein the similarity is evaluated by lengths of the multiple vectors and angles of the multiple vectors against a predetermined first direction.

3. The optical data processing device according to claim 1 , wherein the specific direction is a perpendicular direction.

4. The optical data processing device according to claim 1 , wherein the specific three-dimensional edge is specified by endpoints of a line segment that constitutes the specific three-dimensional edge.

5. The optical data processing device according to claim 1 , wherein at least one of the first three-dimensional model and the second three-dimensional model is a three-dimensional model based on a stereophotographic image.

6. The optical data processing device according to claim 5 , the processing circuitry further configured to calculate an external orientation element of left and right photographic images based on a perpendicular edge in the left and right photographic images that constitute the stereophotographic image.

7. The optical data processing device according to claim 6 ,
wherein the three-dimensional model based on the stereophotographic image expands or contracts, and
the processing circuitry further configured to:
adjust a scale of the three-dimensional model based on the stereophotographic image, so as to match each position of the first group of three-dimensional edges and each position of the second group of three-dimensional edges selected by a selecting unit, and
integrate the three-dimensional model based on the stereophotographic image in which the scale is adjusted and other three-dimensional models, based on a combination of the first group of three-dimensional edges and the second group of three-dimensional edges selected by the selecting unit.

8. The optical data processing device according to claim 1 , wherein the first three-dimensional model is a three-dimensional model based on a three-dimensional point cloud position data obtained by a reflected light of a laser beam, and the second three-dimensional model is a three-dimensional model based on a stereophotographic image or the first three-dimensional model and the second three-dimensional model are three-dimensional models based on a stereophotographic image.

9. The optical data processing device according to claim 1 , wherein the first three-dimensional model and the second three-dimensional model are three-dimensional models based on three-dimensional point cloud position data obtained by a reflected light of a laser beam.

10. An optical data processing system comprising:
processing circuitry configured to:
extract at least three three-dimensional edges that extend in a specific and same direction from a first three-dimensional model, as a first group of three-dimensional edges, and for extracting at least three three-dimensional edges that extend in the specific and same direction from a second three-dimensional model, as a second group of three-dimensional edges,
specify a relative position against other plural three-dimensional edges in each of the first group of three-dimensional edges and a relative position against other plural three-dimensional edges in each of the second group of three-dimensional edges,
calculate a similarity between the relative position in each of the first group of three-dimensional edges and the relative position in each of the second group of three-dimensional edges, and
select one edge in the second group of three-dimensional edges corresponding to one edge in the first group of three-dimensional edges based on the similarity,

wherein each relative position is specified based on a distance between a target three-dimensional edge and a respective of the other plural three-dimensional edges and an angle direction of the respective of the other plural three-dimensional edges viewed from the target three-dimensional edge, and
wherein each relative position is defined by a combination of multiple vectors in which a specific three-dimensional edge and other multiple three-dimensional edges are connected.

11. An optical data processing method comprising:
extracting at least three three-dimensional edges that extend in a specific and same direction from a first three-dimensional model, as a first group of three-dimensional edges, and for extracting at least three three-dimensional edges that extend in the specific and same direction from a second three-dimensional model, as a second group of three-dimensional edges,
specifying a relative position against other plural three-dimensional edges in each of the first group of three-dimensional edges and a relative position against other plural three-dimensional edges in each of the second group of three-dimensional edges,
calculating a similarity between the relative position in each of the first group of three-dimensional edges and the relative position in each of the second group of three-dimensional edges, and
selecting one edge in the second group of three-dimensional edges corresponding to one edge in the first group of three-dimensional edges based on the similarity,
wherein each relative position is specified based on a distance between a target three-dimensional edge and a respective of the other plural three-dimensional edges and an angle direction of the respective of the other plural three-dimensional edges viewed from the target three-dimensional edge, and
wherein each relative position is defined by a combination of multiple vectors in which a specific three-dimensional edge and other multiple three-dimensional edges are connected.

12. A non-transitory computer readable medium including an optical data processing program that is read and run by a computer, the program actuating the computer to operate as:
an extracting means for extracting at least three three-dimensional edges that extend in a specific and same direction from a first three-dimensional model, as a first group of three-dimensional edges, and for extracting at least three three-dimensional edges that extend in the specific and same direction from a second three-dimensional m

Assignees

• Kk Topcon

Inventors

• Kochi Nobuo
• Kitamura Kazuo

Classifications

• G01B11/00 Primary

  Measuring arrangements characterised by the use of optical techniques · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06T7/593

  from stereo images · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title