Systems and methods for generating three dimensional geometry

Patent metadata

Field	Value
Publication number	US-11113877-B2
Application number	US-202016990453-A
Country	US
Kind code	B2
Filing date	Aug 11, 2020
Priority date	Nov 5, 2008
Publication date	Sep 7, 2021
Grant date	Sep 7, 2021

Abstract

Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.

First claim

We claim:

1. A method of generating a building model, the method comprising:
receiving a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;
creating, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;
defining a plurality of edges within the point cloud for at least one of the plurality of surfaces;
creating a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;
constructing a 3D building model of the building object based on the simplified geometry;
correlating at least two vertices of the 3D building model with an orthogonal image of the building object; and
scaling the 3D building model based on the correlated orthogonal image.

2. The method of claim 1 , wherein the plurality of initial two-dimensional images consists of ground-level images.

3. The method of claim 1 , wherein the plurality of initial two-dimensional images consists of oblique images.

4. The method of claim 1 , wherein defining a plurality of edges further comprises determining a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

5. The method of claim 1 , further comprising texturing the 3D building model.

6. The method of claim 5 , wherein the texturing is wrapping at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

7. The method of claim 1 , wherein the at least one surface is a building façade.

8. A system for generating a model, the system comprising:
an image database storing a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;
an image processor, operative with the image database, configured to:
create, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;
define a plurality of edges within the point cloud for each of the at least one of the plurality of surfaces;
create a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;
construct a 3D building model of the building object based on the simplified geometry;
correlate at least two vertices of the 3D building model with an orthogonal image of the building object; and
scale the 3D building model based on the correlated orthogonal image.

9. The system of claim 8 , wherein the plurality of initial two-dimensional images consists of ground-level images.

10. The system of claim 8 , wherein the plurality of initial two-dimensional images consists of oblique images.

11. The system of claim 8 , wherein to define the plurality of edges the processor is further configured to determine a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

12. The system of claim 8 , wherein the image processor is further configured to texture the 3D building model.

13. The system of claim 12 , wherein to texture is to wrap at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

14. The system of claim 8 , wherein the at least one surface is a building façade.

15. A method of generating a building model, the method comprising:
receiving a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;
creating, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;
defining a plurality of edges within the point cloud for at least one of the plurality of surfaces;
creating a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;
constructing a 3D building model of the building object based on the simplified geometry;
correlating at least two vertices among the 3D building model with an oblique image of the building object; and
scaling the 3D building model based on the correlated oblique image.

16. The method of claim 15 , wherein the plurality of initial two-dimensional images consists of ground-level images.

17. The method of claim 15 , wherein the plurality of initial two-dimensional images consists of orthogonal images.

18. The method of claim 15 , wherein defining a plurality of edges further comprises determining a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

19. The method of claim 15 , further comprising texturing the 3D building model.

20. The method of claim 19 , wherein the texturing is wrapping at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

21. The method of claim 15 , wherein the at least one surface is a building façade.

22. A system for generating a model, the system comprising:
an image database storing a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;
an image processor, operative with the image database, configured to:
create, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;
define a plurality of edges within the point cloud for at least one of the plurality of surfaces;
create a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;
construct a 3D building model of the building object based on the simplified geometry;
correlate at least two vertices of the 3D building model with an oblique image of the building object; and
scale the 3D building model based on the correlated oblique image.

23. The system of claim 22 , wherein the plurality of initial two-dimensional images consists of ground-level images.

24. The system of claim 22 , wherein the plurality of initial two-dimensional images consists of orthogonal images.

25. The system of claim 22 , wherein to define the plurality of edges the processor is further configured to determine a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

26. The system of claim 22 , wherein the image processor is further configured to texture the 3D building model.

27. The system of claim 26 , wherein to texture is to wrap at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

28. The system of claim 22 , wherein the at least one surface is a building facade.

Assignees

• Hover Inc

Inventors

• Sun Shaohui
• Pavlidis Ioannis
• Altman Adam J

Classifications

• G06T19/003

  Navigation within 3D models or images · CPC title

• G06T15/20

  Perspective computation · CPC title

• G06T2210/04

  Architectural design, interior design · CPC title

• G06T15/04 Primary

  Texture mapping · CPC title

• G06V20/176

  Urban or other man-made structures · CPC title