Image capture for a multi-dimensional building model

Patent metadata

Field	Value
Publication number	US-12190446-B2
Application number	US-202217993377-A
Country	US
Kind code	B2
Filing date	Nov 23, 2022
Priority date	May 29, 2015
Publication date	Jan 7, 2025
Grant date	Jan 7, 2025

Abstract

A process for receiving, from a computing device, a series of captured building images. The process continues by processing, in real-time, each building image in the series of captured building images to determine if each building image meets a minimum criterion, wherein the minimum criteria includes applicability to be used in constructing a specific digital multi-dimensional building model. The process continues by aggregating each image meeting the minimum criteria, determining when a base set of building images has been aggregated, wherein the base set of building images includes a threshold number images to model at least a partial multi-dimensional building model representing the series of captured building images, determining one or more facades present in the partial multi-dimensional building model, determining preliminary dimensions for one or more architectural features of the one or more facades and returning, incrementally (in real-time), the preliminary dimensions to the computing device.

First claim

What is claimed is:

1. A method of minimizing image capture for multi-dimensional reconstruction, the method comprising:
receiving a request for a multi-dimensional building model based on a minimum criteria, wherein the minimum criteria establishes building images necessary to produce the multi-dimensional building model;
processing a first building image of a building object and a second building image of the building object, wherein processing the first building image and the second building image comprises determining, by one or more processors, if a first minimum criterion is present in the first building image or the second building image;
selecting the first building image or the second building image based on the presence of the first minimum criterion in one of the first building image or the second building image;
receiving one or more additional building images comprising imagery of the building object;
aggregating the one or more additional building images with the selected first building image or the second building image based on the presence of a second minimum criterion in the one or more additional building images; and
constructing the multi-dimensional building model of the building object from aggregated building images.

2. The method of claim 1 , wherein the minimum criteria comprises the first minimum criterion and the second minimum criterion.

3. The method of claim 1 , wherein the first minimum criterion and the second minimum criterion are separate minimum criterion.

4. The method of claim 1 , wherein the minimum criteria comprises a plurality of facades.

5. The method of claim 4 , wherein the minimum criteria further comprises architectural features of the plurality of facades.

6. The method of claim 5 , wherein the architectural features comprise roofing or gables.

7. The method of claim 5 , wherein the architectural features comprise windows or doors.

8. The method of claim 1 , wherein the minimum criteria comprises a post of the building object.

9. The method of claim 8 , wherein the post of the building object is a corner.

10. The method of claim 1 , wherein the first building image, the second building image, and the one or more additional building images are captured building images.

11. The method of claim 1 , wherein the first building image, the second building image, and the one or more additional building images are interior building images.

12. The method of claim 11 , wherein the multi-dimensional building model comprises interior facades.

13. The method of claim 1 , wherein the first building image, the second building image, and the one or more additional building images are exterior building images.

14. The method of claim 13 , wherein the multi-dimensional building model comprises exterior facades.

15. The method of claim 1 , wherein the first building image, the second building image, and the one or more additional building images are captured by a portable camera.

16. The method of claim 15 , wherein the portable camera includes any of: a smartphone, a tablet computer, a wearable computer, or a drone.

17. The method of claim 1 , wherein the one or more processors comprise an artificial intelligence system.

18. The method of claim 1 , wherein the multi-dimensional building model comprises a partial multi-dimensional building model.

19. The method of claim 1 , wherein the multi-dimensional building model comprises a base building model.

20. One or more non-transitory computer readable medium storing instructions that, when executed, cause a processor to execute operations comprising:
receiving a request for a multi-dimensional building model based on a minimum criteria, wherein the minimum criteria establishes building images necessary to produce the multi-dimensional building model;
processing a first building image of a building object and a second building image of the building object, wherein processing the first building image and the second building image comprises determining, by one or more processors, if a first minimum criterion is present in the first building image or the second building image;
selecting the first building image or the second building image based on the presence of the first minimum criterion in one of the first building image or the second building image;
receiving one or more additional building images comprising imagery of the building object;
aggregating the one or more additional building images with the selected first building image or the second building image based on the presence of a second minimum criterion in the one or more additional building images; and
constructing the multi-dimensional building model of the building object from aggregated building images.

21. The one or more non-transitory computer readable medium of claim 20 , wherein the minimum criteria comprises the first minimum criterion and the second minimum criterion.

22. The one or more non-transitory computer readable medium of claim 20 , wherein the first minimum criterion and the second minimum criterion are separate minimum criterion.

23. The one or more non-transitory computer readable medium of claim 20 , wherein the minimum criteria comprises a plurality of facades.

24. The one or more non-transitory computer readable medium of claim 23 , wherein the minimum criteria further comprises architectural features of the plurality of facades.

25. The one or more non-transitory computer readable medium of claim 24 , wherein the architectural features comprise roofing or gables.

26. The one or more non-transitory computer readable medium of claim 24 , wherein the architectural features comprise windows or doors.

27. The one or more non-transitory computer readable medium of claim 20 , wherein the minimum criteria comprises a post of the building object.

28. The one or more non-transitory computer readable medium of claim 27 , wherein the post of the building object is a corner.

29. The one or more non-transitory computer readable medium of claim 20 , wherein the first building image, the second building image, and the one or more additional building images are captured building images.

30. The one or more non-transitory computer readable medium of claim 20 , wherein the first building image, the second building image, and the one or more additional building images are interior building images.

31. The one or more non-transitory computer readable medium of claim 30 , wherein the multi-dimensional building model comprises interior facades.

32. The one or more non-transitory computer readable medium of claim 20 , wherein the first building image, the second building image, and the one or more additional building images are exterior building images.

33. The one or more non-transitory computer readable medium of claim 32 , wherein the multi-dimensional building model comprises exterior facades.

34. The one or more non-transitory computer readable medium of claim 20 , wherein the first building image, the second building image, and the one or more additional building images are captured by a portable camera.

35. The one or more non-transitory computer readable medium of claim 34 , wherein the portable camera includes any of: a smartphone, a tablet computer, a wearable com

Assignees

• Hover Inc

Inventors

• Upendran Manish
• Castillo William
• Mishra Ajay
• Altman Adam J

Classifications

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• G06T2210/04

  Architectural design, interior design · CPC title

• G06T17/00 Primary

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title