Systems and methods for generating time discrete 3d scenes

Patent metadata

Field	Value
Publication number	US-2017193693-A1
Application number	US-201615394689-A
Country	US
Kind code	A1
Filing date	Dec 29, 2016
Priority date	Dec 31, 2015
Publication date	Jul 6, 2017
Grant date	—

Abstract

Methods, systems, and apparatus including medium-encoded computer program products for generating and visualizing 3D scenes include, in one aspect, a method including: obtaining site data acquired by one or more capture devices, wherein the site data comprises data sets corresponding to two or more locations about a physical site, and each respective data set comprises (i) imaging data of the physical site, (ii) coordinate data for the imaging data, and (iii) time metadata for the imaging data; reconstructing a series of three dimensional (3D) modeled scenes of the physical site from the site data using the imaging data, the coordinate data, and the time metadata; receiving a request having associated position, orientation and time data; and generating, in response to the request, output for display of a portion of the 3D modeled scenes to represent the physical site based on the position, orientation and time data.

First claim

What is claimed is:

1 . A method comprising:
obtaining site data acquired by one or more capture devices, wherein the site data comprises data sets corresponding to two or more locations about a physical site, and each respective data set comprises (i) imaging data of the physical site, (ii) coordinate data for the imaging data, and (iii) time metadata for the imaging data; reconstructing a series of three dimensional (3D) modeled scenes of the physical site from the site data using the imaging data, the coordinate data, and the time metadata; receiving a request having associated position, orientation and time data; and generating, in response to the request, output for display of a portion of the 3D modeled scenes to represent the physical site based on the position, orientation and time data.

2 . The method of claim 1 , wherein the one or more capture devices comprise multiple capture devices including at least one camera that captures two dimensional (2D) images as the imaging data, and at least one scanner that captures 3D range data as the imaging data, and wherein each of the multiple capture devices provides a different perspective of the physical site.

3 . The method of claim 1 , wherein the one or more capture devices comprise a single capture device that is positioned at the two or more locations about the physical site to provide different perspectives of the physical site.

4 . The method of claim 1 , wherein the physical site is a building construction site.

5 . The method of claim 1 , wherein the request is received from a mobile device located at the physical site, and wherein the output for display of a portion of the 3D modeled scenes is transmitted to the mobile device for use in displaying the portion of the 3D modeled scenes at the mobile device.

6 . The method of claim 5 , comprising obtaining annotation metadata acquired through a user interface element of the mobile device, wherein the annotation metadata is associated with the portion of the 3D modeled scenes displayed at the mobile device.

7 . The method of claim 5 , comprising iteratively generating two or more perspective discrete outputs for display of a portion of the 3D modeled scenes based on additionally received position and orientation data, wherein the additionally received position and orientation data is generated through motion input via physical movement of the mobile device.

8 . The method of claim 5 , comprising iteratively generating two or more time discrete outputs for display, wherein the two or more time discrete outputs correspond to a portion of the 3D modeled scenes with time metadata associated with additionally received time data through a user interface element of the mobile device.

9 . The method of claim 8 , wherein the two or more time discrete outputs are displayed as two dimensional (2D) images or 3D scenes at the mobile device.

10 . The method of claim 8 , wherein the iteratively generating the two or more time discrete outputs for display comprises generating a modeled scene to be superimposed onto live imaging data of the physical site currently captured by the mobile device, wherein the superimposed modeled scene is displayed as 2D images or 3D scenes at the mobile device.

11 . The method of claim 1 , wherein the physical site is a first physical site of a first project, the series of 3D modeled scenes are a series of first 3D modeled scenes in a first coordinate space, and the method comprising:
loading a series of second 3D modeled scenes in a second coordinate space for a second physical site of a second project; and registering the first coordinate space with the second coordinate space; wherein the generating comprises superimposing the portion of the first 3D modeled scenes of the first physical site on a portion of the second 3D modeled scenes of the second physical site.

12 . A system comprising:
a computer network; one or more capture devices communicatively coupled with the computer network, wherein the one or more capture devices are positioned about a physical site and programed to acquire site data associated with two or more locations about the physical site; one or more computing devices communicatively coupled with the computer network and programed to (i) obtain the site data acquired by the one or more capture devices, wherein the site data comprises data sets corresponding to the two or more locations about the physical site, and each respective data set comprises (a) imaging data of the physical site, (b) coordinate data for the imaging data, and (c) time metadata for the imaging data, (ii) reconstruct a series of three dimensional (3D) modeled scenes of the physical site from the site data using the imaging data, the coordinate data, and the time metadata, (iii) receive a request having associated position, orientation and time data; and (iv) generate, in response to the request, output for display of a portion of the 3D modeled scenes to represent the physical site based on the position, orientation and time data.

13 . The system of claim 12 , wherein the one or more capture devices comprise multiple capture devices including at least one camera that captures two dimensional (2D) images as the imaging data, and at least one scanner that captures 3D range data as the imaging data, and wherein each of the multiple capture devices provides a different perspective of the physical site.

14 . The system of claim 12 , wherein the one or more capture devices comprise a single capture device that is positioned at the two or more locations about the physical site to provide different perspectives of the physical sites.

15 . The system of claim 12 , wherein the one or more capture devices are further programed to acquire the site data at one or more predetermined capture times, and wherein the one or more predetermined capture times are included within the time metadata for the imaging data.

16 . The system of claim 12 , wherein the physical site is a building construction site.

17 . The system of claim 12 , comprising a mobile device communicatively coupled with the computer network, wherein the mobile device is located at the physical site and programed to (i) transmit the request, (ii) receive the output of a portion of the 3D modeled scenes, and (iii) display the output of a portion of the 3D modeled scenes.

18 . The system of claim 17 , wherein the mobile device comprises a user interface element for acquiring annotation metadata associated with the portion of the 3D modeled scenes displayed at the mobile device.

19 . The system of claim 17 , wherein the one or more computing devices are further programed to iteratively generate two or more perspective discrete outputs for display of a portion of the 3D modeled scenes based on additionally received position and orientation data, wherein the additionally received position and orientation data is generated through motion input via physical movement of the mobile device.

20 . The system of claim 17 , wherein the one or more computing devices are further programed to iteratively generate two or more time discrete outputs for display, wherein the two or more time discrete outputs correspond to a portion of the 3D modeled scenes with time metadata associated with additionally received time data through a user interface element of the mobile device,

21 . The system of claim 20 , wherein the two or more time discrete outputs are displayed as 2D images or 3D scenes at the mobile device.

Assignees

• Autodesk Inc

Inventors

• Robert Luc
• Gallo Emmanuel

Classifications

• H04N1/00

  Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof · CPC title

• G06T7/55

  from multiple images · CPC title

• H04N13/25

  using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor · CPC title

• G06T17/00 Primary

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G01B11/24 Primary

  for measuring contours or curvatures · CPC title