Selecting two-dimensional imagery data for display within a three-dimensional model

Patent metadata

Field	Value
Publication number	US-2015269785-A1
Application number	US-201414219906-A
Country	US
Kind code	A1
Filing date	Mar 19, 2014
Priority date	Mar 19, 2014
Publication date	Sep 24, 2015
Grant date	—

Abstract

Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.

First claim

What is claimed is:

1 . A system, comprising
a computer-readable storage media having stored thereon computer executable components, and a processor configured to execute the following computer executable components stored in the computer-readable storage media:
an imagery component that receives a model representing a three dimensional environment; and
a selection component that selects, based on the model, two dimensional imagery data as candidate imagery data for transitioning to.

2 . The system of claim 1 , wherein the selection component selects the two dimensional imagery data based on a defined selection criterion.

3 . The system of claim 2 , wherein the selection criterion is based on a capture position of the two dimensional imagery data.

4 . The system of claim 2 , wherein the selection criterion is based on a quality metric associated with the two dimensional imagery data.

5 . The system of claim 2 , wherein the selection criterion is based on a navigation position associated with the model.

6 . The system of claim 2 , wherein the selection component determines an orientation of the selected two dimensional imagery data.

7 . The system of claim 2 , wherein the selection component selects the two dimensional imagery data based on a weighted confidence score.

8 . The system of claim 1 , further comprising:
a construction component that renders the three dimensional model based at least in part on imagery data and position data.

9 . The system of claim 8 further comprising:
a display control component that generates, based on the model and an associated navigation position, a notification representing availability of the selected two dimensional imagery data.

10 . The system of claim 9 , wherein the display control component generates the notification as at least one of a notification token, a pop up entity, an audible signal, or a vibration signal.

11 . The system of claim 8 , further comprising:
a transition component that transitions the rendering of the model to a rendering of the selected two dimensional imagery data.

12 . The system of claim 11 , wherein the transition component renders the two dimensional imagery data as an overlay above the three dimensional model.

13 . The system of claim 11 , wherein the transition component renders the two dimensional imagery data as a rendering in an imagery portal.

14 . A method, comprising
using a processor to execute the following computer executable instructions stored in a memory to perform the following acts:
receiving a three dimensional model; and
selecting, based on the three dimensional model, a candidate two dimensional image from a set of two dimensional images for display.

15 . The method of claim 14 , wherein the acts further comprise:
receiving the three dimensional model in response to generating the three dimensional model from data describing positions and data describing images associated with an environment.

16 . The method of claim 14 wherein the acts further comprise:
in response to detecting a triggering event, generating a notification of an availability of the candidate two dimensional image.

17 . The method of claim 16 wherein the acts further comprise:
wherein the notification comprises at least one of a graphical notification, a textual notification, an audible notification, or a motion notification.

18 . The method of claim 14 wherein the acts further comprise:
generating a first display of the three dimensional model; and
navigating the first display of the three dimensional model.

19 . The method of claim 18 wherein the acts further comprise:
generating, based on the navigating of the first display, a second display of the candidate two dimensional image.

20 . A computer readable storage device comprising instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:
generating a three dimensional model of an environment based on a collection of three dimensional positional data and two dimensional image data; in response to occurrence of a first event, selecting a two dimensional image; and generating, based on the selecting the two dimensional image, a display of the two dimensional image.

21 . The computer readable storage device of claim 20 , wherein the operations further comprises:
determining occurrence of the first event based on at least one of a viewpoint of the three dimensional model, a passage of time, or user input.

22 . The computer readable storage device of claim 20 wherein the operations further comprise:
selecting the two dimensional image based on a determined distance between a viewpoint associated with the two dimensional image and a navigational position of the three dimensional model.

23 . The computer readable storage device of claim 20 , wherein the operations further comprise:
generating the three dimensional model in at least one of a walking mode, an orbital mode, or a floor plan mode.

24 . The computer readable storage device of claim 20 , wherein the operations further comprise:
generating a set of visual notification tokens within the three dimensional model.

Assignees

• Matterport Inc

Inventors

• Bell Matthew Tschudy
• Gausebeck David Alan
• Coombe Gregory William
• Ford Daniel
• Brown William John

Classifications

• G06T17/05

  Geographic models · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T19/003 Primary

  Navigation within 3D models or images · CPC title

• G06T15/20

  Perspective computation · CPC title

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title