Selecting two-dimensional imagery data for display within a three-dimensional model

Patent metadata

Field	Value
Publication number	US-11600046-B2
Application number	US-202117165830-A
Country	US
Kind code	B2
Filing date	Feb 2, 2021
Priority date	Mar 19, 2014
Publication date	Mar 7, 2023
Grant date	Mar 7, 2023

Abstract

Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.

First claim

What is claimed is:

1. A system, comprising:
a memory that stores computer executable components; and
a processor that executes at least the following computer executable components stored in the memory:
a construction component that generates a three-dimensional model of an environment;
a display control component that receives instructions representing a first user's selection of a region or an object in the three-dimensional model of the environment;
a selection component that selects a sequence of two-dimensional images based on the received instructions and one of a plurality of selection criteria; and
a transitioning component that facilitates transitioning, in response to a trigger, between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment, the trigger being based on an occurrence of one of a plurality of trigger events, the plurality of trigger events including navigation to a particular point of the three-dimensional model, based on a history of use, and data representing user input.

2. The system of claim 1 , wherein the one the plurality of selection criteria includes selecting two-dimensional image data with the most detailed view of the first user's selected region or object.

3. The system of claim 1 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing visual fidelity in absolute spatial terms.

4. The system of claim 1 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing a visual portion of the region or the object as viewed in the three-dimensional model that is also present in two dimensional image data in the two-dimensional view of the environment.

5. The system of claim 1 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second users in association with previous navigation of the three-dimensional model by the plurality of second users.

6. The system of claim 1 , wherein the processor further executes:
a navigational component that facilitates navigating the three-dimensional model as rendered at a device when in a particular mode.

7. The system of claim 6 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the navigation of the three-dimensional model.

8. The system of claim 6 , wherein the particular mode is a floor plan mode.

9. The system of claim 6 , wherein the particular mode is an orbital mode.

10. A method comprising:
generating, by a system, a three-dimensional model of an environment;
receiving, by the system, instructions representing a first user's selection of a region or an object in the three-dimensional model of the environment;
selecting, by the system, a sequence of two-dimensional images based on the received instructions and one of a plurality of selection criteria; and
transitioning, by the system, in response to a trigger, between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment, the trigger being based on an occurrence of one of a plurality of trigger events, the plurality of trigger events including navigation to a particular point of the three-dimensional model, based on a history of use, and data representing user input.

11. The method of claim 10 , wherein the one the plurality of selection criteria includes selecting two-dimensional image data with the most detailed view of the first user's selected region or object.

12. The method of claim 10 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing visual fidelity in absolute spatial terms.

13. The method of claim 10 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing a visual portion of the region or the object as viewed in the three-dimensional model that is also present in two dimensional image data in the two-dimensional view of the environment.

14. The method of claim 10 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second users in association with previous navigation of the three-dimensional model by the plurality of second users.

15. The method of claim 10 , further comprising:
navigating the three-dimensional model as rendered at a device when in a particular mode.

16. The method of claim 10 , further comprising:
activating an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the navigation of the three-dimensional model.

17. The method of claim 15 , wherein the particular mode is a floor plan mode.

18. The method of claim 15 , wherein the particular mode is an orbital mode.

19. A non-transitory machine-readable storage medium, comprising executable instructions that, when executed by a processor of a device, facilitate performance of operations, comprising:
generating a three-dimensional model of an environment;
receiving instructions representing a first user's selection of a region or an object in the three-dimensional model of the environment;
selecting a sequence of two-dimensional images based on the received instructions and one of a plurality of selection criteria; and
transitioning, in response to a trigger, between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment, the trigger being based on an occurrence of one of a plurality of trigger events, the plurality of trigger events including navigation to a particular point of the three-dimensional model, based on a history of use, and data representing user input.

20. The non-transitory machine-readable storage medium of claim 19 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second users in association with previous navigation of the three-dimensional model by the plurality of second users.

Assignees

• Matterport Inc

Inventors

• Bell Matthew Tschudy
• Gausebeck David Alan
• Coombe Gregory William
• Ford Daniel
• Brown William John

Classifications

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title

• G06T19/003 Primary

  Navigation within 3D models or images · CPC title

• G06T15/20

  Perspective computation · CPC title