Selecting two-dimensional imagery data for display within a three-dimensional model

Patent metadata

Field	Value
Publication number	US-10909758-B2
Application number	US-201816155151-A
Country	US
Kind code	B2
Filing date	Oct 9, 2018
Priority date	Mar 19, 2014
Publication date	Feb 2, 2021
Grant date	Feb 2, 2021

Abstract

Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.

First claim

What is claimed is:

1. A system, comprising:
a memory that stores computer executable components; and
a processor that executes at least the following computer executable components stored in the memory:
a construction component that generates a three-dimensional model of an environment, the three-dimensional model including at least one wall separating the environment and an area external to the environment;
a navigation component that facilitates navigating the three-dimensional model as rendered at a device when in a particular mode, wherein the navigation component determines a current position and a viewpoint of a virtual camera within the three-dimensional model and a field of view; and
a selection component that selects between two-dimensional imagery and three-dimensional imagery to display within the viewpoint of the virtual camera within the three-dimensional model, the selection being based on a plurality of selection criteria one of the plurality of selection criteria including at least a presence of a hole at a particular location of the at least one wall, wherein upon satisfaction of the one of the plurality of selection criteria, the selection component provides the two-dimensional imagery corresponding the particular location of the at least one wall to the device for rendering, otherwise enabling the three-dimensional imagery to be rendered by the device.

2. The system of claim 1 , wherein the selection component selects between the two-dimensional imagery or the three-dimensional imagery in the viewpoint of the virtual camera within the three-dimensional model prior to initiation of the navigation of the three-dimensional model.

3. The system of claim 1 , wherein the navigation of the three-dimensional model is associated with a user identity, and wherein the one of the plurality of selection criteria is based on pattern information identifying one or more navigation paths previously followed by the user identity in association with previous navigation of the three-dimensional model.

4. The system of claim 1 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second user identities in association with previous navigation of the three-dimensional model by the second user identities.

5. The system of claim 1 , wherein the navigation component further facilitates navigating the three-dimensional model using a manual navigation mode, wherein the manual navigation mode comprises providing imagery of the three-dimensional model to the device for rendering based on user input indicating a desired perspective for viewing the three-dimensional model in association with the navigation of the three-dimensional model.

6. The system of claim 5 , wherein the one of the plurality of selection criteria is based on pattern information identifying one or more navigation paths followed in association with navigation of the three-dimensional model using the manual navigation mode.

7. The system of claim 5 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to user input selecting a transition from the manual navigation mode to the automatic navigation mode.

8. The system of claim 5 , wherein the navigation component transitions to the manual navigation mode in response to reception of user input indicating a desire to deactivate the automatic navigation mode.

9. The system of claim 1 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to reception of user input indicating a request to view a predefined location or area of the three-dimensional model.

10. The system of claim 1 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the navigation of the three-dimensional model.

11. A method comprising:
generating, by a system, a three-dimensional model of an environment, the three-dimensional model including at least one wall separating the environment from an area external to the environment;
facilitating, by the system, navigating the three-dimensional model as rendered at a device when in a particular mode, wherein the navigating the three-dimensional model includes determining a current position and viewpoint of a virtual camera within the three-dimensional model and a field of view;
selecting, by the system, between two-dimensional imagery and three-dimensional imagery to display within the viewpoint of the virtual camera within the three-dimensional model, the selection being based on a plurality of selection criteria, one of the plurality of selection criteria including at least a presence of a hole at a particular location of the at least one wall, wherein upon satisfaction of the one of the plurality of selection criteria, providing the two-dimensional imagery corresponding to the particular location of the at least one wall to the device for rendering, otherwise enabling the three-dimensional imagery to be rendered by the device.

12. The method of claim 11 , wherein the selecting comprises selecting between the two-dimensional imagery or the three-dimensional imagery in the viewpoint of the virtual camera within the three-dimensional model prior to initiation of the navigation of the three-dimensional model.

13. The method of claim 11 , wherein the navigation of the three-dimensional model is associated with a user identity, and wherein the one of the plurality of selection criteria is based on pattern information identifying one or more navigation paths previously followed by the user identity in association with previous navigation of the three-dimensional model.

14. The method of claim 11 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second user identities in association with previous navigation of the three-dimensional model by the second user identities.

15. The method of claim 11 , wherein the facilitating further comprises facilitating the navigating of the three-dimensional using a manual navigation mode, wherein the manual navigation mode comprises providing imagery of the three-dimensional model to the device for rendering based on user input indicating a desired perspective for viewing the three-dimensional model in association with the navigation of the three-dimensional model.

16. The method of claim 15 , further comprising:
receiving, by the system, user input selecting a transition from the manual navigation mode to an automatic navigation mode; and
activating, by the system, the automatic navigation mode based on the receiving the user input.

17. The method of claim 11 , further comprising:
receiving, by the system, user input indicating a request to view a predefined location or area of the three-dimensional model; and
activating, by the system, an automatic navigation mode based on the receiving the user input.

18. A non-transitory machine-readable storage medium, comprising executable instructions that, when executed by a processor of a device, facilitate performance of operations, comprising:
generating a three-dimensional model of an environment, the three-dimensional model including at least one wall separating the environment and an area external to the environment;
navigating the three-dimensional model as rendered at a device when in a particular mode, wherein the navigating determines a current

Assignees

• Matterport Inc

Inventors

• Bell Matthew Tschudy
• Gausebeck David Alan
• Coombe Gregory William
• Ford Daniel
• Brown William John

Classifications

• G06T19/003 Primary

  Navigation within 3D models or images · CPC title

• G06T15/20

  Perspective computation · CPC title

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title