Selecting two-dimensional imagery data for display within a three-dimensional model

Patent metadata

Field	Value
Publication number	US-12456262-B2
Application number	US-202318171053-A
Country	US
Kind code	B2
Filing date	Feb 17, 2023
Priority date	Mar 19, 2014
Publication date	Oct 28, 2025
Grant date	Oct 28, 2025

Abstract

Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.

First claim

What is claimed is:

1 . A non-transitory computer-readable medium comprising executable instructions, the executable instructions being executable by one or more processors to perform a method, the method comprising:
receiving a three-dimensional model of an environment; receiving instructions representing a selection by a user of a region or an object in the three-dimensional model of the environment; selecting one or more two-dimensional images based on the instructions; and in response to a trigger, transitioning between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment that includes the one or more two-dimensional images, the trigger based on an occurrence of one of multiple trigger events, the multiple trigger events including the user navigating to a particular area in the three-dimensional model, the user staying at a particular area in the three-dimensional model for a specific period of time, and a history of behavior of the user or of multiple users in the three-dimensional model.

2 . The non-transitory computer-readable medium of claim 1 wherein selecting the one or more two-dimensional images based on the instructions includes selecting the one or more two-dimensional images based on the instructions and on one or more selection criteria.

3 . The non-transitory computer-readable medium of claim 2 , wherein the one or more selection criteria include those two-dimensional images with the most detailed views of the region or the object selected by the user.

4 . The non-transitory computer-readable medium of claim 2 , wherein the one or more selection criteria include scores for the one or more two-dimensional images based on maximizing visual fidelity in absolute spatial terms.

5 . The non-transitory computer-readable medium of claim 2 , wherein the one or more selection criteria include scores based on maximizing a visual portion of the region or the object as viewed in the three-dimensional model that is also present in two-dimensional image data in the two-dimensional view of the environment.

6 . The non-transitory computer-readable medium of claim 2 , wherein the user is a first user, and wherein the one or more selection criteria include pattern information identifying paths followed by one or more second users in association with previous navigation of the three-dimensional model by the one or more second users.

7 . The non-transitory computer-readable medium of claim 1 , the method further comprising facilitating the user navigating the three-dimensional model as rendered at a device when in a particular mode.

8 . The non-transitory computer-readable medium of claim 7 , the method further comprising facilitating an activation of an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the user navigating the three-dimensional model.

9 . The non-transitory computer-readable medium of claim 7 , wherein the particular mode is a floor plan mode.

10 . The non-transitory computer-readable medium of claim 7 , wherein the particular mode is an orbital mode.

11 . A method comprising:
receiving a three-dimensional model of an environment; receiving instructions representing a selection by a user of a region or an object in the three-dimensional model of the environment; selecting one or more two-dimensional images based on the instructions; and in response to a trigger, transitioning between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment that includes the one or more two-dimensional images, the trigger based on an occurrence of one of multiple trigger events, the multiple trigger events including the user navigating to a particular area in the three-dimensional model, the user staying at a particular area in the three-dimensional model for a specific period of time, and a history of behavior of the user or of multiple users in the three-dimensional model.

12 . The method of claim 11 , wherein selecting the one or more two-dimensional images based on the instructions includes selecting the one or more two-dimensional images based on the instructions and on one or more selection criteria.

13 . The method of claim 12 , wherein the one or more selection criteria include those two-dimensional images with the most detailed views of the region or the object selected by the user.

14 . The method of claim 12 , wherein the one or more selection criteria include scores for the one or more two-dimensional images based on maximizing visual fidelity in absolute spatial terms.

15 . The method of claim 12 , wherein the one or more selection criteria include scores based on maximizing a visual portion of the region or the object as viewed in the three-dimensional model that is also present in two-dimensional image data in the two-dimensional view of the environment.

16 . The method of claim 12 , wherein the user is a first user, and wherein the one or more selection criteria include pattern information identifying paths followed by one or more second users in association with previous navigation of the three-dimensional model by the one or more second users.

17 . The method of claim 11 , further comprising facilitating the user navigating the three-dimensional model as rendered at a device when in a particular mode.

18 . The method of claim 17 further comprising facilitating an activation of an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the user navigating the three-dimensional model.

19 . The method of claim 17 , wherein the particular mode is a floor plan mode.

20 . The method of claim 17 , wherein the particular mode is an orbital mode.

21 . A system comprising at least one processor and memory containing executable instructions, the executable instructions being executable by the at least one processor to:
receive a three-dimensional model of an environment; receive instructions representing a selection by a user of a region or an object in the three-dimensional model of the environment; select one or more two-dimensional images based on the instructions; and in response to a trigger, transition between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment that includes the one or more two-dimensional images, the trigger based on an occurrence of one of multiple trigger events, the multiple trigger events including the user navigating to a particular area in the three-dimensional model, the user staying at a particular area in the three-dimensional model for a specific period of time, and a history of behavior of the user or of multiple users in the three-dimensional model.

Assignees

• Matterport Inc
• Costar Realty Information Inc

Inventors

• Tschudy Bell Matthew
• Gausebeck David Alan
• Coombe Gregory William
• Ford Daniel
• Brown William John

Classifications

• G06T15/20

  Perspective computation · CPC title

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title

• G06T19/003 Primary

  Navigation within 3D models or images · CPC title