Presenting integrated building information using building models

Patent metadata

Field	Value
Publication number	US-11238652-B2
Application number	US-202017064608-A
Country	US
Kind code	B2
Filing date	Oct 7, 2020
Priority date	Nov 12, 2019
Publication date	Feb 1, 2022
Grant date	Feb 1, 2022

Abstract

Techniques are described for using computing devices to perform automated operations related to providing visual information of multiple types in an integrated manner about a building or other defined area. The techniques may include generating and presenting a GUI (graphical user interface) on a client device that includes a computer model of the building's interior with one or more first types of information (e.g., in a first pane of the GUI), and simultaneously presenting other types of related information about the building interior (e.g., in additional separate GUI pane(s)) that is coordinated with the first type(s) of information being currently displayed. The computer model may be a 3D (three-dimensional) or 2.5D representation generated after the house is built and showing the actual house's interior (e.g., walls, furniture, etc.), and may be displayed to a user of a client computing device in a displayed GUI with various user-selectable controls.

First claim

What is claimed is:

1. A computer-implemented method comprising:
selecting, by one or more computing systems, multiple types of information about an indicated building to simultaneously show to a user in a displayed graphical user interface (GUI), wherein the multiple types of information include at least one of an image or a video showing one or more locations associated with the indicated building, and include at least a portion of a floor map of the indicated building that shows at least two-dimensional structural information for at least some of the indicated building and that indicates the one or more locations for the at least one of the image or the video;
receiving, by the one or more computing systems, one or more indications of one or more additional types of information to visually overlay on the at least portion of the floor map that are based at least in part on data acquired at the indicated building; and
presenting, by the one or more computing systems, and via the displayed GUI, the multiple types of information simultaneously in the displayed GUI, including to display the least one of the image or the video and to display the at least portion of the floor map, and visually overlaying the one or more additional types of information on the displayed at least portion of the floor map.

2. The computer-implemented method of claim 1 wherein the presenting of the multiple types of information in the displayed GUI includes using multiple panes simultaneously in the displayed GUI such that the at least portion of the floor map is displayed in a first pane and the at least one of the image or the video is displayed in one or more second panes.

3. The computer-implemented method of claim 2 wherein at least one of the one or more second panes provides an interface for an interactive tour of a plurality of viewing locations in an interior of the indicated building, and wherein the presenting of the multiple types of information includes providing user-selectable controls that modify information shown in the displayed GUI, including to display, in the at least one second pane, one or more user-selectable visual indicators of one or more viewing locations of the plurality.

4. The computer-implemented method of claim 1 wherein the presenting of the multiple types of information by the one or more computing systems includes transmitting at least the multiple types of information over one or more computer networks to a client computing device of the user for display in the GUI on the client computing device, and wherein the receiving of the one or more indications of the one or more additional types of information is based at least in part by one or more interactions of the user with one or more user-selectable controls displayed in the GUI.

5. The computer-implemented method of claim 1 wherein the one or more additional types of information include information about at least one of public spaces for the indicated building or private spaces for the indicated building, and wherein the presenting of the multiple types of information includes displaying information overlaid on the displayed at least portion of the floor map that includes visual indications of the at least one of the public spaces or the private spaces.

6. The computer-implemented method of claim 1 wherein the one or more additional types of information include information about a type of room, and wherein the presenting of the multiple types of information includes displaying information overlaid on the displayed at least portion of the floor map that includes one or more visual indications of at least one room in the indicated building that is of the type of room.

7. The computer-implemented method of claim 6 wherein the one or more additional types of information further include multiple visual icons representing multiple room types, and wherein the presenting of the multiple types of information includes displaying information overlaid on the displayed at least portion of the floor map that includes at least some of the multiple visual icons for rooms of respective types in the indicated building that are shown in the displayed at least portion of the floor map.

8. The computer-implemented method of claim 1 wherein the one or more additional types of information include information about flow patterns of people within the indicated building, and wherein the presenting of the multiple types of information includes displaying information overlaid on the displayed at least portion of the floor map that includes visual indications of the flow patterns.

9. The computer-implemented method of claim 1 wherein the one or more additional types of information include personalized information that is specific to the user about one or more spaces within the indicated building and that is based at least in part on one or more prior actions of the user, and wherein the presenting of the multiple types of information includes displaying information overlaid on the displayed at least portion of the floor map that includes visual indications of the personalized information for the one or more spaces.

10. The computer-implemented method of claim 9 wherein the personalized information specific to the user includes descriptive information previously supplied by the user about at least one of the one or more spaces.

11. The computer-implemented method of claim 1 further comprising:
receiving, via one or more user interactions with the displayed GUI, instructions to display information about one or more distances within the indicated building that are specified by the user within at least one of the displayed at least portion of the floor map or the displayed at least one of the image or the video; and
determining values of the one or more distances within the indicated building, and
wherein the one or more additional types of information include the one or more distances, and wherein the presenting of the multiple types of information includes displaying information overlaid on the displayed at least portion of the floor map that includes visual indications of the determined values of the one or more distances.

12. The computer-implemented method of claim 11 wherein the one or more user interactions about the one or more distances further indicate at least one location within the indicated building to which the one or more distances correspond, wherein the displaying of the information overlaid on the displayed at least portion of the floor map further includes placing the visual indications of the determined values of the one or more distances at one or more first positions on the displayed at least portion of the floor map that correspond to the at least one location, and wherein the presenting of the multiple types of information further includes displaying, simultaneously with the displaying of the information overlaid on the displayed at least portion of the floor map, second information that is overlaid on the displayed at least one of the image or the video at one or more second positions corresponding to the at least one location and that includes visual indications of the determined values of the one or more distances.

13. The computer-implemented method of claim 1 wherein the one or more additional types of information include information about dimensions of one or more rooms of the indicated building, and wherein the presenting of the multiple types of information includes displaying information overlaid on the displayed at least portion of the floor map that includes visual indications of the dimensions of the one or more rooms.

14. The computer-implemented method of claim 13 wherein

Assignees

• Zillow Group Inc
• Zillow Inc

Inventors

• Impas Romualdo
• Boyadzhiev Ivaylo
• Vincent Joshuah
• Li Yuguang
• Moulon Pierre

Classifications

• G06V20/20

  in augmented reality scenes · CPC title

• G06T17/05

  Geographic models · CPC title

• G06T19/003 Primary

  Navigation within 3D models or images · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T15/506

  Illumination models · CPC title