Mobile three-dimensional model creation platform and methods

Patent metadata

Field	Value
Publication number	US-9767566-B1
Application number	US-201414476725-A
Country	US
Kind code	B1
Filing date	Sep 3, 2014
Priority date	Sep 3, 2014
Publication date	Sep 19, 2017
Grant date	Sep 19, 2017

Abstract

A method of analyzing the dimensions of an interior. The method comprises capturing a first image of the interior with a first camera of a mobile communication device and capturing a second image of the interior with a second camera of the mobile communication device. The method further comprises analyzing the first image and the second image by the mobile communication device and, based at least in part on the analysis of the first image and the second image, determining a three-dimensional model of the interior. The method further comprises transmitting a transaction by a radio transceiver of the mobile communication device, wherein the transaction is based on the three-dimensional model of the interior and wherein the transaction is one of an insurance claim estimate, a contractor material order, or a real-estate broker listing.

First claim

What is claimed is:

1. A mobile communication device, comprising:
a radio frequency transceiver;
a processor;
a non-transitory memory;
a first camera;
a second camera;
an infrared camera;
an orientation sensor, wherein the orientation sensor is configured to determine a physical orientation of the mobile communication device when the mobile communication device is located at a location in an interior of a room; and
an application stored in the non-transitory memory that, when executed by the processor,
produces an orientation indication based on the determined physical orientation of the mobile communication device within the interior of the room,
determines, via the orientation sensor, that the mobile device is accelerating in at least one of three orthogonal axes,
analyzes at least a first image captured by the first camera, at least a second image captured by the second camera, at least a third image captured by the infrared camera, and the orientation indication,
determines surfaces characteristics and depth information associated with the interior of the room based on the analysis and determined acceleration,
identifies at least one surface in the room as a glass surface based on the analysis of the third image captured by the infrared camera, and
develops a three-dimensional model corresponding to the interior of the room based on the analysis, wherein the three dimensional model defines a plurality of surfaces including the at least one surface and designates that the at least one surface is a glass surface.

2. The mobile communication device of claim 1 , further comprising:
a second application stored in the memory that, when executed by the processor,
creates a transaction request based on the three-dimensional model; and
transmits the transaction request via the radio frequency transceiver.

3. The mobile communication device of claim 2 , wherein the radio frequency transceiver is a cellular radio frequency transceiver.

4. The mobile communication device of claim 1 , wherein the orientation sensor comprises a three axis accelerometer.

5. The mobile communication device of claim 1 , further comprising a projector configured to project one of a light spot or an image, whereby the mobile communication device is aligned in preparation for capturing the first image and the second image.

6. The mobile communication device of claim 1 , further comprising a touchscreen, wherein the application further presents a view of the three-dimensional model on the touchscreen and prompts for identification of doors and windows in the view.

7. The mobile communication device of claim 1 , wherein the application identifies a window in the three-dimensional model based on the third image.

8. The mobile communication device of claim 1 , wherein the first and second images are images of the interior of the room.

9. The mobile communication device of claim 8 , wherein the three-dimensional model comprises estimates of a length, breadth, and depth of surfaces of the interior and a designation of a material of each of the plurality of surfaces of the interior.

10. The mobile communication device of claim 9 , further comprising:
a second application stored in the memory that, when executed by the processor,
builds a transaction based on the estimates of the length, breadth, and depth of the surfaces of the interior and the designation of the material of each of the plurality of surfaces of the interior; and
transmits the transaction via the radio frequency transceiver.

11. The mobile communication device of claim 10 , wherein transmitting the transaction by the radio transceiver comprises the radio transceiver communicating using at least one of a code division multiple access (CDMA) wireless communication protocol, a global system for mobile communication (GSM) wireless communication protocol, a long-term evolution (LTE) wireless communication protocol, or a worldwide access for microwave access (WiMAX) wireless communication protocol.

12. The mobile communication device of claim 10 , wherein the transaction is one of an insurance claim for replacement of damage in the interior, a contractor remodeling bid for remodeling at least some of the interior, or a detailed real-estate listing.

13. The mobile communication device of claim 12 , wherein the second application, when executed by the processor, further:
determines an amount of material to complete the remodeling bid based on the three-dimensional model,
builds a contractor material order based on the amount of material, and
transmits the contractor material order via the radio transceiver to complete a purchase transaction with a materials store.

14. The mobile communication device of claim 13 , wherein the material comprises paint or lumber.

15. The mobile communication device of claim 13 , wherein the determination of the amount of material comprises including a pre-defined amount of extra margin.

16. The mobile communication device of claim 2 , wherein the transaction request is for one of an insurance claim for replacement of damage at the location, a contractor remodeling bid for remodeling at the location, a detailed real-estate listing associated with the location, or a landscaping bid for a back yard of a property at the location.

17. The mobile communication device of claim 1 , wherein the mobile communication device is one of a mobile phone or a smart phone.

18. The mobile communication device of claim 2 , wherein the transaction is for a detailed real-estate listing associate with the location.

19. The mobile communication device of claim 2 , wherein the transaction is for an insurance claim for replacement of damage at the location.

Assignees

• Sprint Communications Co Lp

Inventors

• Paczkowski Lyle W
• Ralston James V
• Schempp Dale S
• Tarwater Jennifer P

Classifications

• G05D2201/0207

  Physics · mapped topic

• G06Q10/06313

  Resource planning in a project environment · CPC title

• H04W88/02

  Terminal devices · CPC title

• G05D1/0251

  extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision (stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593) · CPC title

• H04N13/0275

  Electricity · mapped topic