Measuring dimension of object through visual odometry

Patent metadata

Field	Value
Publication number	US-10275945-B2
Application number	US-201715664754-A
Country	US
Kind code	B2
Filing date	Jul 31, 2017
Priority date	Jan 3, 2014
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

An electronic device includes at least one sensor, a display, and a processor. The processor is configured to determine a dimension of a physical object along an axis based on a change in position of the electronic device when the electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis. A method includes capturing and displaying imagery of a physical object at an electronic device, and receiving user input identifying at least two points of the physical object in the displayed imagery. The method further includes determining, at the electronic device, at least one dimensional aspect of the physical object based on the at least two points of the physical object using a three-dimensional mapping of the physical object.

First claim

What is claimed is:

1. A method comprising:
determining, at a mobile electronic device, a dimension of a physical object along an axis based on a change in position of the mobile electronic device when the mobile electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis, wherein determining the dimension of the physical object comprises:
determining, using sensor data from at least one sensor of the mobile electronic device, a first position and a first orientation of the mobile electronic device at the first end of the physical object, the at least one sensor including at least one of an inertial sensor, a global positioning system (GPS) sensor, or an imaging camera;
determining, using sensor data from the at least one sensor, a second position and a second orientation of the mobile electronic device at the second end of the physical object;
determining, at a processor of the mobile electronic device, an offset based on a difference between the first orientation and the second orientation; and
determining, at the processor of the mobile electronic device, the dimension of the physical object based on a distance between the first position and the second position and based on the offset.

2. The method of claim 1 , wherein the at least one sensor comprises an inertial sensor.

3. The method of claim 1 , wherein the at least one sensor comprises a global positioning system (GPS) sensor.

4. The method of claim 1 , wherein:
the at least one sensor comprises an imaging camera;
determining the first position of the mobile electronic device comprises determining the first position of the mobile electronic device based at least in part on analysis of imagery captured by the imaging camera; and
determining the second position of the mobile electronic device comprises determining the second position of the mobile electronic device based at least in part on analysis of imagery captured by the imaging camera.

5. The method of claim 1 , further comprising:
capturing, via an imaging camera of the mobile electronic device, at least one image of the physical object;
identifying the physical object based on object recognition analysis of the at least one image and based on the dimension of the physical object; and
querying a database based on an identification of the physical object to obtain at least one other dimension of the physical object from the database.

6. The method of claim 5 , further comprising:
displaying, at the mobile electronic device, at least one of the dimension and the at least one other dimension to a user.

7. The method of claim 6 , further comprising:
querying a database based on the identification of the physical object to display to a user of the mobile electronic device at least one of: warranty information for the physical object; product information for the physical object; user reviews for the physical object; and one or more prices offered for purchase of the physical object.

8. The method of claim 1 , wherein the axis is defined by a first location of the mobile electronic device proximate to the first end of the physical object and a second location of the mobile electronic device proximate to the second end of the physical object.

9. A mobile electronic device comprising:
at least one sensor, the at least one sensor including at least one of an inertial sensor, a global positioning system (GPS) sensor, or an imaging camera;
a display; and
a processor configured to determine a dimension of a physical object along an axis based on a change in position of the mobile electronic device when the mobile electronic device is moved from a first end of the physical object along the axis to a second end of the physical object along the axis, wherein the processor is configured to determine the dimension of the physical object by:
determining, using sensor data from the at least one sensor, a first position and a first orientation of the mobile electronic device at the first end of the physical object, the at least one sensor including at least one of an inertial sensor, a global positioning system (GPS) sensor, or an imaging camera;
determining, using sensor data from the at least one sensor, a second position and a second orientation of the mobile electronic device at the second end of the physical object;
determining an offset based on a difference between the first orientation and the second orientation; and
determining the dimension of the physical object based on a distance between the first position and the second position and based on the offset.

10. The mobile electronic device of claim 9 , wherein the at least one sensor comprises an inertial sensor.

11. The mobile electronic device of claim 9 , wherein the at least one sensor comprises a global positioning system (GPS) sensor.

12. The mobile electronic device of claim 9 , wherein:
the at least one sensor comprises an imaging camera;
the processor is configured to determine the first position of the mobile electronic device by determining the first position of the mobile electronic device based at least in part on analysis of imagery captured by the imaging camera; and
the processor is configured to determine the second position of the mobile electronic device by determining the second position of the mobile electronic device based at least in part on analysis of imagery captured by the imaging camera.

13. The mobile electronic device of claim 9 , further comprising:
at least one imaging camera; and
wherein the processor further is configured to:
capture, via the at least one imaging camera, at least one image of the physical object;
identify the physical object based on object recognition analysis of the at least one image and based on the dimension of the physical object; and
query a database based on an identification of the physical object to obtain at least one other dimension of the physical object from the database.

14. The mobile electronic device of claim 13 , wherein the processor further is configured to:
provide at least one of the dimension and the at least one other dimension to the display for display to a user.

15. The mobile electronic device of claim 14 , wherein the processor further is configured to:
query a database based on the identification of the physical object to display to a user of the mobile electronic device at least one of: warranty information for the physical object; product information for the physical object; user reviews for the physical object; and one or more prices offered for purchase of the physical object.

16. The mobile electronic device of claim 9 , wherein the axis is defined by a first location of the mobile electronic device proximate to the first end of the physical object and a second location of the mobile electronic device proximate to the second end of the physical object.

17. A method comprising:
capturing and displaying imagery of a physical object at a mobile electronic device using an imaging camera of the mobile electronic device;
determining, at a processor of the mobile electronic device, a three-dimensional mapping of the physical object;
identifying at least two points of the physical object by detecting at least two user contact points at a touchscreen of the mobile electronic device, each user contact point corresponding to, and identifying, a corresponding point of the at least two points of the physical object in the displayed imagery; and
determining, at the processor of the mobile electronic device, at least one dimensiona

Assignees

• Google Llc

Inventors

• Lee Johnny Chung
• Hesch Joel
• Hickman Ryan
• Mihelich Patrick
• Fung James

Classifications

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04W4/043

  Electricity · mapped topic

• H04L67/38

  Electricity · mapped topic

• H04L67/18

  Electricity · mapped topic

• G06T2210/04

  Architectural design, interior design · CPC title