Scanning for materials and scale information

Patent metadata

Field	Value
Publication number	US-10108846-B2
Application number	US-201615282138-A
Country	US
Kind code	B2
Filing date	Sep 30, 2016
Priority date	Sep 30, 2016
Publication date	Oct 23, 2018
Grant date	Oct 23, 2018

Abstract

Methods, systems, and apparatus, including medium-encoded computer program products, facilitate determining information about an object included in an image. In one aspect, a method includes: identifying an image; identifying a specific object included in the image; identifying data associated with the image; determining both a dimension of the specific object and a construction material of the specific object using the identified data; and outputting the dimension and the construction material of the specific object.

First claim

What is claimed is:

1. A method comprising:
identifying an image;
identifying a specific object included in the image;
identifying data associated with the image;
determining both a dimension of the specific object and a construction material of the specific object using the identified data; and
outputting the dimension and the construction material of the specific object;
wherein identifying the data associated with the image comprises identifying one or more other objects included in the image, and determining the dimension and the construction material of the specific object comprises determining at least one of the dimension or the construction material of the specific object based on a spatial relationship between the specific object and the one or more other objects.

2. The method of claim 1 , wherein identifying the image includes capturing the image.

3. The method of claim 2 , wherein identifying the data associated with the image occurs upon the capturing of the image, and the method further comprises:
identifying a product corresponding to the specific object; and
adding a selectable product label for the product to a display of the image;
wherein the outputting comprises displaying material, cost, and dimension information in response to a selection of the selectable product label.

4. The method of claim 1 , wherein identifying the image includes identifying a previously-captured image.

5. The method of claim 1 , wherein the image is a frame of a video content item.

6. The method of claim 1 , wherein determining at least one of the dimension or the construction material of the specific object comprises:
identifying an object type for at least one of the one or more other objects;
identifying one or more known dimensions of the at least one other object with the identified object type;
determining the dimension of the specific object based on the one or more known dimensions of the at least one other object and the spatial relationship;
identifying a set of possible construction materials for the specific object based on the spatial relationship; and
pattern matching image data for the specific object with the set of possible construction materials to determine the construction material of the specific object.

7. The method of claim 1 , wherein identifying the data associated with the image comprises:
identifying a location for the specific object based on positioning data stored with the image upon capture; and
retrieving dimension and material information from a data repository based on the identified location.

8. The method of claim 1 , wherein identifying the data associated with the image comprises identifying a symbol or code in the image, and determining the dimension and construction material comprises using the code to retrieve dimension and material information from a data repository.

9. The method of claim 8 , wherein the symbol or code is embedded within the specific object.

10. The method of claim 9 , wherein an appearance of the symbol or code on the specific object is triggered by a flash of a camera that captures the image.

11. A computer storage medium having instructions stored thereon that cause data processing apparatus to perform operations comprising:
identifying an image;
identifying a specific object included in the image;
identifying data associated with the image, wherein identifying the data associated with the image comprises identifying one or more other objects included in the image;
determining both a dimension of the specific object and a construction material of the specific object using the identified data, wherein determining the dimension and the construction material of the specific object comprises
identifying an object type for at least one of the one or more other objects,
identifying one or more known dimensions of the at least one other object with the identified object type,
determining the dimension of the specific object based on the one or more known dimensions of the at least one other object and a spatial relationship between the specific object and the one or more other objects,
identifying a set of possible construction materials for the specific object based on the spatial relationship, and
pattern matching image data for the specific object with the set of possible construction materials to determine the construction material of the specific object; and

outputting the dimension and the construction material of the specific object.

12. The computer storage medium of claim 11 , wherein identifying the image includes capturing the image.

13. The computer storage medium of claim 12 , wherein identifying the data associated with the image occurs upon the capturing of the image, the operations further comprising:
identifying a product corresponding to the specific object; and
adding a selectable product label for the product to a display of the image;
wherein the outputting comprises displaying material, cost, and dimension information in response to a selection of the selectable product label.

14. The computer storage medium of claim 11 , wherein identifying the image includes identifying a previously-captured image.

15. The computer storage medium of claim 11 , wherein the image is a frame of a video content item.

16. A system comprising:
one or more computer storage media having instructions stored thereon; and
one or more data processing apparatus configured to execute the instructions to perform operations comprising:
identifying an image;
identifying a specific object included in the image;
identifying data associated with the image, wherein identifying the data associated with the image comprises identifying one or more other objects included in the image;
determining both a dimension of the specific object and a construction material of the specific object using the identified data, wherein determining the dimension and the construction material of the specific object comprises
identifying an object type for at least one of the one or more other objects,
identifying one or more known dimensions of the at least one other object with the identified object type,
determining the dimension of the specific object based on the one or more known dimensions of the at least one other object and a spatial relationship between the specific object and the one or more other objects,
identifying a set of possible construction materials for the specific object based on the spatial relationship, and
pattern matching image data for the specific object with the set of possible construction materials to determine the construction material of the specific object; and

outputting the dimension and the construction material of the specific object.

17. The system of claim 16 , wherein identifying the image includes capturing the image.

18. The system of claim 17 , wherein identifying the data associated with the image occurs upon the capturing of the image, the operations further comprising:
identifying a product corresponding to the specific object; and
adding a selectable product label for the product to a display of the image;
wherein the outputting comprises displaying material, cost, and dimension information in response to a selection of the selectable product label.

19. The system of claim 16 , wherein identifying the image includes identifying a previously-captured image.

Assignees

• Autodesk Inc

Inventors

• Look Douglas
• Vrobel Patricia Anne
• Awe James
• Arabani Negar
• Davis Mark Thomas

Classifications

• H04N23/56

  provided with illuminating means · CPC title

• G06K9/00208 Primary

  Physics · mapped topic

• G06K9/20

  Physics · mapped topic

• G06K2209/27

  Physics · mapped topic

• G06K9/18

  Physics · mapped topic