Augmented reality model comparison and deviation detection

Patent metadata

Field	Value
Publication number	US-10169384-B2
Application number	US-201615253944-A
Country	US
Kind code	B2
Filing date	Sep 1, 2016
Priority date	Nov 24, 2015
Publication date	Jan 1, 2019
Grant date	Jan 1, 2019

Abstract

An aspect of providing augmented reality model comparison and deviation detection includes receiving a three-dimensional (3D) model of an object that is associated with a domain, determining a set of characteristics of the object from the 3D model, and searching a domain-specific database for data matching the set of characteristics. The domain-specific database corresponds to the domain associated with the object. An aspect also includes determining an identification of the object from data in the domain-specific database that matches the set of characteristics. For each characteristic in the set of characteristics, and aspect further includes comparing each value of the characteristic to a corresponding value in the matching data of the domain-specific database, and calculating any variation between the corresponding value of the characteristic and the value of the matching data. Another aspect includes creating a searchable index of the matching data and corresponding variations.

First claim

What is claimed is:

1. A method, comprising:
detecting, using at least one electronic sensor, an object associated with a domain;
receiving a three-dimensional (3D) model of the object;
determining, by a computer processor, a set of characteristics of the object from the 3D model;
searching a domain-specific database for data matching the set of characteristics, the domain-specific database corresponding to the domain associated with the object;
determining an identification of the object from data in the domain-specific database that matches the set of characteristics, the identification determined using an image detection technique;
for each characteristic in the set of characteristics:
comparing each value of the characteristic to a corresponding value in the matching data of the domain-specific database; and
calculating any variation between the corresponding value of the characteristic and the value of the matching data;
creating, by the computer processor, a searchable index of the matching data and corresponding variations;
receiving a request as to how the variations affect at least one of a monetary value of the object, a safety of the object, and a compliance regulation corresponding to the object;
mapping the variations stored in the searchable index to at least one of the monetary value of the object, the safety of the object, and the compliance regulation corresponding to the object;
generating an indicator that indicates a degree of the variation with respect to at least one of the monetary value, the safety, and the compliance regulation; and
displaying, on a display device, the indicator in relation to the object so as to generate an augmented image showing the degree of the variation with respect to the object,
wherein receiving the request comprises:
receiving a request for a monetary value corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristics and corresponding variation; and
submitting a query to a data source, the query including the characteristics and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object;
wherein the monetary value reflects one of an increase in value of the object and a decrease in value of the object based on a type and the degree of the variation.

2. The method of claim 1 , wherein the domain-specific database is a product specification database, and the object is a product created by a manufacturer.

3. The method of claim 1 , wherein the set of characteristics includes conditioning.

4. The method of claim 1 , wherein the object is a building structure, the method further comprising:
receiving a request for compliance data corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristic and corresponding variation; and
submitting a query to a data source, the query including the characteristic and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object, the data source storing building regulation codes;
wherein the compliance data includes an indicator of compliance of the variation based on the building regulation codes.

5. The method of claim 1 , wherein the set of characteristics includes at least one of dimensions and colors.

6. The method of claim 1 , wherein the values include at least one of size, shape, proportion, and gradient.

7. A system, comprising:
a memory having computer readable instructions; and
a processor for executing the computer readable instructions, the computer readable instructions including:
an electronic sensor configured to detect an object associated with a domain;
receiving a three-dimensional (3D) model of the object;
determining a set of characteristics of the object from the 3D model;
searching a domain-specific database for data matching the set of characteristics, the domain-specific database corresponding to the domain associated with the object;
determining an identification of the object from data in the domain-specific database that matches the set of characteristics, the identification determined using an image detection technique;
for each characteristic in the set of characteristics:
comparing each value of the characteristic to a corresponding value in the matching data of the domain-specific database;
calculating any variation between the corresponding value of the characteristic and the value of the matching data; and

creating a searchable index of the matching data and corresponding variations;
receiving a request as to how the variations affect at least one of a monetary value of the object, a safety of the object, and a compliance regulation corresponding to the object;
mapping the variations stored in the searchable index to at least one of the monetary value of the object, the safety of the object, and the compliance regulation corresponding to the object; and
generating an indicator that indicates a degree of the variation with respect to at least one of the monetary value, the safety, and the compliance regulation; and
displaying, on a display device, the indicator in relation to the object so as to generate an augmented image showing the degree of the variation with respect to the object,
wherein the receiving request further comprises:
receiving a request for a monetary value corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristics and corresponding variation; and
submitting a query to a data source, the query including the characteristics and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object;
wherein the monetary value reflects one of an increase in value of the object and a decrease in value of the object based on a type and the degree of the variation.

8. The system of claim 7 , wherein the domain-specific database is a product specification database, and the object is a product created by a manufacturer.

9. The system of claim 7 , wherein the set of characteristics includes conditioning.

10. The system of claim 7 , wherein the object is a building structure, the computer readable instructions further comprise:
receiving a request for compliance data corresponding to a variation responsive to a search of the searchable index, the search including a characteristic from the set of characteristic and corresponding variation; and
submitting a query to a data source, the query including the characteristic and the corresponding variation, wherein the domain-specific database is linked to the data source through an index of domain-specific data and an identifier of the object, the data source storing building regulation codes;
wherein the compliance data includes an indicator of compliance of the variation based on the building regulation codes.

11. The system of claim 7 , wherein the set of characteristics includes at least one of dimensions and colors.

12. The system of claim 7 , wherein the values include at least one of size, shape, proportion, and gradient.

13. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a computer p

Assignees

• IBM

Inventors

• Dow Eli M
• Farr Erin M
• Gildein Ii Michael E
• Vaughan Moses J

Classifications

• G06K9/00671

  Physics · mapped topic

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T7/408

  Physics · mapped topic

• G06F17/30321 Primary

  Physics · mapped topic

• G06F17/30477

  Physics · mapped topic