Applying Annotations to Three-Dimensional (3D) Object Data Models Based on Object Parts

Patent metadata

Field	Value
Publication number	US-2016246767-A1
Application number	US-201314134784-A
Country	US
Kind code	A1
Filing date	Dec 19, 2013
Priority date	Dec 19, 2013
Publication date	Aug 25, 2016
Grant date	—

Abstract

Methods and systems for interacting with multiple three-dimensional (3D) object data models are provided. An example method may involve receiving a plurality of three-dimensional (3D) object data models that represent objects associated with a given category. The plurality of 3D object data models may include one or more annotated parts. The method may also involve receiving a candidate 3D object data model that is associated with the given category of objects. The candidate 3D object data model may include one or more un-annotated parts. The method may additionally involve, based on a shape and an appearance of the one or more annotated parts and spatial-layout information that defines how the one or more annotated parts are spatially arranged, applying an annotation of a respective part of a respective 3D object data model to a corresponding part of the candidate 3D object data model.

First claim

1 . A method comprising:
receiving a plurality of three-dimensional (3D) object data models, the plurality of 3D object data models associated with a first category of objects, wherein respective 3D object data models of the plurality of 3D object data models comprise one or more annotated parts; receiving a candidate 3D object data model that is associated with the first category of objects, the candidate 3D object data model comprising one or more un-annotated parts; and based on a shape and an appearance of the one or more annotated parts and spatial-layout information that defines how the one or more annotated parts are spatially arranged, applying, by a computing device, a first annotation of a respective part of a respective 3D object data model to a corresponding un-annotated part of the candidate 3D object data model, wherein the spatial-layout information comprises information about at least one normalized distance between parts of the one or more annotated parts and about at least one relative orientation between parts of the one or more annotated parts, and wherein applying the first annotation comprises:
determining one or more first shape-context descriptors for the respective 3D object data model, wherein the one or more first shape-context descriptors comprise a first shape-context descriptor associated with a first point of the respective 3D object data model, wherein the first shape-context descriptor is configured to capture a distribution of points in the respective 3D object data model relative to the first point;
determining one or more second shape-context descriptors for the candidate 3D object data model, wherein the one or more second shape-context descriptors comprise a second shape-context descriptor associated with a second point of the candidate 3D object data model, wherein the second shape-context descriptor is configured to capture a distribution of points in the candidate 3D object data model relative to the second point;
determining an aligning transformation for aligning the 3D object data model with the candidate 3D object data model, wherein the aligning transformation is based on correspondences between the one or more first shape-context descriptors and the one or more second shape-context descriptors; and
applying the first annotation to the corresponding un-annotated part of the candidate 3D object data model based on the aligning transformation.

2 . The method of claim 1 , further comprising:
determining an index related to a database storing the plurality of 3D object data models, wherein the index is based on the spatial-layout information that defines how the one or more annotated parts are spatially arranged; adding the candidate 3D object data model to the database; receiving a search request for a search to be performed on the database storing the plurality of 3D object data models, the search request comprising information related to the first annotation; and after receiving the search request, providing an output related to the search request that comprises information about the candidate 3D object data model, wherein the output is based on the index related to the database.

3 . The method of claim 1 , wherein respective parts of the one or more annotated parts comprise an annotation positioned at a vertex point on the respective parts of the one or more annotated parts, and
wherein applying the first annotation of the respective part of the respective 3D object data model to the corresponding part of the candidate 3D object data model further comprises applying the annotation based on the vertex point.

4 . The method of claim 1 , wherein applying the first annotation of the respective part of the respective 3D object data model to the corresponding part of the candidate 3D object data model further comprises applying the first annotation as a call-out to the candidate 3D object model.

5 . The method of claim 4 , wherein the call-out comprises a part number and/or a part name.

6 . The method of claim 4 , further comprising:
utilizing the call-out to facilitate changing an orientation of the candidate 3D object data model.

7 . The method of claim 1 , further comprising:
indexing the candidate 3D object data model in a database based on the shape and the appearance of the one or more annotated parts and the spatial-layout information that defines how the one or more parts are spatially arranged.

8 . The method of claim 1 , further comprising:
generating a second plurality of 3D object data models that correspond to the one or more annotated parts; receiving a second candidate 3D object data model comprising one or more un-annotated parts; comparing the one or more un-annotated parts of the second candidate 3D object data model to the second plurality of 3D object data models; and based on the comparison, determining that the second candidate 3D object data model is associated with the first category of objects.

9 . The method of claim 8 , wherein applying the first annotation further comprises:
applying the first annotation of the respective part of the respective 3D object data model to a corresponding part of the second candidate 3D object data model based on the second plurality of 3D object data models and the spatial-layout information.

10 . The method of claim 1 , further comprising:
making an evaluation of the first annotation of the respective part of the respective 3D object data model to the corresponding un-annotated part of the candidate 3D object data model.

11 . The method of claim 10 , further comprising:
receiving a second candidate 3D object data model comprising one or more un-annotated parts; making a comparison of the one or more un-annotated parts of the second candidate 3D object data model to the second plurality of 3D object data models; based on the comparison, determining the second candidate 3D object data model is associated with the first category of objects; and based on the evaluation of the first annotation, applying a second annotation of the respective part of the respective 3D object data model to a corresponding part of the second candidate 3D object data model.

12 . A non-transitory computer-readable medium having stored therein instructions, that when executed by a computing device, cause the computing device to perform functions comprising:
receiving a plurality of three-dimensional (3D) object data models, the plurality of 3D object data models being of objects associated with a first category of objects, wherein respective 3D object data models of the plurality of 3D object data models comprise one or more annotated parts; receiving a candidate 3D object data model that is associated with the first category of objects, the candidate 3D object data model comprising one or more un-annotated parts; and based on a shape and an appearance of the one or more annotated parts and spatial-layout information that defines how the one or more annotated parts are spatially arranged, applying by the computing device a first annotation of a respective part of a respective 3D object data model to a corresponding part of the candidate 3D object data model, wherein the spatial-layout information comprises information about at least one normalized distance between parts of the one or more annotated parts and about at least one relative orientation between parts of the one or more annotated parts, and wherein applying the first annotation comprises:
determining one or more first shape-context descriptors for the respective 3D object data model, wherein the one or more first shape shape-context descriptors comprise a first shape-context descriptor associated with a firs

Assignees

• Google Inc

Inventors

• Makadia Ameesh
• Harp Andrew Logan
• Francis Anthony Gerald

Classifications

• G06T19/00 Primary

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• G06F17/241 Primary

  Physics · mapped topic

• G06T17/10 Primary

  Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes · CPC title

• G06T2219/004

  Annotating, labelling · CPC title