Processing uncertain content in a computer graphics system

Patent metadata

Field	Value
Publication number	US-11188739-B2
Application number	US-202016747812-A
Country	US
Kind code	B2
Filing date	Jan 21, 2020
Priority date	Oct 20, 2017
Publication date	Nov 30, 2021
Grant date	Nov 30, 2021

Abstract

An example method includes: obtaining, from computer memory, information from a three-dimensional (3D) graphical model that represents an object; identifying, based on the information, a first part of the object having an attribute; performing a recognition process on the object based on features of the object, where the recognition process attaches more importance to a second part of the object than to the first part, with the second part either not having the attribute or having less of the attribute than the first part; and providing data for rendering content on a graphical user interface based, at least in part, on recognition of the object performed by the recognition process.

First claim

What is claimed is:

1. A method performed by one or more processing devices, the method comprising:
recognizing an object in a first frame of video;
identifying a feature of the object having an attribute that would cause content associated with the feature to change as the object changes orientation or position, where the feature of the object is identified based on a three-dimensional (3D) model of the object stored in computer memory; and
tracking movement of the object in one or more frames of video that follow the first frame, where tracking comprises deemphasizing the content associated with the feature.

2. The method of claim 1 , wherein tracking movement of the object comprises:
detecting a part of the object in a second frame of the video that follows the first frame;
identifying the feature in the second frame; and
obtaining a location of the object in the second frame based on the part of the object and by deemphasizing content associated with the feature.

3. The method of claim 2 , wherein tracking movement of the object comprises: detecting the part of the object in a third frame of the video that follows the second frame; identifying the feature in the third frame; and obtaining a location of the object in the third frame based on the part of the object detected in the third frame and by deemphasizing content associated with the feature.

4. The method of claim 1 , wherein deemphasizing the content comprises, when tracking movement of the object, weighting the content associated with the feature less than other content associated with the object that does not have the attribute.

5. The method of claim 1 , wherein deemphasizing the content comprises, when tracking movement of the object, weighting the content associated with the feature less than other content associated with the object that has less of the attribute than the content associated with the feature.

6. The method of claim 1 , wherein tracking movement of the object comprises:
detecting a part of the object in a second frame of the video that follows the first frame, the part of the object having less of the attribute than the content associated with the feature;
assigning a first weight to the part of the object;
identifying the feature in the second frame;
assigning a second weight to content associated with the feature, the second weight being less than the first weight; and
obtaining a location of the object in the second frame based, at least in part, on the first weight and the second weight.

7. The method of claim 1 , wherein the attribute would cause content associated with the feature to change as the object changes both orientation and position.

8. The method of claim 1 , wherein recognizing comprises identifying information from the 3D model in the object.

9. The method of claim 1 , wherein the attribute comprises flexibility.

10. The method of claim 1 , wherein the attribute comprises reflectivity.

11. The method of claim 1 , wherein attribute comprises transparency.

12. The method of claim 1 , wherein the attribute comprises refractivity.

13. The method of claim 1 , wherein recognizing the object in the first frame is performed by emphasizing one or more features of the object over one or more other features of the object.

14. A method of tracking an object that is performed by one or more processing devices, the method comprising:
identifying an object in a first frame of video based on information associated with the object;
obtaining a three-dimensional (3D) graphical model for the object;
mapping information from the 3D graphical model to the object;
identifying, based on the mapping, a region of the object that has an attribute that would cause content associated with the region to change as the object changes orientation, position, or both orientation and position; and
performing a process to obtain a location of the object in a second frame of the video that follows the first frame, where the process deemphasizes information from the region of the object when determining the location in the second frame.

15. The method of claim 14 , further comprising:
performing a second process to obtain a location of the object in a third frame of the video that follows the second frame, where the second process deemphasizes information from the region of the object when determining the location in the third frame.

16. The method of claim 14 , wherein the first process comprises:
identifying a part of the object in the second frame, the part of the object having less of the attribute than the region of the object;
assigning a first weight to the part of the object;
identifying the region in the second frame;
assigning a second weight to content associated with the region, the second weight being less than the first weight; and
obtaining a location of the object in the second frame based, at least in part, on the first weight and the second weight.

17. The method of claim 14 , wherein the object is identified in the first frame based on one or more unique characteristics of the object.

18. The method of claim 14 , wherein the attribute comprises flexibility.

19. The method of claim 14 , wherein the attribute comprises reflectivity.

20. The method of claim 14 , wherein attribute comprises transparency.

21. The method of claim 14 , wherein the attribute comprises refractivity.

Assignees

• Ptc Inc

Inventors

• Prideaux-Ghee Stephen
• Gosselin Andre
• Nielsen Per
• Del Castillo Vincent
• Pan Qi
• Gervautz Michael

Classifications

• G06T7/246 Primary

  using feature-based methods, e.g. the tracking of corners or segments · CPC title

• G06V20/64 Primary

  Three-dimensional [3D] objects · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T2200/04

  involving 3D image data · CPC title