Colored three-dimensional digital model generation

Patent metadata

Field	Value
Publication number	US-12045944-B2
Application number	US-202217863625-A
Country	US
Kind code	B2
Filing date	Jul 13, 2022
Priority date	Jun 1, 2018
Publication date	Jul 23, 2024
Grant date	Jul 23, 2024

Abstract

Colored three-dimensional digital model generation techniques and systems are described. In one example, scanning techniques are employed by a scanning system that scans a physical object while disposed within packaging to form a three-dimension digital model. A model coloring system is employed to color the three-dimensional digital model. A two-dimensional digital image is employed that captures the same or similar physical object. In one example, features of the model are matched to the image. This is then used to align a viewing perspective with respect to the model with a viewing perspective of the object within the digital image, e.g., to find which “view” of the model corresponds with the image. The color is then applied from the digital image to the model, e.g., from pixels of the image to corresponding points in the model.

First claim

What is claimed is:

1. A method implemented by at least one computing device, the method comprising:
receiving, by the at least one computing device, scanning data resulting from a scan by a scanner of a physical object contained within packaging, the scanner disposed out of the packaging, the scan performed by the scanner through the packaging to the physical object disposed within the packaging;
generating, by the at least one computing device, an uncolored three-dimensional digital model of the physical object based on the received scanning data;
detecting, by the at least one computing device, features of a digital image that correspond to features of the uncolored three-dimensional digital model;
generating, by the at least one computing device, color for the uncolored three-dimensional digital model based on the detecting without removing the physical object contained within the packaging from the packaging; and
outputting, by the at least one computing device, the colored three-dimensional digital model via a user interface without removing the physical object contained within the packaging from the packaging.

2. The method as described in claim 1 , wherein the scan is an X-ray scan.

3. The method as described in claim 1 , wherein the colored three-dimensional digital model represents the physical object without the packaging.

4. The method as described in claim 1 , wherein the physical object has a density that is greater than a density of the packaging.

5. The method as described in claim 1 , wherein the generating includes:
generating an initially colored three-dimensional digital model having features that correspond to features of the digital image as colored; and
generating color for at least one portion of the uncolored three-dimensional digital model that is not colored in the initially colored three-dimensional digital model to form the generated colored three-dimensional digital model.

6. The method as described in claim 5 , wherein the generating of the color for the at least one portion that is not colored is based on detecting a different portion of the initially colored three-dimensional digital model as corresponding to the at least one portion.

7. The method as described in claim 6 , wherein the correspondence is based on bilateral correspondence of the at least one portion to the different portion.

8. The method as described in claim 5 , wherein the generating of the color for the at least one portion that is not colored is based on stretching color from another portion of the initially colored three-dimensional digital model as supplying the color for the at least one portion.

9. The method as described in claim 1 , wherein the generating includes linear blend skinning of the digital image to the uncolored three-dimensional digital model.

10. The method as described in claim 1 , wherein the generating includes stretching a portion of the digital image and compressing another portion of the digital image as aligning a perspective of the uncolored three-dimensional digital model to a perspective of the physical object in the digital image.

11. The method as described in claim 1 , further comprising generating a search query based on the colored three-dimensional digital model and wherein the digital image is a search result resulting from a search performed based on the search query.

12. The method as described in claim 1 , further comprising generating digital content as including the colored three-dimensional digital model and functionality that is user selectable to initiate a purchase of the physical object from a user.

13. The method as described in claim 12 , wherein digital image is received via a network from the user that also initiates the generating of the digital content.

14. The method as described in claim 1 , further comprising generating digital content as a webpage that includes the colored three-dimensional digital model.

15. A system comprising:
a three-dimensional scanning device disposed out of packaging and a physical object disposed within the packaging, the three-dimensional scanning device configured to generate an uncolored three-dimensional digital model by scanning the physical object disposed within the packaging, the scanning of the physical object performed through the packaging; and
a model coloring system implemented at least partially in hardware of a computing device to color the uncolored three-dimensional digital model of the physical object using a two-dimensional digital image of the physical object without removing the physical object disposed within the packaging from the packaging.

16. The system as described in claim 15 , wherein the model coloring system colors the uncolored three-dimensional digital model of the physical object using the two-dimensional digital image of the physical object by:
aligning features of the two-dimensional digital image with corresponding features of the uncolored three-dimensional digital model;
generating an initially colored three-dimensional digital model based on the aligning; and
generating color for at least one portion of the initially colored three-dimensional digital model that is not colored in the initially colored three-dimensional digital model to form a generated colored three-dimensional digital model.

17. The system as described in claim 16 , wherein the generating of the color for the at least one portion that is not colored is based on detecting a different portion of the initially colored three-dimensional digital model as corresponding to the at least one portion.

18. The system as described in claim 17 , wherein the correspondence is based on stereo correspondence of the at least one portion to the different portion.

19. A system comprising:
a three-dimensional scanning device disposed out of packaging and a physical object disposed within the packaging, the three-dimensional scanning device configured to generate an uncolored three-dimensional digital model by scanning the physical object disposed within the packaging, the scanning of the physical object performed through the packaging;
a model coloring system implemented at least partially in hardware of a computing device to color the uncolored three-dimensional digital model of the physical object using a two-dimensional digital image of the physical object without removing the physical object disposed within the packaging from the packaging; and
a digital content control module implemented at least partially in hardware of a computing device to generate digital content as including the colored three-dimensional digital model.

20. The system as described in claim 19 , wherein the digital content control module is further implemented at least partially in hardware of a computing device to output the digital content including the colored three-dimensional digital model via a user interface.

Assignees

• Ebay Korea Co Ltd
• Ebay Inc

Inventors

• Park Yo Han

Classifications

• G06T17/00 Primary

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T15/50 Primary

  Lighting effects · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T15/205

  Image-based rendering · CPC title