Colored three-dimensional digital model generation

Patent metadata

Field	Value
Publication number	US-11423631-B2
Application number	US-202016928138-A
Country	US
Kind code	B2
Filing date	Jul 14, 2020
Priority date	Jun 1, 2018
Publication date	Aug 23, 2022
Grant date	Aug 23, 2022

Abstract

Colored three-dimensional digital model generation techniques and systems are described. In one example, scanning techniques are employed by a scanning system that scans a physical object while disposed within packaging to form a three-dimension digital model. A model coloring system is employed to color the three-dimensional digital model. A two-dimensional digital image is employed that captures the same or similar physical object. In one example, features of the model are matched to the image. This is then used to align a viewing perspective with respect to the model with a viewing perspective of the object within the digital image, e.g., to find which “view” of the model corresponds with the image. The color is then applied from the digital image to the model, e.g., from pixels of the image to corresponding points in the model.

First claim

What is claimed is:

1. A method implemented by at least one computing device the method comprising:
receiving, by the at least one computing device, scanning data resulting from a scan by a scanner of a physical object contained internally within packaging, the scanner disposed externally to the packaging;
generating, by the at least one computing device, a three-dimensional digital model of the physical object based on the received scanning data;
identifying, by the at least one computing device, one or more points of a part of the physical object that can move via at least one of a flexing movement or a hinging movement based on the received scanning data;
modifying, by the at least one computing device, the three-dimensional digital model, the modifying including repositioning a part of the three-dimensional digital model of the physical object based on the one or more points identified of the part of the physical object that can move; and
outputting, by the at least one computing device, the three-dimensional digital model as supporting user interaction via a user interface involving a change in a viewing perspective in relation to the three-dimensional digital model.

2. The method as described in claim 1 , wherein the scan is an X-ray scan.

3. The method as described in claim 1 , wherein the three-dimensional digital model does not include the packaging.

4. The method as described in claim 1 , wherein the physical object has a density that is greater than a density of the packaging.

5. The method as described in claim 1 , further comprising:
detecting, by the at least one computing device, features of a digital image that correspond to features of the three-dimensional digital model;
generating, by the at least one computing device, color for the three-dimensional digital model based on the detecting; and
outputting, by the at least one computing device, a colored three-dimensional digital model as supporting user interaction via a user interface involving a change in a viewing perspective in relation to the colored three-dimensional digital model.

6. The method as described in claim 5 , wherein the generating includes:
generating an initially colored three-dimensional digital model having features that correspond to features of the digital image as colored; and
generating color for at least one portion of the three-dimensional digital model that is not colored in the initially colored three-dimensional digital model to form the generated colored three-dimensional digital model.

7. The method as described in claim 6 , wherein the generating of the color for the at least one portion that is not colored is based on detecting a different portion of the initially colored three-dimensional digital model as corresponding to the at least one portion.

8. The method as described in claim 6 , wherein the generating of the color for the at least one portion that is not colored is based on stretching color from another portion of the initially colored three-dimensional digital model as covering the at least one portion.

9. The method as described in claim 5 , wherein the generating includes stretching a portion of the digital image and compressing another portion of the digital image as aligning a perspective of the three-dimensional digital model to a perspective of the physical object in the features of the digital image.

10. The method as described in claim 1 , further comprising:
generating a search query based on the three-dimensional digital model; and
receiving a digital image resulting from a search performed based on the search query.

11. The method as described in claim 1 , further comprising generating digital content as including the three-dimensional digital model and functionality that is user selectable to initiate a purchase of the physical object from a user.

12. The method as described in claim 11 , wherein a digital image is received via a network from the user that also initiates the generating of the digital content.

13. The method as described in claim 1 , wherein the modifying of the three-dimensional digital model of the physical object includes adding an accessory three-dimensional digital model to the three-dimensional digital model of the physical object.

14. The method as described in claim 1 , wherein the scanning data includes the packaging of the physical object.

15. The method as described in claim 1 , wherein the generating of the three-dimensional digital model of the physical object is further based on an isosurface extraction algorithm.

16. A system comprising:
one or more processors; and
a computer-readable storage medium including instructions that are executable by the one or more processors to perform operations including:
receiving scanning data resulting from a scan by a scanner of a physical object, the scan performed by the scanner as disposed externally through packaging to the physical object disposed internally within the packaging;
generating a three-dimensional digital model of the physical object based on the received scanning data;
identifying one or more points of a part of the three-dimensional digital model of the physical object that move via at least one of a flexing movement or a hinging movement based on the received scanning data;
modifying the three-dimensional digital model, the modifying including repositioning the part of the three-dimensional digital model of the physical object based on the one or more points identified; and
outputting the three-dimensional digital model as supporting user interaction via a user interface involving a change in a viewing perspective in relation to the three-dimensional digital model.

17. The system as described in claim 16 , further comprising:
generating a search query based on the three-dimensional digital model; and
receiving a digital image resulting from a search performed based on the search query.

18. A system comprising:
a three-dimensional scanning device disposed externally to packaging and a physical object disposed internally within the packaging, the three-dimensional scanning device configured to generate a three-dimensional digital model based on scanning data resulting from a scan by the three-dimensional scanning device, the scanning of the physical object performed externally through the packaging;
a feature matching module implemented at least partially in hardware of a computing device to identify one or more points of a part of the physical object that can move via at least one of a flexing movement or a hinging movement based on the scanning data received, and to modify the three-dimensional digital model, the modifying including repositioning a part of the three-dimensional digital model of the physical object based on the one or more points identified of the part of the physical object that can move; and
a digital content control module implemented at least partially in the hardware of the computing device to generate digital content as including the three-dimensional digital model and functionality that is user selectable to purchase the physical object from the user, the generation of the digital content initiated by a user input received from the user via a network.

19. The system as described in claim 18 , further comprising generating the digital content as a webpage that includes the three-dimensional digital model.

20. The system as described in claim 16 , wherein the generating of the three-dimensional digital model of the physical object is further based on an isosurfa

Assignees

• Ebay Korea Co Ltd
• Ebay Inc

Inventors

• Park Yo Han

Classifications

• G06T17/00 Primary

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T15/50 Primary

  Lighting effects · CPC title

• G06Q30/0643 Primary

  graphically representing goods, e.g. 3D product representation · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title