System and method of enhancing a 3D printed model

Patent metadata

Field	Value
Publication number	US-11654633-B2
Application number	US-201816627859-A
Country	US
Kind code	B2
Filing date	Jul 4, 2018
Priority date	Jul 6, 2017
Publication date	May 23, 2023
Grant date	May 23, 2023

Abstract

A method of enhancing a 3D printed model includes generating successive visualisations of a virtual environment comprising a target object, receiving a user input indicating selection of a visualisation of the target object at a particular moment in time, generating visualisation data to enable subsequent visualisation of at least the target object as at the particular moment in time, causing the visualisation data to be stored at a unique location;generating 3D print model data for 3D printing of the target object, and associating data identifying the unique location of the stored visualisation data with the 3D print model data.

First claim

The invention claimed is:

1. A method of enhancing a 3D printed model, comprising the steps of:
generating successive visualisations of a virtual environment comprising a target object generated by a videogame;
receiving a user input indicating selection of a visualisation of the target object at a particular moment in time to be 3D printed;
generating visualisation data to enable subsequent visualisation of at least part of the virtual environment comprising the target object as at the particular moment in time;
causing the visualisation data to be stored at a unique location;
generating 3D print model data for 3D printing of the target object at the particular moment in time based at least in part on Z-buffer information providing depth data at the particular moment in time; and
associating data identifying the unique location of the stored visualisation data with the 3D print model data.

2. The method of claim 1 , comprising the steps of:
3D printing the target object based upon the generated 3D print model data; and
incorporating a machine-readable representation of the data identifying the unique location of the stored visualisation data into the 3D printed target object.

3. The method of claim 2 , in which the machine-readable representation of the data is encoded in a near field communication device incorporated into the 3D printed target object or a support structure thereof.

4. The method of claim 2 , in which the machine-readable representation of the data is encoded in a visual code incorporated into a surface of the 3D printed target object or a support structure thereof.

5. The method of claim 1 , in which the visualisation data comprises one or more of:
i. a game save for the particular moment in time;
ii. one or more textures or identifiers of textures used by a graphics card at the particular moment in time;
iii. mesh data corresponding to the state of at least part of the virtual environment at the particular moment in time;
iv. Z-buffer information providing depth data at the particular moment in time;
v. descriptors relating to the warping or modification of meshes, textures or any surface appearance, the particular moment in time;
vi. a point-cloud of the scene captured using virtual photogrammetry for the particular moment in time; and
vii. a series of rendered images of the scene from a predetermined distribution of virtual camera positions centred on the original in-game viewpoint for the particular moment in time.

6. A method of enhancing a 3D printed model, comprising the steps of:
extracting data from a machine-readable representation of 3D print model data for 3D printing of a target object taken from within a virtual environment generated by a videogame, the data identifying a unique location of stored visualisation data that enables subsequent visualisation of at least part of the virtual environment comprising the target object as visualised within a virtual environment at the same particular moment in time at which the 3D print model data was generated;
accessing the unique location; and
obtaining at least a first visualisation of at least the target object,
wherein the 3D print model data having been generated by:
generating successive visualisations of the virtual environment comprising the target object generated by the videogame;
receiving a user input indicating selection of a visualisation of the target object at the particular moment in time to be 3D printed;
generating visualisation data to enable subsequent visualisation of at least part of the virtual environment comprising the target object as at the particular moment in time;
causing the visualisation data to be stored at the unique location;
generating 3D print model data for 3D printing of the target object at the particular moment in time based at least in part on Z-buffer information providing depth data at the particular moment in time; and
associating data identifying the unique location of the stored visualisation data with the 3D print model data.

7. The method of claim 6 , in which the machine-readable representation is extracted from a near field communication device incorporated into the 3D printed target object or a support structure thereof, by one of:
i. a mobile phone comprising a near field communication reader; and
ii. a peripheral device comprising a near field communication reader and operably coupled to an entertainment device.

8. The method of claim 6 , in which the machine-readable representation is extracted from a visual code incorporated into a surface of the 3D printed target object or a support structure thereof, by one of:
i. a mobile phone comprising a video camera; and
ii. a peripheral device comprising a video camera and operably coupled to an entertainment device.

9. The method of claim 6 , in which the step of obtaining the at least first visualisation of these the target object comprises
receiving the stored visualisation data at a user device from a remote server hosting the unique location, and
generating the at least first visualisation of at least the target object.

10. The method of claim 6 , in which the step of obtaining the at least first visualisation of these the target object comprises:
generating the at least first visualisation of at least the target object at a remote server hosting the unique location, and
transferring the at least first visualisation to a user device over a network.

11. A non-transitory, computer readable recording medium having computer executable instructions stored thereon, which when executed by a computer system, cause the computer system to enhance a 3D printed model by carrying out actions, comprising:
extracting data from a machine-readable representation of 3D print model data for 3D printing of a target object taken from within a virtual environment generated by a videogame, the data identifying a unique location of stored visualisation data that enables subsequent visualisation of at least part of the virtual environment comprising the target object as visualised within a virtual environment at the same particular moment in time at which the 3D print model data was generated;
accessing the unique location; and
obtaining at least a first visualisation of at least the target object,
wherein the 3D print model data having been generated by:
generating successive visualisations of the virtual environment comprising the target object generated by the videogame;
receiving a user input indicating selection of a visualisation of the target object at the particular moment in time to be 3D printed;
generating visualisation data to enable subsequent visualisation of at least part of the virtual environment comprising the target object as at the particular moment in time;
causing the visualisation data to be stored at the unique location;
generating 3D print model data for 3D printing of the target object at the particular moment in time based at least in part on Z-buffer information providing depth data at the particular moment in time; and
associating data identifying the unique location of the stored visualisation data with the 3D print model data.

12. An entertainment device, comprising
an image processor adapted to generate successive visualisations of a virtual environment comprising a target object generated by a videogame;
a user input port adapted to receive a user input indicating selection of a visualisation of the target object at a particular moment in time to be 3D printed;
the image processor being adapted to generate visualisation data to enable subsequent visualisation of at least part of the virtual environment comprising the target objec

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Bigos Andrew James

Classifications

• H04B5/20

  characterised by the transmission technique; characterised by the transmission medium · CPC title

• G06T17/205

  Re-meshing · CPC title

• G06T17/10

  Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes · CPC title

• G06K19/06187

  with magnetically detectable marking · CPC title

• G06T17/00 Primary

  Three-dimensional [3D] modelling for computer graphics · CPC title