Device and method for generating dynamic texture map for 3 dimensional digital human

Patent metadata

Field	Value
Publication number	US-2024203027-A1
Application number	US-202318544111-A
Country	US
Kind code	A1
Filing date	Dec 18, 2023
Priority date	Dec 20, 2022
Publication date	Jun 20, 2024
Grant date	—

Abstract

A device and a method for generating dynamic texture map for 3 dimensional digital human are disclosed. The method comprises generating high-quality images from low-quality images including a low-quality object; generating partial high-quality images including a high-quality object by replacing the low-quality object within the low-quality images with the high-quality object within the high-quality images; and generating a high-quality texture map for a 3D model corresponding to the high-quality object using the partial high-quality images.

First claim

What is claimed is:

1 . A computer-implemented method for generating a high-quality texture map for a digital human comprising:
generating high-quality images from low-quality images including a low-quality object; generating partial high-quality images including a high-quality object by replacing the low-quality object within the low-quality images with the high-quality object within the high-quality images; and generating a high-quality texture map for a 3D model corresponding to the high-quality object using the partial high-quality images.

2 . The method of claim 1 , wherein the low-quality images indicate key frame images among rendered images.

3 . The method of claim 1 , wherein the generating of the partial high-quality images includes:
separating the low-quality object from the background of the low-quality images; separating the high-quality object from the background of the high-quality images; and replacing at least a part of the low-quality object with a corresponding part of the high-quality object.

4 . The method of claim 1 , wherein the generating of the high-quality texture map for the 3D model includes:
generating the 3D model with the same shape and pose as the high-quality object within the partial high-quality images and with a partial texture map related to the high-quality object; separating the 3D model into the shape and the partial texture map; and generating a complete texture map by performing inpainting on the partial texture map.

5 . The method of claim 1 , wherein the low-quality images are obtained by rendering the shape of the 3D model and the low-quality texture map for the 3D model.

6 . The method of claim 5 , wherein the generating of the high-quality texture map for the 3D model includes:
generating the high-quality texture map by applying the high-quality object to the low-quality texture map based on a mapping relationship between each part of the low-quality texture map and each part of the high-quality object.

7 . A device for generating a high-quality texture map for a digital human comprising:
at least one memory storing computer-executable instructions; and at least one processor, wherein the at least one processor is configured to execute the computer-executable instructions to: generates high-quality images from low-quality images including low-quality objects; generates partial high-quality images including a high-quality object by the low-quality object within the low-quality images with a high-quality object within the high-quality images; and generates a high-quality texture map for a 3D model corresponding to the high-quality object using the partial high-quality images.

8 . The device of claim 7 , wherein the low-quality images indicate key frame images among rendered images.

9 . The device of claim 7 , wherein the at least one processor:
separates the low-quality object from the background of the low-quality images; separates the high-quality object from the background of the high-quality images; and replaces at least a part of the low-quality object with a corresponding part of the high-quality object.

10 . The device of claim 7 , wherein the at least one processor:
generates the 3D model with the same shape and pose as the high-quality object within the partial high-quality images and with a partial texture map related to the high-quality object; separates the 3D model into the shape and the partial texture map; and generates a complete texture map by performing inpainting on the partial texture map.

11 . The device of claim 7 , wherein the low-quality images are obtained by rendering the shape of the 3D model and the low-quality texture map for the 3D model.

12 . The device of claim 11 , wherein the at least one processor:
generates the high-quality texture map by applying the high-quality object to the low-quality texture map based on a mapping relationship between each part of the low-quality texture map and each part of the high-quality object.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Yoon Seung Uk
• Kim Ki Nam
• Kim Tae Joon
• Lee Seung Wook
• Hwang Bon Woo

Classifications

• G06T15/04 Primary

  Texture mapping · CPC title

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T5/77 Primary

  Retouching; Inpainting; Scratch removal · CPC title

• G06T2207/30196

  Human being; Person · CPC title