Method and apparatus for creating texture map and method of creating database

Patent metadata

Field	Value
Publication number	US-2016110909-A1
Application number	US-201514887425-A
Country	US
Kind code	A1
Filing date	Oct 20, 2015
Priority date	Oct 20, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

A method of creating a texture map is provided. The method includes extracting feature points of a particular object from one or more image frames captured by a camera; selecting one of the image frames as an image frame to be used in the creation of a texture map of the particular object based on information regarding the extracted feature points; and creating the texture map of the particular object using the selected image frame.

First claim

What is claimed is:

1 . A method of creating a texture map, comprising:
extracting feature points of an object from at least one image frame captured by a camera; selecting the at least one image frame captured by the camera as an image frame to be used in the creation of a texture map of the object based on information regarding the extracted feature points; and creating the texture map of the object using the selected at least one image frame.

2 . The method of claim 1 , wherein the selecting the comprises in response to a first image frame, among the at least one image frame captured by the camera, including an entire first group of feature points that is set in advance, selecting only the first image frame as the at least one image frame to be used in the creation of the texture map of the object, and
wherein the creating comprises creating a single texture map using the selected first image frame.

3 . The method of claim 1 , wherein the selecting comprises selecting two or more of the at least one image frame captured by the camera from which more than a predefined number of feature points are extracted, and
wherein the creating comprises:
creating two or more texture maps using the selected two or more image frames; and
creating a final texture map by matching the created two or more texture maps.

4 . The method of claim 3 , wherein the creating the final texture map comprises performing blending on boundaries that are formed in the process of matching the created two or more texture maps.

5 . The method of claim 3 , wherein the selecting comprises in response to the selected two or more image frames including an entire first group of feature points that is set in advance, selecting no further image frame.

6 . The method of claim 1 , wherein the selecting comprises in response to there being only one image frame from which more than a predefined number of feature points are extracted and the image frame including only some of a first group of feature points that is set in advance, selecting only the one image frame as the at least one image frame to be used in the creation of the texture map of the object, and
wherein the creating comprises creating a first texture map using the selected at least one image frame, creating a second texture map by mirroring the first texture map, and creating the final texture map by matching the first texture map and the second texture map.

7 . The method of claim 6 , wherein the creating the final texture map comprises performing blending on boundaries that are formed in the process of the matching the first texture map and the second texture map.

8 . The method of claim 1 , further comprising:
enhancing the resolution of the selected image frame, wherein the creating comprises creating the texture map of the particular object using the resolution-enhance image frame.

9 . The method of claim 1 , further comprising:
calculating vertex coordinates of a mesh corresponding to each pixel of a standard UV texture map using a three-dimensional (3D) standard object model and the standard UV texture map; acquiring capture time information of the selected at least one image frame using the extracted feature points, feature points of the 3D standard object model, and parameters of the camera; and acquiring pixel information corresponding to one or more regions in the at least one selected image frame that are necessary for the creation of the texture map of the object from the selected at least one image frame using the capture time information and the vertex coordinates, wherein the creating comprises creating the texture map of the object using the pixel information.

10 . A method of creating a database for face recognition, comprising:
calculating vertex coordinates of a mesh corresponding to each pixel of a standard UV texture map using a three-dimensional (3D) standard face model and the standard UV texture map; extracting feature points of a face from at least one image frame; selecting one of the at least one image frame as an image frame to be used in the creation of a texture map of the face based on the number of extracted feature points; creating the texture map of the face using the selected at least one image frame; creating a 3D model of the face by performing texturing using the texture map of the face, the vertex coordinates, and the 3D model of the face; and creating the database using the 3D model of the face and a rendering technique.

11 . An apparatus for creating a texture map, comprising:
a feature point extraction unit configured to extract feature points of an object from at least one image frame captured by a camera; a frame selection unit configured to select at least one image frame captured by the camera as an image frame to be used in the creation of a texture map of the object based on information regarding the extracted feature points; and a texture map creation unit configured to create the texture map of the object using the selected at least one image frame.

12 . The apparatus of claim 11 , wherein in response to a first image frame, among the at least one image frame captured by the camera, including an entire first group of feature points that is set in advance, the frame selection unit is configured to select only the first image frame as the at least one image frame to be used in the creation of the texture map of the object, and
wherein the texture map creation unit is configured to create a single texture map using the selected first image frame.

13 . The apparatus of claim 11 , wherein the frame selection unit is configured to select two or more of the at least one image frame captured by the camera from which more than a predefined number of feature points are extracted, and
wherein the texture map creation unit is configured to create two or more texture maps using the selected two or more of the at least one image frame and create a final texture map by matching the created two or more texture maps.

14 . The apparatus of claim 11 , wherein in response to there being only one image frame from which more than a predefined number of feature points are extracted and the image frame including only some of a first group of feature points that is set in advance, the frame selection unit is configured to select only the one image frame as the at least one image frame to be used in the creation of the texture map of the object, and
wherein the texture map creation unit is configured to create a first texture map using the selected at least one image frame, creates a second texture map by mirroring the first texture map, and create the final texture map by matching the first texture map and the second texture map.

15 . The apparatus of claim 11 , further comprising:
a coordinate calculation unit configured to calculate vertex coordinates of a mesh corresponding to each pixel of a standard UV texture map using a 3D standard object model and the standard UV texture map; a time information acquisition unit configured to acquire capture time information of the selected at least one image frame using the extracted feature points, feature points of the 3D standard object model, and parameters of the camera; and a pixel information acquisition unit configured to acquire pixel information corresponding to one or more regions in the selected at least one image frame that are necessary for the creation of the texture map of the object from the selected image frame using the capture time information and the vertex coordinates, wherein the texture map creation unit creates the texture map of the obj

Assignees

• Samsung Sds Co Ltd

Inventors

• Kim Bo Youn
• Lee Sang Hak
• Kim Jong Hang
• Ha Seong Jong
• Shin Young Min
• Ahn Yu Ri
• Kwon Yeon Hee
• Kang Sun Ah

Classifications

• G06V10/772

  Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries · CPC title

• G06V40/172 Primary

  Classification, e.g. identification · CPC title

• G06F16/56

  having vectorial format · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06F18/28

  Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries · CPC title