Method for training SMPL parameter prediction model, computer device, and storage medium

Patent metadata

Field	Value
Publication number	US-12198374-B2
Application number	US-202117231952-A
Country	US
Kind code	B2
Filing date	Apr 15, 2021
Priority date	Feb 1, 2019
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

A method for training an SMPL parameter prediction model, including: obtaining a sample picture; inputting the sample picture into a pose parameter prediction model to obtain a predicted pose parameter; inputting the sample picture into a shape parameter prediction model to obtain a predicted shape parameter; calculating model prediction losses according to an SMPL parameter prediction model and annotation information of the sample picture; and updating the pose parameter prediction model and the shape parameter prediction model according to the model prediction losses.

First claim

What is claimed is:

1. A method for training a skinned multi-person linear model (SMPL) parameter prediction model, performed by a computer device, the method comprising:
obtaining a sample picture, the sample picture containing a human body image;
inputting the sample picture into a pose parameter prediction model to obtain a predicted pose parameter, the predicted pose parameter being a parameter used for indicating a human body pose in the SMPL parameter prediction model;
inputting the sample picture into a shape parameter prediction model to obtain a predicted shape parameter, the predicted shape parameter being a parameter used for indicating a human body shape in the SMPL parameter prediction model;
constructing a three-dimensional human body model according to the predicted pose parameter and the predicted shape parameter;
calculating model prediction losses according to the three-dimensional human body model based on the SMPL parameter prediction model and annotation information of the sample picture; and
reversely training the pose parameter prediction model and the shape parameter prediction model the according to the model prediction losses.

2. The method according to claim 1 , wherein the model prediction losses comprise a first model prediction loss; and the calculating model prediction losses according to the three-dimensional human body model based on the SMPL parameter prediction model and annotation information of the sample picture comprises:
calculating the first model prediction loss according to the three-dimensional human body model based on the SMPL parameter prediction model and annotated SMPL parameters in the annotation information, the annotated SMPL parameters comprising an annotated pose parameter and an annotated shape parameter.

3. The method according to claim 2 , wherein the calculating the first model prediction loss according to the three-dimensional human body model based on the SMPL parameter prediction model and annotated SMPL parameters in the annotation information comprises:
calculating a first Euclidean distance between the annotated pose parameter and the predicted pose parameter;
calculating a second Euclidean distance between the annotated shape parameter and the predicted shape parameter; and
determining the first model prediction loss according to the first Euclidean distance and the second Euclidean distance.

4. The method according to claim 1 , wherein the model prediction losses comprise a second model prediction loss; and the calculating the model prediction losses according to the three-dimensional human body model based on the SMPL parameter prediction model and the annotation information of the sample picture comprises:
calculating the second model prediction loss according to predicted joint coordinates of joints in the three-dimensional human body model and annotated joint coordinates of joints in the annotation information.

5. The method according to claim 4 , wherein the annotated joint coordinates comprise three-dimensional annotated joint coordinates and/or two-dimensional annotated joint coordinates; and
the calculating the second model prediction loss according to predicted joint coordinates of joints in the three-dimensional human body model and annotated joint coordinates of joints in the annotation information comprises:
calculating third Euclidean distances between three-dimensional predicted joint coordinates of the joints in the three-dimensional human body model and the three-dimensional annotated joint coordinates; and
calculating the second model prediction loss according to the third Euclidean distances.

6. The method according to claim 5 , wherein the calculating third Euclidean distances between three-dimensional predicted joint coordinates of the joints in the three-dimensional human body model and the three-dimensional annotated joint coordinates comprises:
determining the three-dimensional predicted joint coordinates of the joints in the three-dimensional human body model according to vertex coordinates of model vertices around the joints in the three-dimensional human body model; and
calculating the third Euclidean distances between the three-dimensional predicted joint coordinates and the three-dimensional annotated joint coordinates.

7. The method according to claim 5 , wherein the calculating the second model prediction loss according to the third Euclidean distances comprises:
calculating fourth Euclidean distances between two-dimensional predicted joint coordinates of the joints in the three-dimensional human body model and the two-dimensional annotated joint coordinates; and
calculating the second model prediction loss according to the fourth Euclidean distances.

8. The method according to claim 7 , wherein the pose parameter prediction model is further configured to output a projection parameter according to the inputted sample picture, the projection parameter being used for projecting points in a three-dimensional space into a two-dimensional space; and
the calculating fourth Euclidean distances between two-dimensional predicted joint coordinates of the joints in the three-dimensional human body model and the two-dimensional annotated joint coordinates comprises:
determining the three-dimensional predicted joint coordinates of the joints in the three-dimensional human body model according to vertex coordinates of model vertices around the joints in the three-dimensional human body model;
performing projection processing on the three-dimensional predicted joint coordinates according to the projection parameter to obtain the two-dimensional predicted joint coordinates; and
calculating the fourth Euclidean distances between the two-dimensional predicted joint coordinates and the two-dimensional annotated joint coordinates.

9. The method according to claim 1 , wherein the model prediction losses comprise a third model prediction loss; and the calculating the model prediction losses according to the three-dimensional human body model based on the SMPL parameter prediction model and the annotation information of the sample picture comprises:
calculating the third model prediction loss according to a predicted two-dimensional human body contour of the three-dimensional human body model and an annotated two-dimensional human body contour in the annotation information.

10. The method according to claim 9 , wherein the pose parameter prediction model is further configured to output a projection parameter according to the inputted sample picture, the projection parameter being used for projecting points in a three-dimensional space into a two-dimensional space; and
the calculating the third model prediction loss according to a predicted two-dimensional human body contour of the three-dimensional human body model and an annotated two-dimensional human body contour in the annotation information comprises:
projecting model vertices in the three-dimensional human body model into a two-dimensional space according to the projection parameter, and generating the predicted two-dimensional human body contour;
calculating a first contour loss and a second contour loss according to the predicted two-dimensional human body contour and the annotated two-dimensional human body contour; and
determining the third model prediction loss according to the first contour loss and the second contour loss.

11. The method according to claim 10 , wherein the calculating a first contour loss and a second contour loss according to the predicted two-dimensional human body contour and the annotated two-dimensional human body contour comprises:
calculating a first shortest distance from each contour point in the predicte

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Sun Shuang
• Li Chen
• Tai Yuwing
• Jia Jiaya
• Shen Xiaoyong

Classifications

• G06N3/09

  Supervised learning · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06V40/11

  Hand-related biometrics; Hand pose recognition · CPC title

• G06V10/82

  using neural networks · CPC title

• G06V10/809

  of classification results, e.g. where the classifiers operate on the same input data · CPC title