Methods and apparatuses for determining bounding box of target object, media, and devices

Patent metadata

Field	Value
Publication number	US-11348275-B2
Application number	US-201916731858-A
Country	US
Kind code	B2
Filing date	Dec 31, 2019
Priority date	Nov 21, 2017
Publication date	May 31, 2022
Grant date	May 31, 2022

Abstract

Embodiments of the present application disclose methods and apparatuses for determining a bounding box of a target object, media, and devices. The method includes: obtaining attribute information of each of a plurality of key points of a target object; and determining a bounding box position of the target object according to the attribute information of each of the plurality of key points of the target object and to a preset neural network. The implementations of the present application can improve the efficiency and accuracy of determining a bounding box of a target object.

First claim

The invention claimed is:

1. A method for determining a bounding box of a target object, comprising:
obtaining attribute information of each of a plurality of key points of a target object;
determining a bounding box position of the target object based on the attribute information of each of the plurality of key points of the target object and a preset neural network;
wherein the attribute information of each of the plurality of key points comprises coordinate information and a presence determination value;
wherein the determining the bounding box position of the target object based on the attribute information of each of the plurality of key points of the target object and the preset neural network comprises:
determining at least one valid key point from the plurality of key points according to the attribute information of each of the plurality of key points,
processing, according to the attribute information of each of the at least one valid key point, the attribute information of the plurality of key points to obtain processed attribute information of the plurality of key points, and
inputting the processed attribute information of the plurality of key points to the preset neural network for processing to obtain the bounding box position of the target object; and

wherein the processed attribute information of the plurality of key points comprises processed attribute information of each of the at least one valid key point, and attribute information of key points other than the at least one valid key point in the plurality of key points.

2. The method according to claim 1 , wherein processing, according to the attribute information of each of the at least one valid key point, the attribute information of the plurality of key points to obtain processed attribute information of the plurality of key points comprises:
determining a reference coordinate according to coordinate information comprised in the attribute information of each of the at least one valid key point; and
determining coordinate information in the processed attribute information of each valid key point according to the reference coordinate and to the coordinate information in the attribute information of each of the at least one valid key point.

3. The method according to claim 2 , wherein determining the reference coordinate according to coordinate information comprised in the attribute information of each of the at least one valid key point comprises:
performing averaging processing on coordinates corresponding to the coordinate information of each of the at least one valid key point to obtain the reference coordinate, and/or
determining the coordinate information in the processed attribute information of each valid key point according to the reference coordinate and to the coordinate information in the attribute information of each of the at least one valid key point comprises:
determining, with the reference coordinate as an origin point, processed coordinate information corresponding to the coordinate information of each of the at least one valid key point.

4. The method according to claim 2 , wherein inputting the processed attribute information of the plurality of key points to the preset neural network for processing to obtain the bounding box position of the target object comprises:
inputting the processed attribute information of the plurality of key points to the preset neural network for processing to obtain output position information; and
determining the bounding box position of the target object according to the reference coordinate and the output position information.

5. The method according to claim 1 , wherein the neural network comprises at least two full connection layers.

6. The method according to claim 1 , wherein the neural network comprises three full connection layers, wherein an activation function of at least one of the first full connection layer and the second full connection layer of the three full connection layers comprises a Rectified Linear Unit (ReLu) activation function.

7. A non-transitory computer-readable storage medium having instructions stored thereon, wherein the instructions upon execution by a processor cause the processor to perform operations comprising:
obtaining attribute information of each of a plurality of key points of a target object;
determining a bounding box position of the target object based on the attribute information of each of the plurality of key points of the target object and a preset neural network;
wherein the attribute information of each of the plurality of key points comprises coordinate information and a presence determination value;
wherein the determining the bounding box position of the target object based on the attribute information of each of the plurality of key points of the target object and the preset neural network comprises:
determining at least one valid key point from the plurality of key points according to the attribute information of each of the plurality of key points,
processing, according to the attribute information of each of the at least one valid key point, the attribute information of the plurality of key points to obtain processed attribute information of the plurality of key points, and
inputting the processed attribute information of the plurality of key points to the preset neural network for processing to obtain the bounding box position of the target object; and

wherein the processed attribute information of the plurality of key points comprises processed attribute information of each of the at least one valid key point, and attribute information of key points other than the at least one valid key point in the plurality of key points.

8. An electronic device comprising:
a processor; and
a computer-readable storage medium having stored thereon instructions that, when executed by the processor, cause the processor to:
obtain attribute information of each of a plurality of key points of a target object;
determine a bounding box position of the target object according to the attribute information of each of the plurality of key points of the target object and a preset neural network;
wherein the attribute information of each of the plurality of key points comprises coordinate information and a presence determination value;
wherein the determining the bounding box position of the target object based on the attribute information of each of the plurality of key points of the target object and the preset neural network comprises:
determining at least one valid key point from the plurality of key points according to the attribute information of each of the plurality of key points,
processing, according to the attribute information of each of the at least one valid key point, the attribute information of the plurality of key points to obtain processed attribute information of the plurality of key points, and
inputting the processed attribute information of the plurality of key points to the preset neural network for processing to obtain the bounding box position of the target object; and

wherein the processed attribute information of the plurality of key points comprises processed attribute information of each of the at least one valid key point, and attribute information of key points other than the at least one valid key point in the plurality of key points.

9. The electronic device according to claim 8 , wherein processing, according to the attribute information of each of the at least one valid key point, the attribute information of the plurality of key points to obtain processed attribute information of the plurality of key points comprises:
determining a reference coordinate according to coordinate information comprised in the attri

Assignees

• Beijing Sensetime Tech Development Co Ltd

Inventors

• Li Buyu
• Li Quanquan
• Yan Junjie

Classifications

• G06V10/82

  using neural networks · CPC title

• G06V10/25

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06T7/73 Primary

  using feature-based methods · CPC title

• G06N3/08 Primary

  Learning methods · CPC title