Image tracking control method, control device, and control equipment

Patent metadata

Field	Value
Publication number	US-9591229-B2
Application number	US-201314426480-A
Country	US
Kind code	B2
Filing date	Sep 29, 2013
Priority date	Sep 29, 2013
Publication date	Mar 7, 2017
Grant date	Mar 7, 2017

Abstract

A control method, control apparatus, and control device are disclosed. The control method includes: acquiring audio data including voice information of a target voice source; determining location range information of the target voice source according to the audio data; and controlling rotation of a camera device which currently cannot capture the target voice source according to the location range information, so that the camera device can capture the target voice source. The embodiments of the present invention support capture of a target voice source outside an original screen range by the camera device.

First claim

What is claimed is:

1. A control method, comprising:
acquiring audio data including sound information of a target sound source;
determining location range information of the target sound source according to the audio data; and
controlling, according to the location range information, rotation of a camera device which currently cannot capture the target sound source, so that the camera device can capture the target sound source;
wherein, the location range information is direction information of the target sound source with respect to the camera device, and
controlling, according to the location range information, rotation of the camera device which currently cannot capture the target sound source is:
determining a rotation control parameter of the camera device corresponding to the direction information; and
controlling the rotation of the camera device according to the rotation control parameter;
wherein, the audio data is collected by a sound collection device, and determining the location range information of the target sound source according to the audio data is:
determining position information of the target sound source with respect to the sound collection device according to the audio data; and
determining the direction information according to the position information;
wherein, determining the direction information according to the position information is:
determining the direction information according to the position information and a preset corresponding relationship between the position information and the direction information;
wherein, the sound collection device is used to determine a preset plane of the position information and a preset reference point on the preset plane, the camera device corresponds to a first corresponding point on the preset plane, and the target sound source corresponds to a second corresponding point on the preset plane,
the position information is a location coordinate of the second corresponding point with respect to the preset reference point, and the direction information is a coordinate representing direction information of the second corresponding point with respect to the first corresponding point,
the corresponding relationship is a plane geometric function with a location coordinate of a phonation corresponding point on the preset plane with respect to the preset reference point as an argument, a location coordinate of the first corresponding point with respect to the preset reference point as a parameter, and a coordinate representing direction information of the phonation corresponding point with respect to the first corresponding point as a variable.

2. The control method according to claim 1 , wherein, the location coordinate of the first corresponding point with respect to the preset reference point is a coordinate (a1, a2) in a rectangular coordinate with the preset reference point as a first origin, which belongs to the preset plane, the location coordinate of the phonation corresponding point with respect to the preset reference point is a coordinate (x, y) in the rectangular coordinate, where y is larger than a2, and the coordinate representing the direction information is an angular coordinate b in a polar coordinate with the first corresponding point as a second origin, which belongs to the preset plane,
when a2 is 0, a polar axis of the polar coordinate is in the same direction as an x axis of the rectangular coordinate; and when a2 is not 0, the polar axis of the polar coordinate is parallel to the x axis of the rectangular coordinate and is in the same direction as the x axis,
the plane geometric function is b=arctan((y−a2)/(x−a1)), wherein x is not equal to a1; or
the plane geometric function is: b=arctan((y−a2)/(x−a1)) when x is not equal to a1, and b=90 degree when x is equal to a1.

3. The control method according to claim 1 , wherein, the parameter is determined according to a location coordinate of a corresponding training point of at least one training sound source obtained by study training on the preset plane with respect to the preset reference point and a coordinate representing direction information of the training point with respect to the first corresponding point.

4. A control apparatus, comprising:
an acquisition module, configured to acquire audio data including sound information of a target sound source;
a determination module, configured to determine location range information of the target sound source according to the audio data;
a control module, configured to control, according to the location range information, rotation of a camera device which currently cannot capture the target sound source, so that the camera device can capture the target sound source;
wherein, the location range information is direction information of the target sound source with respect to the camera device, and the control module comprises:
a first determination unit, configured to determine a rotation control parameter of the camera device corresponding to the direction information; and
a control unit, configured to control the rotation of the camera device according to the rotation control parameter, so that the camera device can capture the target sound source;
wherein, the audio data is collected by a sound collection device, and the determination module comprises:
a second determination unit, configured to determine position information of the target sound source with respect to the sound collection device according to the audio data; and
a third determination unit, configured to determine the direction information according to the position information;
a determination sub-unit, configured to determine the direction information according to the position information and a preset corresponding relationship between the position information and the direction information;
wherein, the sound collection device is used to determine a preset plane of the position information and a preset reference point on the preset plane, the camera device corresponds to a first corresponding point on the preset plane, and the target sound source corresponds to a second corresponding point on the preset plane,
the position information is a location coordinate of the second corresponding point with respect to the preset reference point, and the direction information is a coordinate representing direction information of the second corresponding point with respect to the first corresponding point,
the corresponding relationship is a plane geometric function with a location coordinate of a phonation corresponding point on the preset plane with respect to the preset reference point as an argument, a location coordinate of the first corresponding point with respect to the preset reference point as a parameter, and a coordinate representing direction information of the phonation corresponding point with respect to the first corresponding point as a variable.

5. A control device, comprising the control apparatus according to claim 4 .

Assignees

• Zte Corp

Inventors

• Chen Jun
• Huang Qiang
• Huang Zhihong

Classifications

• H04N7/142 Primary

  Constructional details of the terminal equipment, e.g. arrangements of the camera and the display · CPC title

• H04N23/69 Primary

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• G06F3/16

  Sound input; Sound output (speech processing G10L) · CPC title