Estimation device and estimation method using sound image localization processing

Patent metadata

Field	Value
Publication number	US-9594148-B2
Application number	US-201313927599-A
Country	US
Kind code	B2
Filing date	Jun 26, 2013
Priority date	Aug 15, 2012
Publication date	Mar 14, 2017
Grant date	Mar 14, 2017

Abstract

A computer-readable recording medium storing an estimation program for causing a computer to execute a process, the process includes: executing sound image localization processing for each of pieces of sound data output by a plurality of sound sources; and specifying, on the basis of a change in orientation of a listener caused in accordance with the sound image localization processing, at least one of the plurality of sound sources related to the listener.

First claim

What is claimed is:

1. A non-transitory computer-readable recording medium storing an estimation program for causing a computer to execute a process, the process comprising:
obtaining plural pieces of sound data originated from a plurality of sound sources, each of the plural pieces of sound data being associated with a first location of each of the plurality of sound resources;
executing first sound image localization processing that generates first localization sound data with which each of the plurality of sound sources is able to be heard by a listener from the first location with respect to each of the plural pieces of sound data;
executing second sound image localization processing that generates second localization sound data with which each of the plurality of sound sources is able to be heard by the listener as expanding an angle formed by two directions adjacent to each other among directions with respect to each of the plurality of sound sources included in the first localization sound data;
outputting the second localization sound data to a terminal of the listener to cause the terminal to play back the second localization sound data;
sensing an orientation of the listener during a playback of the second localization sound data; and
specifying, on the basis of the change in orientation of the listener, at least one of the plurality of sound sources in which the listener is interested.

2. The non-transitory computer-readable recording medium according to claim 1 , the process further comprising:
obtaining, after the execution of the second sound image localization processing, first direction information indicating a first orientation of the listener; and
specifying a sound source existing in a direction indicated by the first direction information among the plurality of sound sources.

3. The non-transitory computer-readable recording medium according to claim 2 , the process further comprising:
obtaining, prior to the execution of the second sound image localization processing, position information indicating a position of the listener; and
specifying, on the basis of the position information, a second orientation from the listener for each of the plurality of sound sources,
wherein the executing of the second sound image localization processing generates the second localization sound data including a sound apparently output from a third orientation that is different from the second orientation for at least one of the pieces of sound data.

4. The non-transitory computer-readable recording medium according to claim 3 ,
wherein the third orientation is adjusted such that an interval between directions of adjacent ones of the plurality of sound sources, which are based on the position information, is a given value or more.

5. The non-transitory computer-readable recording medium according to claim 4 , the process further comprising:
executing third sound image localization
processing that generates, for sound data originated from a similar sound source corresponding to an orientation closest to the first orientation among third orientations of each of the plurality of sound sources, third localization sound data that includes a sound apparently output from an orientation different from the third orientation; and
outputting the third localization sound data to the terminal to cause the terminal to play back the third localization sound data,
sensing a change of orientation of the listener during a playback of the third localization sound data,
specifying, on the basis of the change in orientation of the listener, the sound source in which the listener is interested.

6. The non-transitory computer-readable recording medium according to claim 5 ,
wherein the third sound image localization processing generates the third localization sound data such that a direction of the sound gradually moves from the third orientation to the second orientation.

7. An estimation method to be executed by a computer, the estimation method comprising:
obtaining plural pieces of sound data originated from a plurality of sound sources, each of the plural pieces of sound data being associated with a first location of each of the plurality of sound resources;
executing first sound image localization processing that generates first localization sound data with which each of the plurality of sound sources is able to be heard by a listener from the first location with respect to each of the plural pieces of sound data;
executing second sound image localization processing that generates second localization sound data with which each of the plurality of sound sources is able to be heard by the listener as expanding an angle formed by two directions adjacent to each other among directions with respect to each of the plurality of sound sources included in the first localization sound data;
outputting the second localization sound data to a terminal of the listener to cause the terminal to play back the second localization sound data;
sensing an orientation of the listener during a playback of the second localization sound data; and
specifying, on the basis of the change in orientation of the listener, at least one of the plurality of sound sources in which the listener is interested.

8. The estimation method according to claim 7 , further comprising:
obtaining, after the execution of the second sound image localization processing, first direction information indicating a first orientation of the listener; and
specifying a sound source existing in a direction indicated by the first direction information among the plurality of sound sources.

9. The estimation method according to claim 8 , further comprising:
obtaining, prior to the execution of the second sound image localization processing, position information indicating a position of the listener; and
specifying, on the basis of the position information, a second orientation from the listener for each of the plurality of sound sources,
wherein the executing of the second sound image localization processing generates the second localization sound data including a sound apparently output from a third orientation that is different from the second orientation for at least one of the pieces of sound data.

10. The estimation method according to claim 9 ,
wherein the third orientation is adjusted such that an interval between directions of adjacent ones of the plurality of sound sources, which are based on the position information, is a given value or more.

11. The estimation method according to claim 10 , further comprising:
executing third sound image localization
processing that generates, for sound data originated from a similar sound source corresponding to an orientation closest to the first orientation among third orientations of each of the plurality of sound sources, third localization sound data that includes a sound apparently output from an orientation different from the third orientation; and
outputting the third localization sound data to the terminal to cause the terminal to play back the third localization sound data,
sensing a change of orientation of the listener during a playback of the third localization sound data,
specifying, on the basis of the change in orientation of the listener, the sound source in which the listener is interested.

12. The estimation method according to claim 11 ,
wherein the third sound image localization processing generates the third localization sound data such that a direction of the sound gradually moves from the third orientation to the second orientation.

13. An estimation device comprising:
a memory; and
a processor coupled to the me

Assignees

• Fujitsu Ltd

Inventors

• Sumioka Motoshi
• Sasaki Kazuo

Classifications

• G09B5/06 Primary

  with both visual and audible presentation of the material to be studied · CPC title

• G01S3/80 Primary

  using ultrasonic, sonic or infrasonic waves · CPC title

• G01C21/20

  Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence) · CPC title