Information processing apparatus, information processing method, and program

Patent metadata

Field	Value
Publication number	US-10834359-B2
Application number	US-201916676905-A
Country	US
Kind code	B2
Filing date	Nov 7, 2019
Priority date	Dec 11, 2015
Publication date	Nov 10, 2020
Grant date	Nov 10, 2020

Abstract

To provide an information processing apparatus, an information processing method, and a program capable of aurally producing distance in a virtual three-dimensional space by using the space for a connection to a communication partner, and realizing more comfortable communication. An information processing apparatus including: a reception unit configured to receive data from a communication destination; and a reproduction control unit configured to perform control such that sound data of a space of the communication destination is reproduced from a sound output unit in a space of a communication source with an output value in accordance with separation distance between the communication destination and the communication source disposed in a virtual three-dimensional space, the output value being different for each sound source type.

First claim

The invention claimed is:

1. A space information processing apparatus, comprising:
a processor that:
generates a first three dimensional virtual space associated with a first physical space; and
adjusts an output sound volume based on a change of a spatial distance between a reference point and a location of a first object within the first three dimensional virtual space, the output sound volume being adjusted such that as the spatial distance increases relative to the reference point, environmental sound associated with the first physical space increases.

2. The space information processing apparatus of claim 1 , wherein the processor generates space audio data based on first three dimensional virtual space data associated with the first three dimensional virtual space and adjusts the output sound volume based on the generated space audio data.

3. The space information processing apparatus of claim 2 , wherein the space audio data comprises a three dimensional sound image.

4. The space information processing apparatus of claim 2 , wherein the processor performs localized sound processing of each sound source located within the first physical space in generating the space audio data.

5. The space information processing apparatus of claim 1 , wherein the spatial distance comprises a virtual distance parameter in the first three dimensional virtual space.

6. The space information processing apparatus of claim 1 , wherein sound volume associated with the first object decreases as the spatial distance increases relative to the reference point.

7. The space information processing apparatus of claim 1 , wherein the first physical space is located remotely relative to the processor and the processor generates the first three dimensional virtual space based on image data and sound data associated with the first physical received over a communications network.

8. A method for reproducing audio in a telepresence system, comprising:
generating a first three dimensional virtual space associated with a first physical space; and
adjusting an output sound volume based on a change of a spatial distance between a reference point and a location of a first object within the first three dimensional virtual space, the output sound volume being adjusted such that as the spatial distance increases relative to the reference point, environmental sound associated with the first physical space increases.

9. The method of claim 8 , comprising generating space audio data based on first three dimensional virtual space data associated with the first three dimensional virtual space and adjusting the output sound volume based on the generated space audio data.

10. The method of claim 9 , wherein the space audio data comprises a three dimensional sound image.

11. The method of claim 9 , localizing each sound source located within the first physical space in generating the space audio data.

12. The method of claim 9 , wherein the first three dimensional virtual space data comprises image data and sound data associated with the first physical received over a communications network.

13. The method of claim 8 , wherein the spatial distance comprises a distance parameter in the first three dimensional virtual space.

14. The method of claim 8 , wherein sound associated with the first object decreases as the spatial distance increases relative to the reference point.

15. A telepresence system, comprising:
a video camera that captures local video images of a first physical space;
a microphone that captures local sound in the first physical space; and
a processor that:
processes the local video images and local sound;
generates a three dimensional virtual space associated with a second physical space;
adjusts an output sound volume based on a change of a spatial distance between a reference location and a location of an object within the three dimensional virtual space, the output sound volume being adjusted such that as the spatial distance increases relative to the reference point, environmental sound associated with the first physical space increases.

16. The telepresence system of claim 15 , wherein the second physical space is at a location remotely located relative to the first physical space.

17. The telepresence system of claim 16 , wherein the processor generates three dimensional virtual space data based on image data and sound data associated with the second physical received over a communications network.

18. The telepresence system of claim 15 , wherein the spatial distance comprises a virtual distance parameter in the three dimensional virtual space.

19. The telepresence system of claim 15 , wherein sound volume associated with the object decreases as the spatial distance increases relative to the reference location.

Assignees

• Sony Corp

Inventors

• Sakai Yusuke
• Izumihara Atsushi
• Miki Daisuke

Classifications

• H04N7/157 Primary

  defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827) · CPC title

• H04M11/00

  Telephonic communication systems specially adapted for combination with other electrical systems · CPC title

• H04S7/303

  Tracking of listener position or orientation · CPC title

• H04N7/15 Primary

  Conference systems · CPC title

• G10L21/0324

  Details of processing therefor · CPC title