Computer system for realizing customized being-there in association with audio and method thereof

Patent metadata

Field	Value
Publication number	US-11930348-B2
Application number	US-202117534804-A
Country	US
Kind code	B2
Filing date	Nov 24, 2021
Priority date	Nov 24, 2020
Publication date	Mar 12, 2024
Grant date	Mar 12, 2024

Abstract

A method by a computer system including generating audio files based on respective audio signals, the audio signals having been respectively generated from a plurality of objects at a venue, generating metadata including spatial features at the venue that are respectively set for the objects, and transmitting the audio files and the metadata for the objects to a first electronic device to cause the first electronic device to realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata may be provided.

First claim

What is claimed is:

1. A method by a computer system, the method comprising:
generating audio files based on respective audio signals, the audio signals having been respectively generated from a plurality of objects at a venue;
generating metadata including spatial features at the venue that are respectively set for the objects; and
transmitting the audio files and the metadata for the objects to a first electronic device to cause the first electronic device to realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata,
wherein the metadata includes at least one of position information about each of the objects, group information representing a position combination of at least two objects among the objects, and environment information about the venue.

2. The method of claim 1 , wherein the generating audio files comprises:
obtaining the audio signals through a microphone attached to each of the objects or installed adjacent to each of the objects; and
generating the audio files from the audio signals, respectively.

3. The method of claim 1 , wherein the generating metadata comprises:
outputting a graphic interface;
setting the spatial features for the objects, respectively, based on at least one input through the graphic interface; and
generating the metadata based on the spatial features.

4. The method of claim 1 , wherein each of the objects includes one of a musical instrument, an instrument player, a vocalist, a talker, a speaker, and a background.

5. The method of claim 1 , wherein the transmitting causes the first electronic device to be configured such that the being-there at the venue is realized by receiving the audio files and the metadata, by extracting desired information from the metadata, and by rendering the audio files based on the desired information and at least one input through a user interface.

6. The method of claim 5 , wherein the transmitting causes the first electronic device to extract the desired information including first information and second information, and perform switching from the first information to the second information at a point of reducing or minimizing a sound quality distortion by referring to a look-up table including an index of sound quality distortion occurring in connection with the switching from the first information to the second information over time.

7. A method by a computer system, the method comprising:
generating audio files based on respective audio signals, the audio signals having been respectively generated from a plurality of objects at a venue;
generating metadata including spatial features at the venue that are respectively set for the objects; and
transmitting the audio files and the metadata for the objects to a first electronic device to cause the first electronic device to realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata, wherein
the generating audio files and the generating metadata are performed using a production tool included in a second electronic device that is included in the computer system, and
the generating metadata generates the metadata in a form selectable by the first electronic device.

8. The method of claim 7 , wherein the transmitting the audio files and the metadata comprises:
receiving, by a server, the audio files and the metadata from the second electronic device included in the computer system based on a first communication protocol; and
transmitting, by the server, the audio files and the metadata to the first electronic device based on a second communication protocol.

9. The method of claim 8 , wherein the server is a live streaming server.

10. A non-transitory computer-readable record medium storing a program, which when executed by at least one processor included in a computer system, causes the computer system to perform the method of claim 1 .

11. A computer system comprising:
a first electronic device included in the computer system and configured to,
generate audio files based on respective audio signals, the audio signals respectively generated from a plurality of objects at a venue, and
generate metadata including spatial features at the venue that are respectively set for the objects; and
a server configured to transmit the audio files and the metadata for the objects to a second electronic device to cause the second electronic device to realize a being-there at the venue by rendering the audio files based on the spatial features in the metadata,
wherein the metadata includes at least one of position information about each of the objects, group information representing a position combination of at least two objects among the objects, and environment information about the venue.

12. The computer system of claim 11 , wherein the first electronic device is configured to obtain the audio signals through a microphone attached to each of the objects or installed adjacent to each of the objects, and generate the audio files from the audio signals, respectively.

13. The computer system of claim 11 , wherein the first electronic device is configured to output a graphic interface, to set the spatial features for the objects, respectively, based on at least one input through the graphic interface, and generate the metadata based on the spatial features.

14. The computer system of claim 11 , wherein each of the objects includes one of a musical instrument, an instrument player, a vocalist, a talker, a speaker, and a background.

15. The computer system of claim 11 , wherein the first electronic device includes a production tool and is configured to generate the audio files and the metadata using the production tool, and generate the metadata in a form selectable by the first electronic device.

16. The computer system of claim 11 , wherein the server is configured to receive the audio files and the metadata from the first electronic device based on a first communication protocol, and transmit the audio files and the metadata to the second electronic device based on a second communication protocol.

17. The computer system of claim 11 , wherein the server is configured to transmit the audio files and the metadata for the objects to the second electronic device to cause the second electronic device to realize the being-there at the venue by receiving the audio files and the metadata, by extracting desired information from the metadata, and by rendering the audio files based on the desired information and at least one input through a user interface.

18. The computer system of claim 17 , wherein the server is configured to transmit the audio files and the metadata for the objects to the second electronic device to cause the second electronic device is configured to extract the desired information including first information and second information, and perform switching from the first information to the second information at a point of reducing or minimizing a sound quality distortion by referring to a look-up table including an index of sound quality distortion occurring in connection with the switching from the first information to the second information over time.

Assignees

• Naver Corp
• Gaudio Lab Inc

Inventors

• Kim Dae Hwang
• Kim Jung Sik
• Kim Dong Hwan
• Lee Ted
• Seo Jeonghun
• Seo Hyeonsu

Classifications

• H04S7/30 Primary

  Control circuits for electronic adaptation of the sound field · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F16/687

  using geographical or spatial information, e.g. location · CPC title

• H04L65/61

  for supporting one-way streaming services, e.g. Internet radio · CPC title

• H04S3/008

  in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02) · CPC title