Electronic device for processing audio data and method for operating same

Patent metadata

Field	Value
Publication number	US-12198732-B2
Application number	US-202117310460-A
Country	US
Kind code	B2
Filing date	Jul 29, 2021
Priority date	Aug 4, 2020
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

An electronic device according to various embodiments includes a camera; a display; a communication module supporting Bluetooth communication; and a processor configured to: establish a communication link with a plurality of external electronic devices through the communication module; transmit a first signal indicating an occurrence of an event using the camera to at least one of the plurality of external electronic devices through the communication link; receive audio data corresponding to sound acquired by each of the plurality of external electronic devices, from each of the plurality of external electronic devices in predetermined time periods through the communication link in a state in which the plurality of external electronic devices are worn; and synchronize the audio data with video acquired using the camera and store the synchronized data, based on time and an order at which each of the plurality of external electronic devices acquires the sound.

First claim

The invention claimed is:

1. An electronic device comprising:
a camera;
a display;
a communication circuit configured to support Bluetooth communication; and
a processor, wherein the processor is configured to:
establish at least one communication link with a plurality of external electronic devices through the communication circuit;
perform an event for capturing video data using the camera in a binaural mode;
transmit a first signal indicating an occurrence of the event to at least one of the plurality of external electronic devices through the at least one communication link;
while capturing the video data using the camera, receive first audio data corresponding to a first sound acquired by a first external electronic device among the plurality of external electronic devices, in a first time period, and second audio data corresponding to a second sound acquired by a second external electronic device among the plurality of external electronic devices, in a second time period different from the first time period, through the at least one communication link in a state in which the plurality of external electronic devices are worn on a user's body;
acquire stereo audio data using the first audio data and the second audio data, based on time and sequence at which the first external electronic device and the second external electronic device acquire the first sound and the second sound, respectively;
identify a latency between the stereo audio data and the video data based on a first delay time for receiving the first audio data and the second audio data and a second delay time for acquiring the stereo audio data; and
synchronize and store the stereo audio data with the video data captured using the camera, based on the latency between the stereo audio data and the video data.

2. The electronic device of claim 1 , wherein the processor is configured to:
transmit a first acknowledgement (ACK) signal to the first external electronic device in the first time period when the first audio data is received; and
transmit a second ACK signal to the second external electronic device in the second time period when the second audio data is received.

3. The electronic device of claim 1 , wherein:
the first external electronic device includes an earphone in a first direction, and
the second external electronic device includes an earphone in a second direction.

4. The electronic device of claim 3 , wherein the processor is configured to:
check a wearing state of each of the first external electronic device and the second external electronic device; and
display information on the wearing state through the display.

5. The electronic device of claim 1 , wherein the processor is configured to:
receive the first audio data through a first communication link established with the first external electronic device; and
receive the second audio data through a second communication link established with the second external electronic device.

6. The electronic device of claim 1 , wherein the processor is configured to:
receive the first audio data from the first external electronic device through a first communication link established with the first external electronic device; and
receive the second audio data from the second external electronic device using the first communication link.

7. The electronic device of claim 1 , wherein the processor is configured to:
receive the first audio data and the second audio data from of the first external electronic device and the second external electronic device, respectively, using at least one of an extended synchronous connections (eSCO) communication channel, an asynchronous connection-less (ACL) communication channel, or a BLE communication channel.

8. A method of operating an electronic device, comprising:
establishing at least one communication link with a plurality of external electronic devices;
performing an event for capturing video data using a camera included in the electronic device in a binaural mode;
transmitting a first signal indicating an occurrence of the event to at least one of the plurality of external electronic devices through the at least one communication link;
while capturing the video data using the camera, receiving first audio data corresponding to a first sound acquired by a first external electronic device among the plurality of external electronic devices, in a first time period, and second audio data corresponding to a second sound acquired by a second external electronic device among the plurality of external electronic devices, in a second time period different from the first time period, through the at least one communication link in a state in which the plurality of external electronic devices are worn;
acquiring stereo audio data using the first audio data and the second audio data, based on time and sequence at which the first external electronic device and the second external electronic device acquire the first sound and the second sound, respectively;
identifying a latency between the stereo audio data and the video data based on a first delay time for receiving the first audio data and the second audio data and a second delay time for acquiring the stereo audio data; and
synchronizing and storing the stereo audio data with video data captured using the camera, based on the latency between the stereo audio data and the video data.

9. The method of claim 8 , further comprising:
transmitting a first ACK signal to the first external electronic device in the first time period when the first audio data is received; and
transmitting a second ACK signal to the second external electronic device in the second time period when the second audio data is received.

10. The method of claim 8 , further comprising:
identifying a wearing state of each of the first external electronic device and the second external electronic device; and
displaying information on the wearing state through the display.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Cheong Gupil
• Kim Hyunwook
• Moon Hangil
• Lee Byoungchul
• Jin Juyeon
• Kang Doosuk
• Choi Bokun

Classifications

• H04R2420/07

  Applications of wireless loudspeakers or wireless microphones · CPC title

• H04M2201/34

  Microprocessors · CPC title

• H04M1/0264

  for a camera module assembly · CPC title

• G06F3/162

  Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs · CPC title

• H04W4/80

  Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication · CPC title