Electronic device and method for playing back image data

Patent metadata

Field	Value
Publication number	US-9812168-B2
Application number	US-201615044321-A
Country	US
Kind code	B2
Filing date	Feb 16, 2016
Priority date	Feb 16, 2015
Publication date	Nov 7, 2017
Grant date	Nov 7, 2017

Abstract

The present disclosure provides an electronic device and method for playing image data. The method for playing back image data in an electronic device includes storing an audiovisual (A/V) data for a predetermined period of time in a memory of the electronic device. The electronic device plays back the A/V data, wherein upon playing back, by the electronic device, the A/V data comprises analyzing an audio signal of the A/V data dynamically to select one of a plurality of sound effects based on the analyzed audio signal. The A/V data is played back by applying the selected sound effect to at least a part of the A/V signal.

First claim

What is claimed is:

1. A method for operating an electronic device, the method comprising:
storing audiovisual (A/V) data for a predetermined period of time, in a memory of the electronic device; and
playing back the A/V data stored in the memory;
wherein playing back the A/V data comprises:
analyzing an audio signal of the A/V data dynamically;
selecting one of a plurality of sound effects based on the analyzed audio signal; and
playing back the A/V data by applying the selected one sound effect to at least a part of the A/V signal,
wherein selecting one of the plurality of sound effects comprising:
obtaining Pulse Code Modulation (PCM) data per channel by decoding the analyzed audio signal;
calculating a deviation energy between left and right sides of each frame of the obtained PCM data per channel, and center energy; and
selecting one of the plurality of sound effects based on the calculated deviation energy and the center energy.

2. The method of claim 1 , further comprising:
downloading a copy of the A/V data from an external electronic device prior to storing the A/V data in the memory.

3. The method of claim 1 , further comprising:
receiving a stream of a copy of the A/V data from an external electronic device prior to storing the A/V data in the memory.

4. The method of claim 1 , wherein analyzing the audio signal of the A/V data dynamically comprises,
buffering a part of the A/V data to be played back in an area of the memory; and
analyzing an audio signal of the buffered part of the A/V data.

5. The method of claim 1 , wherein playing back the A/V data by applying the selected one sound effect to at least a part of the A/V signal comprises:
applying the selected one sound effect to an audio signal to be played back.

6. The method of claim 1 , further comprising:
comparing a value resulting from dividing the center energy by a sum of the deviation energy and the center energy with a first threshold.

7. The method of claim 6 , further comprising:
determining the analyzed audio signal as a first audio signal; and
selecting a conversation mode to be applied to image data of the A/V data, if the value of the division is greater than the first threshold.

8. The method of claim 7 , wherein a selected mode corresponds to one of a conversation mode, a music mode, and a film mode, each mode including a plurality of genres classified according to a mood value extracted from the analyzed audio signal.

9. The method of claim 1 , further comprising:
buffering the obtained PCM data per channel for a predetermined period of time;
extracting a mood value from the buffered PCM data per channel;
combining the extracted mood value, and a ratio of center energy to total energy calculated with the obtained PCM data per channel in frame; and
determining whether the analyzed audio signal comprises at least one of other audio signals by comparing the combined value with a second threshold.

10. The method of claim 9 , further comprising:
if the analyzed audio signal corresponds to an audio signal from music, using the extracted mood value to classify the audio signal by music genres.

11. The method of claim 9 , further comprising:
if the analyzed audio signal corresponds to an audio signal from a film, using the extracted mood value to classify the audio signal by film genres.

12. An electronic device for playing back image data, the electronic device comprising:
a transceiver configured to transmit/receive image data;
a non-transitory memory configured to store the image data;
a controller configured to include at least one processor having circuitry configured to analyze an audio signal from the image data, select a mode to be applied to the image data based on the analyzed audio signal, and apply the selected mode to the image data; and
an output configured to play back the image data with the selected mode applied thereto,
wherein the controller is further configured to:
obtain Pulse Code Modulation (PCM) data per channel by decoding the analyzed audio signal;
calculate a deviation energy between left and right sides of each frame of the obtained PCM data per channel, and center energy; and
select one of a plurality of sound effects based on the calculated deviation energy and the center energy.

13. The electronic device of claim 12 , wherein the controller is configured to compare a value resulting from dividing the center energy by a sum of the deviation energy and the center energy with a first threshold.

14. The electronic device of claim 13 , wherein the controller is configured to, if the value of the division is greater than the first threshold, determine the analyzed audio signal comprises a first audio signal, select a first audio mode to be applied to the image data, and apply the selected first audio mode and a video mode that matches the first audio mode to the image data.

15. The electronic device of claim 13 , wherein the controller is configured to, if the value of the division is not greater than the first threshold, determine whether the analyzed audio signal corresponds to at least one of other audio signals.

16. The electronic device of claim 12 , wherein the controller is configured to
buffer the obtained PCM data per channel for a predetermined period of time;
extract a mood value from the buffered PCM data per channel;
combine the extracted mood value, and a ratio of a center energy to a total energy calculated with the obtained PCM data per channel in a frame; and
determine whether the analyzed audio signal is at least one of other audio signals or an audio signal from a film by comparing the combined value with a second threshold.

17. The electronic device of claim 12 , wherein the controller is configured to integrate or separate the obtained PCM data per channel into two channels.

18. A non-transitory computer-readable storage medium having a program embodied thereon to operate an electronic device, the program including instructions of:
a first instruction set for storing audiovisual (A/V) data in a memory of the electronic device; and
a second instruction set for playing back the A/V data stored in the memory,
wherein the second instruction set comprises:
a third instruction set for analyzing an audio signal of the A/V data dynamically;
a fourth instruction set for selecting one of a plurality of sound effects based on the analyzed audio signal; and
a fifth instruction set for playing back the A/V data by applying the selected one sound effect to at least a part of the A/V signal, and
wherein the fourth instruction set comprises:
a sixth instruction set for obtaining Pulse Code Modulation (PCM) data per channel by decoding the analyzed audio signal;
a seventh instruction set for calculating a deviation energy between left and right sides of each frame of the obtained PCM data per channel, and center energy; and
a eighth instruction set for selecting one of the plurality of sound effects based on the calculated deviation energy and the center energy.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Doo-Hyun
• Kim Jae-Hyun
• Kim Byeong-Jun
• Park Sang-Soo
• Lee Jun-Soo
• Hwang Ho-Chul

Classifications

• H04N21/4305

  Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets (arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083) · CPC title

• H04N21/2387

  Stream processing in response to a playback request from an end-user, e.g. for trick-play · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• H04N21/4394 Primary

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title

• H04N21/4307

  Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen · CPC title