Display apparatus and recording medium

Patent metadata

Field	Value
Publication number	US-2019320114-A1
Application number	US-201716317424-A
Country	US
Kind code	A1
Filing date	May 22, 2017
Priority date	Jul 11, 2016
Publication date	Oct 17, 2019
Grant date	—

Abstract

A display apparatus including: a display; a loudspeaker; a user input unit; a video processor configured to process a video signal to be displayed as an image on the display, and change a viewpoint of the image displayed on the display in response to a user input made through the user input unit; and an audio processor configured to process an audio signal to be output as a sound from the loudspeaker, determine acoustic features of the audio signal, and adjust the output of the sound from the loudspeaker according to the acoustic features in response to the user input.

First claim

1 . A display apparatus comprising:
a display; a loudspeaker; a user input unit; a video processor configured to process a video signal to be displayed as an image on the display, and change a viewpoint of the image displayed on the display in response to a user input made through the user input unit; and an audio processor configured to process an audio signal to be output as a sound from the loudspeaker, determine acoustic features of the audio signal, and adjust the output of the sound from the loudspeaker according to the acoustic features in response to the user input.

2 . The display apparatus according to claim 1 , wherein the audio processor determines the acoustic features by determining whether the audio signal is generated by live recording.

3 . The display apparatus according to claim 2 , wherein the audio processor derives a first component corresponding to an audio component of a center channel from the audio signal, and a second component corresponding to an audio component obtained by subtracting the first component from either of a left channel or a right channel, and determines that the audio signal is generated by the live recording when a power ratio between the first component and the second component is greater than a preset threshold value.

4 . The display apparatus according to claim 2 , wherein the audio processor determines that the audio signal is generated by the live recording when similarity between an audio component of a left channel and an audio component of a right channel is lower than a preset level in the audio signal.

5 . The display apparatus according to claim 1 , wherein the audio processor does not adjust the output of the sound from the loudspeaker regardless of the user input, when it is determined that the audio signal is generated by post-process recording.

6 . The display apparatus according to claim 1 , wherein the video signal comprises a wide-angle image captured by a wide-angle camera, and
the video processor processes a partial area of the wide-angle image to be displayed as the image on the display.

7 . The display apparatus according to claim 6 , wherein the video processor processes the wide-angle image to be panned in response to the user input made to move a viewpoint of the user and displayed on the display, and
the audio processor determines change in position of a sound source due to the panning, and adjusts the output of the sound by controlling output power of audio components according to channels of the sound source in the audio signal corresponding to the changed position of the sound source.

8 . The display apparatus according to claim 7 , wherein the user input comprises information about an angle between a default user viewpoint to the image and the moved user viewpoint.

9 . The display apparatus according to claim 6 , wherein the video processor processes the image to be zoomed in or out in response to the user input made to change a zoom depth of the image and displayed on the display, and
the audio processor determines change in distance of a sound source within the changed image with respect to a user, and adjusts the output of the sound by increasing and decreasing output power of an audio component of the sound source in the audio signal corresponding to the changed distance of the sound source.

10 . The display apparatus according to claim 1 , wherein the audio processor acquires view information provided along with the audio signal from a content provider, and adjusts the output of the sound from the loudspeaker in accordance with the acoustic features corresponding to the view information.

11 . A recording medium, in which a program code of a method implementable and processible by a processor of a display apparatus comprising a display and a loudspeaker,
the method comprising: displaying an image on the display; outputting a sound from the loudspeaker; changing a viewpoint of the image displayed on the display in response to a user input; determining acoustic features of an audio signal, and adjusting the output of the sound from the loudspeaker according to the acoustic features in response to the user input.

12 . The recording medium according to claim 11 , wherein the adjusting of the output of the sound from the loudspeaker comprises determining the acoustic features by determining whether the audio signal is generated by live recording.

13 . The recording medium according to claim 12 , wherein the determining of the acoustic features comprises:
deriving a first component corresponding to an audio component of a center channel from the audio signal, and a second component corresponding to an audio component obtained by subtracting the first component from either of a left channel or a right channel; and determining that the audio signal is generated by the live recording when a power ratio between the first component and the second component is greater than a preset threshold value.

14 . The recording medium according to claim 12 , wherein the determining of the acoustic features comprises:
determining that the audio signal is generated by the live recording when similarity between an audio component of a left channel and an audio component of a right channel is lower than a preset level in the audio signal.

15 . The recording medium according to claim 11 , wherein the adjusting of the output of the sound from the loudspeaker comprises preventing the output of the sound from the loudspeaker from being adjusted regardless of the user input, when it is determined that the audio signal is generated by post-process recording.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Sang-Moon
• Ko Sang-Chul
• Cheon Byeong-Geun

Classifications

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N21/816

  involving special video data, e.g 3D video · CPC title

• H04N9/802

  involving processing of the sound signal (H04N9/806, H04N9/835 take precedence) · CPC title

• H04S1/00

  Two-channel systems (H04S5/00, H04S7/00 take precedence) · CPC title

• H04N5/445 Primary

  for displaying additional information (H04N5/50 takes precedence) · CPC title