Display device, method for realizing panoramic sound thereof, and non-transitory storage medium

Patent metadata

Field	Value
Publication number	US-11647349-B2
Application number	US-202117485116-A
Country	US
Kind code	B2
Filing date	Sep 24, 2021
Priority date	Sep 24, 2020
Publication date	May 9, 2023
Grant date	May 9, 2023

Abstract

A display device, a method for realizing panoramic sound, a non-transitory storage medium are provided. The method includes: performing space model parameter modification on preset space model based on application environment; determining middle audio source information based on video source information as read, determining side audio source information based on video source information and modified space model parameter; determining top audio source information based on sound image position information and side audio source information; controlling middle sound production circuit to produce sound based on middle audio source information, two side sound production circuits to produce sound based on side audio source information, top sound production circuit to produce sound based on top audio source information.

First claim

What is claimed is:

1. A method for realizing panoramic sound for a display device, wherein the display device comprises a middle sound production circuit, two side sound production circuits and a top sound production circuit; in a horizontal direction, one of the two side sound production circuits is on a first side of the display device, the other of the two side sound production circuits is on a second side of the display device, and the middle sound production circuit is between the two side sound production circuits; the top sound production circuit is on a side of the display device where an upper frame is located, and a sound production surface of the top sound production circuit faces a sound blocker above a head of an audience member;
wherein the method for realizing panoramic sound comprises:
performing space model parameter modification on a preset space model, based on an application environment of the display device;
reading video source information to be displayed by the display device, determining middle audio source information corresponding to the middle sound production circuit according to the video source information, and determining side audio source information corresponding to the two side sound production circuits based on the video source information and a modified space model parameter;
determining sound image position information according to the video source information;
determining top audio source information corresponding to the top sound production circuit, according to the sound image position information and the side audio source information; and
controlling the middle sound production circuit to produce sound based on the middle audio source information, controlling the two side sound production circuits to produce sound based on the side audio source information, and controlling the top sound production circuit to produce sound based on the top audio source information;
wherein the determining the middle audio source information corresponding to the middle sound production circuit comprises:
obtaining audio information from the video source information; and
separating the middle audio source information from the audio information directly;
wherein the determining the side audio source information corresponding to the two side sound production circuits comprises:
calculating the side audio source information by using a virtual speaker technology, according to the audio information and the modified space model parameter.

2. The method for realizing panoramic sound for the display device according to claim 1 , wherein the performing space model parameter modification on the preset space model based on the application environment of the display device comprises:
playing a preset test audio source;
receiving reflected sound information of the test audio source, wherein the reflected sound information is formed by reflection of the application environment; and
performing space model parameter modification on the preset space model according to the reflected sound information.

3. The method for realizing panoramic sound for the display device according to claim 1 , further comprising:
obtaining basic surround sound audio source information;
fusing the basic surround sound audio source information with the side audio source information to obtain target surround sound information; and
controlling the two side sound production circuits to produce sound based on the target surround sound information.

4. The method for realizing panoramic sound for the display device according to claim 1 , wherein the determining the sound image position information according to the video source information comprises:
determining attribute information of a sound production source according to the video source information;
in a case that the attribute information indicates that the sound production source is in a display image of the display device, obtaining video information from the video source information, and determining the sound image position information using a neighbor frame difference method according to the video information; and
in a case that the attribute information indicates that the sound production source is outside the display image of the display device, analyzing a change in sound intensity over time according to the video source information, and determining a distance between the sound production source and the audience member in real time to determine the sound image position information.

5. The method for realizing panoramic sound for the display device according to claim 1 , wherein the determining the top audio source information corresponding to the top sound production circuit according to the sound image position information and the side audio source information comprises:
determining sound intensity information corresponding to the two side sound production circuits according to the side audio source information; and
determining the top audio source information corresponding to the top sound production circuit, according to a conversion relationship between the sound image position information and the sound intensity information.

6. The method for realizing panoramic sound for the display device according to claim 1 , wherein the display device further comprises a bottom sound production circuit, and the bottom sound production circuit is on a side of the display device where a lower frame is located;
wherein the method for realizing panoramic sound further comprises:
separating bottom audio source information corresponding to the bottom sound production circuit from the audio information directly; and
controlling the bottom sound production circuit to produce sound based on the bottom audio source information.

7. A display device, comprising a middle sound production circuit, two side sound production circuits and a top sound production circuit; wherein in a horizontal direction, one of the two side sound production circuits is on a first side of the display device, the other of the two side sound production circuits is on a second side of the display device, and the middle sound production circuit is between the two side sound production circuits; the top sound production circuit is on a side of the display device where an upper frame is located, and a sound production surface of the top sound production circuit faces a sound blocker above a head of an audience member;
wherein the display device further comprises:
a modification circuit, configured to perform space model parameter modification on a preset space model, based on an application environment of the display device;
an audio source information determining circuit, configured to read video source information to be displayed by the display device, determine middle audio source information corresponding to the middle sound production circuit according to the video source information, and determine side audio source information corresponding to the two side sound production circuits based on the video source information and a modified space model parameter; and
a sound image position information determining circuit, configured to determine sound image position information according to the video source information;
wherein the audio source information determining circuit is further configured to determine top audio source information corresponding to the top sound production circuit, according to the sound image position information and the side audio source information;
wherein the middle sound production circuit is configured to produce sound based on the middle audio source information, the two side sound production circuits are configured to produce sound based on the side audio source information, and the top sound production circuit is configured

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Xi Yanhui
• Zhang Xiaomang
• Ji Zhihua
• Shi Tiankuo
• Sun Yan
• Zhang Shuo
• Peng Xiangjun
• Hou Yifan
• Zhao Chenxi
• Chu Minglei

Classifications

• H04S7/301 Primary

  Automatic calibration of stereophonic sound system, e.g. with test microphone · CPC title

• G10L19/008

  Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing · CPC title

• H04R2499/15

  Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops · CPC title

• H04R2205/022

  Plurality of transducers corresponding to a plurality of sound channels in each earpiece of headphones or in a single enclosure · CPC title

• H04R5/02

  Spatial or constructional arrangements of loudspeakers · CPC title