Systems, devices, and methods of manipulating audio data based on display orientation

Patent metadata

Field	Value
Publication number	US-11586407-B2
Application number	US-202016896998-A
Country	US
Kind code	B2
Filing date	Jun 9, 2020
Priority date	Jun 9, 2020
Publication date	Feb 21, 2023
Grant date	Feb 21, 2023

Abstract

An electronic device includes sensors configured to detect an orientation of a display, driver logic, and a speaker array. The driver logic processes the audio data received by an interface to form audio output data, and forms driver signals representing the audio output data based on the orientation of the display detected by the one or more sensors. The speaker array receives the driver signals formed orientation of the display, and renders the audio output data for playback based on the driver signals.

First claim

What is claimed is:

1. An electronic device comprising:
sensors configured to detect an orientation of a display with respect to a base;
driver logic configured to:
process audio input data captured by a microphone array fixedly attached to the display and received by an interface to form audio output data; and
form driver signals representing the audio output data based on the orientation of the display with respect to the base detected by the sensors; and

a speaker array physically coupled to the base and configured to:
receive the driver signals formed based on the orientation of the display with respect to the base; and
render the audio output data for playback based on the driver signals.

2. The electronic device of claim 1 , wherein to form the driver signals based on the orientation of the display with respect to the base, the driver logic is configured to:
determine a set of equalization parameters corresponding to the orientation of the display with respect to the base; and
form the driver signals based on the set of equalization parameters.

3. The electronic device of claim 2 , wherein to determine the set of equalization parameters corresponding to the orientation of the display with respect to the base, the driver logic is configured to select the set of equalization parameters corresponding to the orientation of the display with respect to the base from a plurality of sets of equalization parameters using a lookup table.

4. The electronic device of claim 2 , wherein to determine the set of equalization parameters corresponding to the orientation of the display with respect to the base, the driver logic is configured to apply a finite element solution that determines the set of equalization parameters corresponding to the orientation of the display with respect to the base.

5. The electronic device of claim 2 , wherein to determine the set of equalization parameters corresponding to the orientation of the display with respect to the base, the driver logic is configured to apply an artificial intelligence model or a machine learning model trained with a mapping of rotation angles of the display to respective sets of equalization parameters to predict the set of equalization parameters corresponding to the orientation of the display with respect to the base.

6. The electronic device of claim 2 , wherein the set of equalization parameters includes one or more of an amplitude, a high pass filter, a low pass filter, notch filters, an adjust Q factor, a filter amplitude, or a phase.

7. The electronic device of claim 6 , wherein the amplitude is expressed as a function of a frequency.

8. The electronic device of claim 1 , wherein the sensors include one or more of an accelerometer, a position encoder, a gyroscope, a motion sensor, camera hardware, an imaging system, a radio frequency probe, an antenna, or a Hall probe.

9. The electronic device of claim 1 , wherein the microphone is array is fixedly attached to a bezel of the display.

10. The electronic device of claim 9 , wherein the sensors are configured to detect a movement of the display with respect to the base while the base remains stationary with respect to an environment.

11. A method comprising:
detecting, by one or more sensors, an orientation of a display of an electronic device with respect to a base of the electronic device;
processing audio input data captured by a microphone array fixedly attached to the base to form audio output data;
forming, by driver logic, driver signals representing the audio output data based the orientation of the display with respect to the base detected by the one or more sensors;
receiving, by a speaker array coupled to the base of the electronic device, the driver signals formed based on the orientation of the display with respect to the base; and
rendering, by the speaker array, the audio output data for playback based on the driver signals.

12. The method of claim 11 , wherein forming the driver signals based on the orientation of the display with respect to the base comprises:
determining, by the driver logic of the electronic device, a set of equalization parameters corresponding to the orientation of the display with respect to the base; and
forming, by the driver logic, the driver signals based on the set of equalization parameters.

13. The method of claim 12 , wherein determining the set of equalization parameters corresponding to the orientation of the display with respect to the base comprises selecting, by the driver logic, the set of equalization parameters corresponding to the orientation of the display with respect to the base from a plurality of sets of equalization parameters using a lookup table.

14. The method of claim 12 , wherein determining the set of equalization parameters corresponding to the orientation of the display with respect to the base comprises applying, by the driver logic, a finite element solution that determines the set of equalization parameters corresponding to the orientation of the display with respect to the base.

15. The method of claim 12 , wherein determining the set of equalization parameters corresponding to the orientation of the display with respect to the base comprises applying, by the driver logic, an artificial intelligence model or a machine learning model trained with a mapping of rotation angles of the display with respect to the base to respective sets of equalization parameters to predict the set of equalization parameters corresponding to the orientation of the display with respect to the base.

16. The method of claim 12 , wherein the set of equalization parameters includes one or more of an amplitude, a high pass filter, a low pass filter, notch filters, an adjust Q factor, a filter amplitude, or a phase.

17. The method of claim 11 , wherein the microphone is array is fixedly attached to a bezel of the display.

18. The method of claim 11 , further comprising detecting, by the one or more sensors, a movement of the display with respect to the base while the base remains stationary with respect to an environment.

19. A non-transitory computer-readable storage medium storing one or more programs configured for execution by one or more processors of an electronic device having a display, a microphone array fixedly attached to the display, an interface, one or more sensors, and a speaker array coupled to a base, the one or more programs including instructions, which when executed by the one or more processors, cause the electronic device to:
receive, via the interface, audio input data captured by the microphone array;
detect, via the one or more sensors coupled to the processing circuitry, an orientation of the display of the electronic device with respect to the base;
process the audio input data received by the interface to form audio output data;
form, based on the orientation of the display with respect to the base detected by the one or more sensors, driver signals representing the audio output data; and
render, via the speaker array, the audio output data for playback based on the driver signals.

Assignees

• Meta Platforms Tech Llc

Inventors

• Back Tyler
• Bingham Joshua Warren
• Zeng yuhuan
• Ivanov Plamen
• Evans Christopher
• Nilsson Jens
• Asfaw Michael

Classifications

• G06F3/14 Primary

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• H04M3/568 Primary

  audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30) · CPC title

• H04M1/6033

  for providing handsfree use or a loudspeaker mode in telephone sets (arrangements for preventing acoustic echo H04M9/08) · CPC title

• G06F3/162

  Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs · CPC title

• H04R2499/15

  Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops · CPC title