Head mounted display and method of outputting audio signal using the same

Patent metadata

Field	Value
Publication number	US-9374549-B2
Application number	US-201213686596-A
Country	US
Kind code	B2
Filing date	Nov 27, 2012
Priority date	Oct 29, 2012
Publication date	Jun 21, 2016
Grant date	Jun 21, 2016

Abstract

The invention relates to a head mounded display that outputs an audio signal of an external digital device according to whether the audio signal is directional output signal.

First claim

What is claimed is:

1. A head mounted display (HMD) comprising:
a processor configured to control an operation of the HMD;
an audio output unit configured to output audio according to a command of the processor, wherein the audio output unit includes a left channel output unit and a right channel output unit;
a sensor unit configured to detect at least one external digital device connected to the HMD and transmitting whether at least one external digital device is connected to the HMD to the processor; and
a communication unit configured to transmit/receive data to/from the external digital device according to a command of the processor,
wherein the processor receives an audio signal of the external digital device,
determines whether to output the received audio signal directionally,
detects location information of the external digital device corresponding to the audio signal when the received audio signal is a directional output signal, wherein the location information represents a relative location of the external digital device with respect to the HMD,
detects a location state of the external digital device based on the location information, wherein the location state includes a first state in which the external digital device is located within a predetermined view angle of the HMD and a second state in which the external digital device is not located within the view angle of the HMD, and
outputs the audio signal based on the detected location information and location state of the external digital device, wherein the audio signal output includes a left channel output and a right channel output, wherein at least one of the left channel output and the right channel output is controlled respectively based on the location information and the location state of the external digital device for outputting directional audio sound,
wherein the processor controls an output level of the audio signal to be less than or equal to a predetermined level or blocks output of the audio signal when the location state of the external digital device corresponds to the second state.

2. The HMD of claim 1 , wherein the processor provides a rear view interface, which virtually represents the location information of the external digital device, on the HMD when the location state of the external digital device corresponds to the second state.

3. The HMD of claim 1 , wherein the processor controls at least one of an output level difference and an output time difference between the left channel output and the right channel output based on the location information of the external digital device.

4. The HMD of claim 1 , wherein the processor converts the audio signal into a 3D audio signal based on the location of the external digital device, wherein the 3D audio signal is a binaural audio signal having 3D effect.

5. The HMD of claim 4 , wherein the processor generates a head related transfer function (HRTF) information based on the location information of the external digital device, and
converts the audio signal into the 3D audio signal using the generated HRTF information.

6. The HMD of claim 1 , wherein the sensor unit includes a left channel receiving unit configured to receive the audio signal for audio output of the left channel output unit and a right channel receiving unit configured to receive the audio signal for audio output of the right channel output unit,
wherein the processor controls at least one of the left channel output and the right channel output by reflecting a received time difference of the audio signal that the left channel receiving unit and the right channel receiving unit respectively receive.

7. The HMD of claim 6 , wherein the audio signal of the external digital device includes an ultrasonic signal, and
the processor converts ultrasonic signals respectively received by the left channel receiving unit and the right channel receiving unit into the left channel output and the right channel output at an audible frequency and outputs the left channel output and the right channel output.

8. The HMD of claim 6 , wherein the left channel output unit and the right channel output unit output the audio signal received by the left channel receiving unit and the right channel receiving unit respectively in real time.

9. The HMD of claim 1 , wherein the communication unit includes at least one antenna, and
the processor detects the location information of the external digital device using a signal transmitted/received between the HMD and the external digital device through the antenna.

10. The HMD of claim 1 , wherein the sensor unit further includes a camera unit,
wherein the processor detects an image of the external digital device using the camera unit, and obtains the location information of the external digital device using the detected image.

11. The HMD of claim 1 , wherein the sensor unit further includes a camera unit,
wherein the processor detects a marker corresponding to the external digital device using the camera unit, and obtains the location information of the external digital device using the detected marker.

12. The HMD of claim 11 , wherein the marker includes an optical pattern output from the external digital device.

13. The HMD of claim 1 , wherein the processor provides an audio output control interface configured to control output of the audio signal of at least one of the external digital device, and
controls an output level of the audio signal of the external digital device based on a user input for the audio output control interface.

14. The HMD of claim 13 , wherein the processor displays the audio output control interface of the audio signal at a position corresponding to the external digital device when the audio signal is output directionally.

15. The HMD of claim 13 , wherein the audio output control interface includes a user interface configured to convert between directional output and non-directional output, and
converts whether the audio signal is output directionally based on a user input applied to the user interface.

16. The HMD of claim 1 , wherein the processor further receives additional data corresponding to the audio signal, wherein the additional data represents whether the audio signal is output directionally.

17. The HMD of claim 1 , wherein the processor determines whether the audio signal is output directionally based on device information of the external digital device corresponding to the audio signal.

18. A method of outputting an audio signal using an HMD, the method comprising:
receiving an audio signal of at least one external digital device connected to the HMD;
determining whether to output the received audio signal directionally output signal;
detecting location information of the external digital device corresponding to the audio signal when the audio signal is a directional output signal, wherein the location information represents a relative location of the external digital device with respect to the HMD;
detecting a location state of the external digital device based on the location information, wherein the location state includes a first state in which the external digital device is located within a predetermined view angle of the HMD and a second state in which the external digital device is not located within the view angle of the HMD; and
outputting the audio signal based on the detected location information and location state of the external digital device, wherein the audio signal output includes a left channel output and a right channel output, wherein at least one of the lef

Assignees

• Lg Electronics Inc

Inventors

• Cho Eunhyung

Classifications

• H04R5/04

  Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• H04N21/4398

  involving reformatting operations of audio signals (details of audio signal transcoding G10L19/173) · CPC title

• H04N21/4622

  Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859) · CPC title

• H04R2420/07

  Applications of wireless loudspeakers or wireless microphones · CPC title