Method and System For In-Game Visualization Based on Audio Analysis

Patent metadata

Field	Value
Publication number	US-2016255455-A1
Application number	US-201615150615-A
Country	US
Kind code	A1
Filing date	May 10, 2016
Priority date	Oct 9, 2013
Publication date	Sep 1, 2016
Grant date	—

Abstract

A game headset receives a plurality of channels of game and/or chat audio during game play, monitors the plurality of channels, and detect one or more sounds on the channels during the monitoring. The game headset determines characteristics of the detected one or more sound and outputs one or more signals for generating a visual representation of the detected one or more sounds based on the determined characteristics. The game headset output the signals to a game console that provides the game play. The game console displays the visual representation during the game play based on the communicated visualization information. The one or more signals is a video stream of an in-game visualization. The game headset outputs the one or more signals to a second screen communication device that generates the visual representation during the game play based on the signals.

First claim

1 - 20 . (canceled)

21 . A method comprising:
receiving, by audio processing circuitry of a first peripheral device via a wired or wireless link to a gaming device, game audio of a game being played on the gaming device; processing, by the audio processing circuitry, the game audio to detect a plurality of sound sources; and generating, by visualization circuitry of the first peripheral device, a video signal that conveys a visual representation of the detected plurality of sound sources.

22 . The method of claim 21 , comprising transmitting, by a transmitter of the first peripheral device, the video signal to a second peripheral device.

23 . The method of claim 21 , comprising transmitting, by a transmitter of the first peripheral device, the video signal to the gaming device.

24 . The method of claim 21 , wherein the first peripheral device is a headset comprising one or more speakers and a microphone.

25 . The method of claim 21 , wherein the processing of the game audio comprises accessing a gaming sounds database that stores audio signatures.

26 . The method of claim 21 , wherein the visual representation comprises a plurality of markers corresponding to the plurality of sound sources.

27 . The method of claim 26 , wherein the plurality of markers conveys relative positions of the plurality of sound sources.

28 . The method of claim 26 , wherein the plurality of markers conveys speed and/or direction of movement of the sound sources.

29 . The method of claim 26 comprising determining, by the audio processing circuitry during the processing of the game audio, which one or more of a plurality of audio channels are carrying sounds from each of the detected plurality of sound sources.

30 . The method of claim 29 , wherein the visual representation comprises a plurality of markers corresponding to the plurality of sound sources.

31 . A system comprising:
an electronic device comprising:
audio processing circuitry operable to:
receive, via a wired or wireless link to a gaming device, game audio of a game being played on the gaming device; and
process the game audio to detect a plurality of sound sources; and

visualization circuitry operable to generate a video signal that conveys a visual representation of the detected plurality of sound sources.

32 . The system of claim 31 , wherein the electronic device comprises a transmitter operable to transmit the video signal to a second peripheral device.

33 . The system of claim 31 , wherein the electronic device comprises a transmitter operable to transmit the video signal to the gaming device.

34 . The method of claim 31 , wherein the electronic device is a headset and comprises one or more speakers and a microphone.

35 . The method of claim 31 , wherein, as part of the processing of the game audio, the audio processing circuitry is operable to access a gaming sounds database that stores audio signatures.

36 . The method of claim 31 , wherein the visual representation comprises a plurality of markers corresponding to the plurality of sound sources.

37 . The method of claim 36 , wherein the plurality of markers conveys relative positions of the plurality of sound sources.

38 . The method of claim 36 , wherein the plurality of markers conveys speed and/or direction of movement of the sound sources.

39 . The method of claim 36 wherein the audio processing circuitry is operable to, during the processing of the game audio, determine which one or more of a plurality of audio channels are carrying sounds from each of the detected plurality of sound sources.

40 . The method of claim 39 , wherein the visual representation comprises a plurality of markers corresponding to the plurality of sound sources.

Assignees

• Voyetra Turtle Beach Inc

Inventors

• Kulavik Richard
• Kuruba Buchannagari Shobha Devi

Classifications

• G10L25/51

  for comparison or discrimination · CPC title

• H04R5/04

  Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)} · CPC title

• G06F3/162

  Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs · CPC title

• H04R1/1041 Primary

  Mechanical or electronic switches, or control elements (switches in general H01H) · CPC title

• H04R1/1008

  Earpieces of the supra-aural or circum-aural type · CPC title