Systems and methods for electronic game control with voice detection and audio stream processing

Patent metadata

Field	Value
Publication number	US-12589294-B2
Application number	US-202318540837-A
Country	US
Kind code	B2
Filing date	Dec 14, 2023
Priority date	Dec 14, 2023
Publication date	Mar 31, 2026
Grant date	Mar 31, 2026

Abstract

System, process, and device configurations are provided for electronic game control with voice detection and audio stream processing. A method can include controlling presentation of electronic game content on a display, receiving an audio input stream including voice data for at least one user of the electronic game and detecting at least one command for the electronic game content presentation based on the at least one user voice. The method can also include controlling presentation for the electronic game content based on voice command. In addition, configurations are provided for training a machine model for identification of a user voice, spatial identification of user position, and filtering of audio input streams to determine a plurality of user commands in parallel. Processes may be used to characterize human voice using models and to detect users in a group. User voice may be a control input in addition to game controller inputs.

First claim

What is claimed is:

1 . A method for electronic game control with voice detection and audio stream processing, the method comprising:
controlling, by a device, presentation of electronic game content on a display; receiving, by the device, an audio input stream, the audio input stream including voice data for at least one user of the electronic game; detecting, by the device, at least one user voice in the audio input stream; detecting, by the device, at least one command for the electronic game content presentation based on the voice data; controlling, by the device, presentation for the electronic game content based on the at least one command; and outputting a separated voice transcript for the audio input stream.

2 . The method of claim 1 , wherein the audio input stream is detected by at least one sensor during presentation of the electronic game content, and wherein voice data of a plurality users is detected in parallel.

3 . The method of claim 1 , wherein the audio input stream is detected for a plurality of users by at least one audio input sensor of the device.

4 . The method of claim 1 , wherein the audio input stream is detected by a microphone array sensor of the device, and wherein detection of voice data includes detection of user position relative to the microphone array.

5 . The method of claim 1 , wherein detecting at least one user voice in the audio input stream includes using at least one voice reference of a user profile.

6 . The method of claim 1 , wherein detecting at least one user voice in the audio input stream includes using a machine model for identification of a user voice.

7 . The method of claim 1 , wherein detecting at least one command for the electronic game content includes spatial identification of user position.

8 . The method of claim 1 , wherein detecting at least one command for the electronic game content includes detecting a control command for at least one game element of the electronic game.

9 . The method of claim 1 , wherein detecting at least one command for the electronic game content includes filtering at least one voice input for detection of the at least one command.

10 . A device configured for electronic game control with voice detection and audio stream processing, the device comprising:
an interface configured to output gaming content; a memory storing executable instructions; and a controller coupled to the interface and the memory, wherein the controller is configured to perform operations comprising:
controlling presentation of electronic game content on a display;
receiving an audio input stream, the audio input stream including voice data for at least one user of the electronic game;
detecting at least one user voice in the audio input stream;
detecting at least one command for the electronic game content presentation based on the voice data;
controlling presentation for the electronic game content based on the at least one command; and
outputting a separated voice transcript for the audio input stream.

11 . The device of claim 10 , wherein the audio input stream is detected by at least one sensor during presentation of the electronic game content, and wherein voice data of a plurality of users is detected in parallel.

12 . The device of claim 10 , wherein the audio input stream is detected for a plurality of users by at least one audio input sensor of the device.

13 . The device of claim 10 , wherein the audio input stream is detected by a microphone array sensor of the device, and wherein detection of voice data includes detection of user position relative to the microphone array.

14 . The device of claim 10 , wherein detecting at least one user voice in the audio input stream includes using at least one voice reference of a user profile.

15 . The device of claim 10 , wherein detecting at least one user voice in the audio input stream includes using a machine model for identification of a user voice.

16 . The device of claim 10 , wherein detecting at least one command for the electronic game content includes spatial identification of user position.

17 . The device of claim 10 , wherein detecting at least one command for the electronic game content includes detecting a control command for at least one game element of the electronic game.

18 . The device of claim 10 , wherein detecting at least one command for the electronic game content includes filtering at least one voice input for detection of the at least one command.

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Black Glenn
• Rajenthiran Murugan

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• A63F13/21

  characterised by their sensors, purposes or types · CPC title

• A63F2300/1081

  Input via voice recognition · CPC title

• A63F13/79

  involving player-related data, e.g. identities, accounts, preferences or play histories · CPC title

• A63F13/424 Primary

  involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition · CPC title