Systems and methods for a music feature file and coordinated light show

Patent metadata

Field	Value
Publication number	US-11723136-B2
Application number	US-202017122966-A
Country	US
Kind code	B2
Filing date	Dec 15, 2020
Priority date	Dec 20, 2019
Publication date	Aug 8, 2023
Grant date	Aug 8, 2023

Abstract

Examples are disclosed for systems and methods for providing an automated light show synchronized to one or more music files. In one embodiment, a method comprises generating a music feature file based on selected audio, the music feature file comprising metadata for the selected audio including a plurality of time markers indicating audio events in the selected audio, and automatically controlling one or more lights according to the music feature file. In another embodiment, other approaches and systems are provided to improve a light show or to provide structures and processed files which can be used to improve a light show or provide other features.

First claim

The invention claimed is:

1. A method carried out by a processor, comprising:
receiving a request to perform a music show for a selected audio;
analyzing, with the processor, the selected audio;
in response to the request, determining that a music feature file for the selected analyzed audio is not available, and in response, generating, via the processor, a music feature file for the selected analyzed audio, including generating, via the processor, metadata based on the analyzed selected audio, the metadata including song events of the selected analyzed audio and trigger beats that index the song events to a timeline, and a timing for one or more lights corresponding to the trigger beats and the song events, and saving the metadata according to a music feature file protocol; and
automatically controlling the one or more lights according to the metadata in the music feature file.

2. The method of claim 1 , further comprising outputting the selected audio to one or more speakers, and synchronizing automatic control of the one or more lights according to the music feature file with output of the selected audio, wherein the selected audio is a compressed audio file.

3. The method of claim 1 , wherein automatically controlling the one or more lights according to the music feature file includes adjusting one or more of a color, a state, a beam movement, and an intensity of the one or more lights based on the metadata of the music feature file.

4. The method of claim 1 , wherein analyzing includes determining song metadata including a length, a tempo, a genre, and a plurality of song events, and wherein generating the metadata comprises generating the metadata using one or more predictive learning algorithms to determine features of the selected audio.

5. The method of claim 4 , wherein the music feature file further comprises the selected audio, wherein the music feature file comprises a plurality of discrete packets, each packet including an entirety of the metadata, and wherein as the tempo increases, more lights are activated and/or intensity of activated lights is increased.

6. The method of claim 1 , wherein the music feature file further comprises a synchronized video file, wherein the selected audio is input into one or more look-up tables, functions, or algorithms, to output the metadata.

7. The method of claim 1 , wherein the selected audio comprises an analog signal including the selected audio.

8. The method of claim 1 , further comprising receiving the selected audio from a remote streaming server, and generating the music feature file while receiving the selected audio.

9. The method of claim 1 , wherein the selected audio comprises a music file stored in a memory of a controller.

10. The method of claim 1 , further comprising receiving a position for each of the one or more lights in a light show environment, mapping the position for each of the one or more lights to a grid corresponding to the light show environment, and further adjusting control of the one or more lights based on the position mapped for the one or more lights in the grid.

11. The method of claim 10 , wherein the position for each of the one or more lights in the light show environment is determined based on a signal from a motion sensing device.

12. The method of claim 11 , wherein the motion sensing device is a mobile phone including BLUETOOTH.

13. The method of claim 11 , wherein the motion sensing device is a mobile phone including a plurality of sensors.

14. A light show system, comprising:
a plurality of lights; and
a controller communicatively coupled to the plurality of lights and configured with instructions stored in non-transitory memory that when executed by a processor of the controller cause the controller to:
responsive to determining that a music feature file for a selected audio file is not available, generate a music feature file for the selected audio file, the music feature file generated based on the selected audio file, the music feature file comprising metadata for the selected audio file including a plurality of time markers indicating audio events in the selected audio file, the metadata including song events and trigger beats that index song events of the selected audio file to a timeline, and a timing for one or more lights corresponding to the trigger beats and the song events, the music feature file being a file protocol, and
control one or more lights of the plurality of lights based on the music feature file,

wherein the plurality of lights is distributed throughout a light show environment, and wherein the controller is further configured with instructions that when executed cause the controller to:
receive a position of each light of the plurality of lights within the light show environment;
map the position of each light to a virtual grid corresponding to the light show environment; and
adjust control of the one or more lights based on the music feature file and the mapped position of each light in the virtual grid, wherein the position of each light of the plurality of lights within the light show environment is determined based on a signal from a motion sensing device, the motion sensing device including a plurality of sensors, including to modify a sequence of adjustments to lights according to relative locations of the lights, including to adjust a light based on its location relative to one or more cells in the virtual grid.

15. The system of claim 14 , further comprising one or more speakers communicatively coupled to the controller, wherein the controller is further configured with instructions that when executed cause the controller to output the selected audio to the one or more speakers while controlling the one or more lights of the plurality of lights based on the music feature file for the selected audio file.

16. The system of claim 14 , wherein the selected audio file is a first audio file, and wherein the controller is further configured with instructions that when executed cause the controller to:
receive a second selected audio file;
retrieve a second music feature file for the second selected audio file; and
control one or more of the plurality of lights based on the second music feature file while outputting the second selected audio file to the one or more speakers.

17. The system of claim 16 , wherein the controller is further configured with instructions that when executed cause the controller to control one or more of the plurality of lights based on the music feature file and the second music feature file while transitioning between outputting the first selected audio file and the second selected audio file to the one or more speakers.

18. A system, comprising:
a plurality of lights and a plurality of speakers arranged in a light show environment; and
a controller with computer-readable instructions stored on non-transitory memory thereof that when executed enable the controller to:
generate, in real-time, a music feature file including metadata in real-time, based on streaming audio data received in real-time from a device, wherein the metadata comprises one or more of a plurality of song events, a timing, a plurality of trigger beats, a genre, a time signature, a number of beats per minute, and a musical key of the streaming audio data, where the music feature file is generated as the streaming audio data is received;
signal to the plurality of lights to adjust one or more of a color, an intensity, a pulsation, and a brightness based on the metadata; and
signal to the plurality of speakers to play audio base

Assignees

• Harman Professional Denmark Aps

Inventors

• Rasmussen Niels Joergen
• Hansen Claus Ellevang

Classifications

• H05B47/12 Primary

  by detecting audible sound · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G10L25/51

  for comparison or discrimination · CPC title

• H04R1/403

  loud-speakers · CPC title

• H04R3/12

  for distributing signals to two or more loudspeakers {(specially adapted for hearing aids H04R25/407)} · CPC title