Processing of multiple media streams

Patent metadata

Field	Value
Publication number	US-10848790-B2
Application number	US-201916554196-A
Country	US
Kind code	B2
Filing date	Aug 28, 2019
Priority date	Dec 4, 2015
Publication date	Nov 24, 2020
Grant date	Nov 24, 2020

Abstract

A system includes a media studio including a processor and a memory. The memory stores instructions executable by the processor. The processor is programmed to receive data indicating a type of event to be recorded, receive one or more media input items from one or more respective media devices, and generate a media output item based at least in part on the one or more received media input items, and further based at least in part on the data indicating the type of event to be recorded and one or more respective locations of the one or more respective media devices.

First claim

The invention claimed is:

1. A method for generating a media output item from a plurality of media input, the method comprising:
receiving a plurality of media input items each from a respective one of a plurality of media devices, each media device having a respective one or more sensors to capture an excitement level of a respective user of the media device, such that each media input item comprises a respective excitement measurement indicating the excitement level of the respective user of the respective media device during capture of the media input item;
generating an aggregated media item automatically by combining two or more of the media input items to be displayed simultaneously within the aggregated media item;
displaying the aggregated media item in an operator console;
generating a media output item by selecting a particular one of the plurality of media input items for display in the media output item based on the respective excitement measurement for the particular one of the plurality of media input items, each media device being associated with a respective overall correction coefficient, the selecting including normalizing the respective excitement measurements based on the respective overall correction coefficients; and
outputting the media output item.

2. The method of claim 1 , wherein:
the generating the aggregated media item comprises time-synchronizing the two or more of the media input items.

3. The method of claim 1 , wherein, for each media device:
each of the one or more sensors of the media device is associated with a respective specific correction coefficient; and
the respective overall correction coefficient for the media device is based on the respective specific correction coefficients of the one or more sensors.

4. The method of claim 1 , further comprising:
receiving one or more commands from an operator via a graphical user interface of the operator console responsive to the displaying,
wherein the generating the media output item is further based on the one or more commands.

5. The method of claim 4 , further comprising:
displaying a graphical indication via the graphical user interface to recommend to the operator the particular one of the plurality of media input items,
wherein the one or more commands indicate a selection by the operator of the particular one of the plurality of media input items responsive to the graphical indication.

6. The method of claim 1 , further comprising:
transmitting the aggregated media item via a network to the operator console prior to the displaying,
wherein the receiving, the generating the aggregated media item, and the transmitting are performed by a first computational system, and the operator console is implemented on a second computational system communicatively coupled with the first computational system over the network.

7. The method of claim 6 , further comprising:
compressing the aggregated media item prior to the transmitting via the network.

8. The method of claim 1 , wherein:
the generating the media output item is further by performing video and/or audio processing operations on the particular one of the plurality of media input items.

9. The method of claim 1 , wherein each respective excitement measurement is derived from at least one biometric measurement of the respective user.

10. A system comprising a media studio including one or more processors and one or more memories, the one or more memories storing instructions executable by the one or more processors such that the one or more processors are programmed to:
receive a plurality of media input items each from a respective one of a plurality of media devices, each media device having a respective one or more sensors to capture an excitement level of a respective user of the media device, such that each media input item comprises a respective excitement measurement indicating the excitement level of the respective user of the respective media device during capture of the media input item;
generate an aggregated media item automatically by combining two or more of the media input items to be displayed simultaneously within the aggregated media item;
display the aggregated media item in an operator console; and
generate a media output item by selecting a particular one of the plurality of media input items for display in the media output item based on the respective excitement measurement for the particular one of the plurality of media input items, each media device being associated with a respective overall correction coefficient, the selecting including normalizing the respective excitement measurements based on the respective overall correction coefficients.

11. The system of claim 10 , wherein the one or more processors are further programmed to output the media output item.

12. The system of claim 10 , wherein the one or more processors are programmed to generate the aggregated media item by time-synchronizing the two or more of the media input items.

13. The system of claim 10 , wherein, for each media device:
each of the one or more sensors of the media device is associated with a respective specific correction coefficient; and
the respective overall correction coefficient for the media device is based on the respective specific correction coefficients of the one or more sensors.

14. The system of claim 10 , wherein the one or more processors are programmed further to:
receive one or more commands from an operator via a graphical user interface of the operator console responsive to the displaying,
wherein the one or more processors are programmed to generate the media output item is further based on the one or more commands.

15. The system of claim 14 , wherein the one or more processors are programmed further to:
display a graphical indication via the graphical user interface to recommend to the operator the particular one of the plurality of media input items,
wherein the one or more commands indicate a selection by the operator of the particular one of the plurality of media input items responsive to the graphical indication.

16. The system of claim 10 , wherein:
the one or more memories comprise a first memory and a second memory;
the one or more processors comprise at least: a first processor disposed in a first computational system and coupled with the first memory, and a second processor disposed in a second computational system and coupled with the second memory;
the first memory has, stored thereon, a first portion of the instructions executable by the one or more processors, such that the first processor is programmed to receive the plurality of media input items and to generate the aggregated media item, and such that the first processor is further programmed to transmit the aggregated media item via a network to the second processor; and
the second memory has, stored thereon, a second portion of the instructions executable by the one or more processors, such that the second processor is programmed to display the aggregated media item responsive to receiving the aggregated media item from the first processor via the network.

17. The system of claim 10 , wherein the one or more processors are programmed to generate the media output item further by performing video and/or audio processing operations on the particular one of the plurality of media input items.

18. The system of claim 10 , wherein each respective excitement measurement is derived from at least one biometric measurement of the respective user.

Assignees

• Sling Media LLC

Inventors

• Abramov Andrey
• Dimov Dmitry
• Lee Chih Jen Ken
• Vurimi Naga Venkata Gnana Meherkanth
• Yegorov Oleksandr

Classifications

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• G11B27/28

  by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} · CPC title

• H04N5/222

  Studio circuitry; Studio devices; Studio equipment (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00) · CPC title

• H04N21/21805

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• H04N21/42201

  biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015) · CPC title