Overriding multimedia device

Patent metadata

Field	Value
Publication number	US-11523189-B1
Application number	US-202117337063-A
Country	US
Kind code	B1
Filing date	Jun 2, 2021
Priority date	Jun 2, 2021
Publication date	Dec 6, 2022
Grant date	Dec 6, 2022

Abstract

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for switching the output of an overriding multimedia device from a first input to a second input or a combination of the first input and the second input. An example embodiment operates by receiving sensor data detected by a sensing device and relating to a multimedia switching event. The example embodiment further operates by determining that sensor data detected by a sensing device corresponds to a multimedia switching action. In response, the example embodiment operates by generating a multimedia switching actuation signal that instructs an overriding multimedia device to switch its output from the first multimedia signal to the second multimedia signal. Subsequently, the example embodiment operates by transmitting the multimedia switching actuation signal to the overriding multimedia device.

First claim

What is claimed is:

1. An apparatus, comprising:
a memory configured to store priority multimedia input data comprising a first priority value for a first multimedia signal and a second priority value for a second multimedia signal, wherein the first multimedia signal comprises content received from one or more content servers and the second multimedia signal comprises a videoconferencing signal; and
at least one processor coupled to the memory and configured to:
receive sensor data detected by a sensing device and relating to a multimedia switching event;
determine that the sensor data corresponds to a multimedia switching action comprising a videoconferencing initiation action based on a first determination that the sensor data has caused the second priority value to increase above the first priority value; and
in response to a second determination that the sensor data corresponds to the multimedia switching action,
generate a multimedia switching actuation signal configured to instruct an overriding multimedia device to switch an output of the overriding multimedia device from the first multimedia signal to the second multimedia signal, and
transmit the multimedia switching actuation signal to the overriding multimedia device.

2. The apparatus of claim 1 , wherein the multimedia switching actuation signal is a High-Definition Multimedia Interface (HDMI) switching actuation signal.

3. The apparatus of claim 1 , wherein the second multimedia signal comprises a combination of the first multimedia signal and a third multimedia signal.

4. The apparatus of claim 1 , wherein the sensor data comprises an audio signal.

5. The apparatus of claim 4 , wherein:
the audio signal comprises a voice command comprising a wake command and an action command; and
the at least one processor is further configured to:
detect the wake command; and
in response to a detection of the wake command,
determine, based on the priority multimedia input data, that the action command corresponds to the multimedia switching action.

6. The apparatus of claim 4 , wherein:
the at least one processor is further configured to:
classify the audio signal as a classified alert initiation action using an audio signal classifier machine learning model trained by a process comprising:
generating a probability value that the audio signal corresponds to an alert initiation action,
determining that the probability value satisfies an alert initiation action threshold value, and
generating the classified alert initiation action based on the determining that the probability value satisfies an alert initiation action threshold value; and

in response to a classification of the audio signal as the classified alert initiation action,
determine, based on the priority multimedia input data, that the classified alert initiation action corresponds to the multimedia switching action.

7. The apparatus of claim 1 , wherein the multimedia switching actuation signal is further configured to instruct an overriding multimedia device to terminate a display of the first multimedia signal.

8. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
receiving sensor data detected by a sensing device and relating to a multimedia switching event;
determining that the sensor data corresponds to a multimedia switching action comprising a videoconferencing initiation action by determining that the sensor data has caused a first priority value for a first multimedia signal to decrease below a second priority value for a second multimedia signal, wherein the first multimedia signal comprises content received from one or more content servers and the second multimedia signal comprises a videoconferencing signal; and
in response to the determining that the sensor data corresponds to the multimedia switching action,
generating a multimedia switching actuation signal that instructs an overriding multimedia device to switch an output of the overriding multimedia device from the first multimedia signal to the second multimedia signal; and
transmitting the multimedia switching actuation signal to the overriding multimedia device.

9. The non-transitory computer-readable medium of claim 8 , wherein the multimedia switching actuation signal is a High-Definition Multimedia Interface (HDMI) switching actuation signal.

10. The non-transitory computer-readable medium of claim 8 , wherein the second multimedia signal comprises a combination of the first multimedia signal and a third multimedia signal.

11. The non-transitory computer-readable medium of claim 8 , wherein:
the sensor data comprises a voice command comprising a wake command and an action command; and
the operations further comprise:
detecting the wake command; and
in response to the detecting the wake command,
determining, based on the priority multimedia input data, that the action command corresponds to the multimedia switching action.

12. The non-transitory computer-readable medium of claim 8 , wherein:
the sensor data comprises an audio signal; and
the operations further comprise:
classifying the audio signal as a classified alert initiation action using an audio signal classifier machine learning model trained by a process comprising:
generating a probability value that the audio signal corresponds to an alert initiation action,
determining that the probability value satisfies an alert initiation action threshold value, and
generating the classified alert initiation action based on the determining that the probability value satisfies an alert initiation action threshold value; and

in response to the classifying the audio signal as the classified alert initiation action,
determining, based on the priority multimedia input data, that the classified alert initiation action corresponds to the multimedia switching action.

13. A computer-implemented method, comprising:
receiving, by at least one processor, sensor data detected by a sensing device and relating to a multimedia switching event;
determining, by the at least one processor, that the sensor data corresponds to a multimedia switching action comprising a videoconferencing initiation action by determining that the sensor data has caused a first priority value for a first multimedia signal to decrease below a second priority value for a second multimedia signal, wherein the first multimedia signal comprises content received from one or more content servers and the second multimedia signal comprises a videoconferencing signal; and
in response to the determining that the sensor data corresponds to the multimedia switching action,
generating, by the at least one processor, a multimedia switching actuation signal that instructs an overriding multimedia device to switch an output of the overriding multimedia device from the first multimedia signal to the second multimedia signal, and
transmitting, by the at least one processor, the multimedia switching actuation signal to the overriding multimedia device.

14. The computer-implemented method of claim 13 , wherein the multimedia switching actuation signal is a High-Definition Multimedia Interface (HDMI) switching actuation signal.

15. The computer-implemented method of claim 13 , wherein the second multimedia signal comprises a combination of the first multimedia signal and a third multimedia signal.

16. The computer-implemented method of claim 13 , wherein:
the sensor data comprises a voice command comprising

Assignees

• Roku Inc

Inventors

• Riepling Eric Casten

Classifications

• H04N21/42222

  Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device · CPC title

• G06N20/00

  Machine learning · CPC title

• H04N21/4436

  Power management, e.g. shutting down unused components of the receiver (power management in computer systems G06F1/3203; hibernate or awake process in computer systems G06F9/4418) · CPC title

• H04N21/42203

  sound input device, e.g. microphone · CPC title

• H04N21/43635

  HDMI · CPC title