Independent control of interactive streaming media

Patent metadata

Field	Value
Publication number	US-10135892-B2
Application number	US-201514810994-A
Country	US
Kind code	B2
Filing date	Jul 28, 2015
Priority date	Jul 28, 2015
Publication date	Nov 20, 2018
Grant date	Nov 20, 2018

Abstract

In one general aspect, a method can include receiving, at a server computing device, a launch request to launch and stream media content pertaining to a game session, the launch request being provided by a mobile device, selecting, using the launch request, a media host configured to stream the media content, verifying a user associated with the mobile device and launching the game session for streaming to the user on a device other than the mobile device. In addition, the method can include during the game session and while streaming the media content, receiving a plurality of real time control requests from the mobile device, and executing the control request by compositing, in real time, the at least one change and the media content and to produce a composite display and transmitting, to the device other than the mobile device, the encoded composite display for streaming in real time.

First claim

What is claimed is:

1. A method of controlling interactive streaming media, the method comprising:
receiving, at a server computing device from a mobile device, a launch request to initiate a game session between the mobile device and the server computing device and to launch and stream media content pertaining to a game session from the server computing device;
selecting, at the server computing device and using the launch request, a media host configured to stream the media content;
verifying a user associated with the mobile device and triggering launch of the game session for streaming media content to the user on a device other than the mobile device;
during the game session and while streaming the media content:
receiving, at the server computing device and from the mobile device, a plurality of real time control requests configured to generate at least one change in the media content, the plurality of real time control requests being transmitted remotely from a controller device to the mobile device; and
upon receiving each control request at the server computing device and from the mobile device:
executing the control request by modifying the media content in real time, the modifying including performing the at least one change on the media content to produce a composite display of the media content and the at least one change,
encoding the composite display for transmission to the device other than the mobile device, and
transmitting, to the device other than the mobile device, the encoded composite display for streaming in real time.

2. The method of claim 1 , wherein the device other than the mobile device comprises a media player coupled to a display device for presenting streaming media.

3. The method of claim 1 , wherein the controller device comprises at least one of a gamepad, a keyboard, a mouse, a game controller, a joystick, a touch screen, a dance pad, and a steering wheel.

4. The method of claim 1 , wherein the composite display represents a streaming video of the at least one change as the change is executed to the streaming media.

5. The method of claim 1 , wherein the plurality of real time control requests comprise instructions to modify streaming media content using input received from the user associated with the mobile device, and wherein the input originated at the controller device coupled to the mobile device, the mobile device being configured to interpret the input and manage communication of the input to the server computing device.

6. The method of claim 5 , wherein the input comprises a partial turn of a radial dial on the controller device and the server computing device interprets the partial turn as a scaled back portion of movement toward a direction associated with the partial turn of the radial dial, and the change to the media content comprises displaying, in the streaming media content, a representation of a character in the media content performing a shallow turn within the media content.

7. The method of claim 5 , wherein the input comprises a fast swipe on the controller device and the server computing device interprets the fast swipe as an increased speed for carrying out the change to the media content.

8. The method of claim 1 , wherein selecting a media host configured to stream the media content is based on a geographic location associated with the user of the mobile device.

9. The method of claim 1 , further comprising upon launching the game session, mapping the game session to a virtual machine associated with content storage for the mobile device, the game session configured to allow communication between the mobile device and the server computing system.

10. The method of claim 1 , wherein a portion of the plurality of real time control requests comprise:
at least two requests to modify content in the streaming media, each request comprising redundant information identified by a sequence identifier, the redundant information including a fixed number of sets of packets per received real time control request; and
an access port identifier identifying a user datagram protocol input port configured to relay user input between the server computing device and the mobile device.

11. The method of claim 10 , wherein the redundant information comprises 15 to 20 sets of packets for each real time control request.

12. A system comprising:
a media player including audio video streaming circuitry, the media player coupled to a network and a display device and configured to receive streaming content;
a mobile device configured to:
determine proximity to a controller and to wirelessly connect to the controller;
receive a list of a plurality of content server computing devices that stream content and select at least one content server computing device to host a streaming session;
establish a streaming session with the at least one content server computing device;
receive input initiated by and transmitted remotely from the controller, the input including instructions to control the content provided by the at least one content server computing device; and
relay, to the at least one content server computing device, a representation of the input initiated at the controller, wherein the representation of the input is generated by the mobile device and includes a plurality of redundant packets that include at least one command to control the content provided by the at least one content server computing device.

13. The system of claim 12 , wherein the plurality of redundant packets comprises 15 to 20 sets of packets for each input.

14. The system of claim 12 , wherein the controller comprises at least one of a gamepad, a keyboard, a mouse, a game controller, a joystick, a touch screen, a dance pad, and a steering wheel.

15. A computer program product tangibly embodied on a non-transitory computer-readable medium and comprising instructions that, when executed, are configured to cause at least one processor to:
receive, at a server computing device and from a mobile device, a launch request to initiate a game session between the mobile device and the server computing device and to launch and stream media content pertaining to a game session from the server computing device;
select, at the server computing device and using the launch request, a media host configured to stream the media content;
verify a user associated with the mobile device and triggering launch of the game session for streaming media content to the user on a device other than the mobile device;
during the game session and while streaming the media content:
receive, at the server computing device and from the mobile device, a plurality of real time control requests configured to generate at least one change in the media content, the plurality of real time control requests being transmitted remotely from a controller device to the mobile device; and
upon receiving each control request at the server computing device and from the mobile device:
executing the control request by modifying the media content in real time, the modifying including performing the at least one change on the media content to produce a composite display of the media content and the at least one change,
encoding the composite display for transmission to the device other than the mobile device, and
transmitting, to the device other than the mobile device, the encoded composite display for streaming in real time.

16. The computer program product of claim 15 , wherein the device other than the mobile device comprises a media player coupled to a display device for presenting streaming media.

Assignees

• Google Inc
• Google Llc

Inventors

• Zimring Dov Shimon
• Nadaff Ali
• Sundermeyer Michael Jon
• Chandra Rishi
• Affaki John
• Walter Sarah
• Mccool Rob
• Bakar Majd

Classifications

• H04L29/06034

  Electricity · mapped topic

• A63F13/79

  involving player-related data, e.g. identities, accounts, preferences or play histories · CPC title

• A63F13/355

  Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client · CPC title

• H04L65/4084 Primary

  Electricity · mapped topic

• A63F13/352 Primary

  involving special game server arrangements, e.g. regional servers connected to a national server or a plurality of servers managing partitions of the game world · CPC title