System and method for selecting a video encoding format based on feedback data

Patent metadata

Field	Value
Publication number	US-9781435-B2
Application number	US-201615238653-A
Country	US
Kind code	B2
Filing date	Aug 16, 2016
Priority date	Dec 10, 2002
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

Methods and systems for processing instructions by an online video game hosting system are provided. One example method includes receiving a control signal for a video game. The control signal is received by a server of the online video game hosting system, and the control signal is transmitted from a client device to the server over a network. Then, executing the online video game by the server while receiving the control signal. The executing causes generation of a sequence of video frames and encoding the sequence of video frames to generate a first compressed sequence of video frames and generate a second compressed sequence of video frames. Transmitting the first compressed sequence of video frames to the client device over the network for decoding by the client device to produce a first decoded sequence of video frames for displaying on a display of the client device. Receiving feedback information from the client device, the feedback information used to determine whether one or more of the first compressed sequence of video frames has been successfully decoded at the client device and modifying the encoding of the sequence of video frames in response to the feedback information. The second compressed sequence of video frames are directed to a storage associated with the server and wherein the quality of the second compressed sequence of video frames is higher than a quality of the first compressed sequence of video frames.

First claim

What is claimed is:

1. A computer-implemented method for processing instructions by an online video game hosting system comprising:
receiving a control signal for a video game, the control signal being received by a server of the online video game hosting system, the control signal being transmitted from a client device to the server over a network;
executing the online video game by the server while receiving the control signal, the executing causes generation of a sequence of video frames;
encoding the sequence of video frames to generate a first compressed sequence of video frames and generate a second compressed sequence of video frames;
transmitting the first compressed sequence of video frames to the client device over the network for decoding by the client device to produce a first decoded sequence of video frames for displaying on a display of the client device;
receiving feedback information from the client device, the feedback information used to determine whether one or more of the first compressed sequence of video frames has been successfully decoded at the client device;
modifying the encoding of the sequence of video frames in response to the feedback information, wherein the second compressed sequence of video frames being generated with a quality that is independent of the feedback information received from the client device for the first compressed sequence of video frames; and
directing the second compressed sequence of video frames to a storage associated with the server and wherein the quality of the second compressed sequence of video frames is higher than a quality of the first compressed sequence of video frames.

2. The method as in claim 1 further comprising:
receiving a second control signal by the server, the second control signal being from a second client device;
retrieving the second compressed sequence of video frames from the storage in response to the second control signal; and
transmitting the second compressed sequence of video frames to the second client device for decoding by the second client device to produce a second decoded sequence of video frames for display on a second display of the second client device.

3. The method as in claim 2 wherein transmitting the second compressed sequence of video frames to the second client device includes a time delay from when the first compressed sequence of video frames were transmitted to the client device.

4. The method as in claim 2 , wherein the second client device is a spectating client device.

5. The method as in claim 1 , wherein the quality of the first compressed sequence of video frames includes a first frame rate and the quality of the second compressed sequence of video frames includes a second frame rate that is greater than the first frame rate.

6. The method as in claim 1 , wherein the quality of the first compressed sequence of video frames includes a first frame resolution and the quality of the second compressed sequence of video frames includes a second frame resolution that is greater than the first frame resolution.

7. The method as in claim 1 , wherein the quality of the second compressed sequence of video frames includes a second frame resolution that is equal to a frame resolution of the generated sequence of video frames when the second compressed sequence of video frames is decoded by a second client device.

8. The method as in claim 1 , wherein the quality of the first compressed sequence of video frames includes a first frame size and the quality of the second compressed sequence of video frames includes a second frame size that is greater than the first frame size.

9. The method as in claim 1 , wherein the quality of the first compressed sequence of video frames includes a first scaling factor and the quality of the second compressed sequence of video frames includes a second scaling factor that is less than the first scaling factor.

10. A computer-implemented method for processing instructions by an online video game hosting system comprising:
receiving a first control signal for a video game, the first control signal being received by a server of the online video game hosting system, the first control signal being transmitted from a first client device to the server over a network;
executing the online video game by the server while receiving the control signal, the executing causes generation of a sequence of video frames;
encoding the sequence of video frames to generate a first compressed sequence of video frames and generate a second compressed sequence of video frames, wherein a quality of the second compressed sequence of video frames is higher than a quality of the first compressed sequence of video frames;
transmitting the first compressed sequence of video frames to the first client device over the network for decoding by the first client device to produce a first decoded sequence of video frames for displaying on a first display of the first client device;
directing the second compressed sequence of video frames to a storage associated with the server;
receiving a second control signal by the server, the second control signal being from a second client device;
retrieving the second compressed sequence of video frames from the storage in response to the second control signal; and
transmitting the second compressed sequence of video frames to the second client device for decoding by the second client device to produce a second decoded sequence of video frames for display on a second display of the second client device, wherein the second client device is a spectating client device.

11. The method as in claim 10 wherein transmitting the second compressed sequence of video frames to the second client device includes delaying transmitting the second compressed sequence of video frames to the second client device from a point in time after the first compressed sequence of video frames were transmitted to the first client device.

12. The method as in claim 10 wherein storage associated with the server is a delay buffer that is in communication with the server.

13. The method as in claim 10 further comprising detecting a data rate capacity of the network and wherein the quality of the first compressed sequence of video frames includes a first data rate less than the detected data rate capacity of the network.

14. The method as in claim 13 wherein the quality of the second compressed sequence of video frames includes a second data rate that is independent of the detected data rate capacity of the network.

15. The method as in claim 10 , wherein the quality of the first compressed sequence of video frames includes a first frame rate and the quality of the second compressed sequence of video frames includes a second frame rate that is greater than the first frame rate.

16. The method as in claim 10 , wherein the quality of the first compressed sequence of video frames includes a first frame resolution and the quality of the second compressed sequence of video frames includes a second frame resolution that is greater than the first frame resolution.

17. The method as in claim 10 , wherein the quality of the first compressed sequence of video frames includes a first frame size and the quality of the second compressed sequence of video frames includes a second frame size that is greater than the first frame size.

18. The method as in claim 10 , wherein the quality of the first compressed sequence of video frames includes a first scaling factor and the quality of the second compressed sequence of video frames includes a second scaling fac

Assignees

• Sony Interactive Entertainment America Llc

Inventors

• Perlman Stephen G
• Van Der Laan Roger
• Cotter Timothy
• Furman Scott
• Mccool Rob
• Buckley Ian

Classifications

• H04N21/6583

  Acknowledgement · CPC title

• H04N21/2381

  Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network {(transmission of MPEG streams over ATM H04L12/5601)} · CPC title

• H04N19/164 Primary

  Feedback from the receiver or from the transmission channel · CPC title

• H04N19/146

  Data rate or code amount at the encoder output · CPC title

• A63F2300/407

  Data transfer via internet · CPC title