Latency-dependent cloud input channel management

Patent metadata

Field	Value
Publication number	US-RE49277-E
Application number	US-202016953163-A
Country	US
Kind code	E1
Filing date	Nov 19, 2020
Priority date	Mar 6, 2015
Publication date	Nov 1, 2022
Grant date	Nov 1, 2022

Abstract

Aspects of the present disclosure relate to systems and methods for establishing an assistance output that takes into account client device latency information and sending the assistance output from the server to the client device. Client device information or the assistance output may include a stream of encrypted data packets.

First claim

What is claimed is:

1. In a server configured to operate on a network, a method, comprising:
receiving client device information from a client device with the server via a network connection, wherein the client device information includes client latency data;
determining an assistance output that takes into account the client latency data including generating an assistance output based on data that includes a measurement of time between user inputs generated at a client device, wherein determining the assistance output includes utilizing the input time measurements wherein the assistance output utilizes the measurement of time between user inputs to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein determining the assistance output comprises at least choosing the appropriate assistance output based on client latency data, wherein the assistance output is configured to alter a modality of user experience with the client device; and
sending the assistance output from the server to the client device, wherein the assistance output allows the user to overcome the effects of latency.

2. The method of claim 1 , wherein the assistance output contains a signal that triggers execution of assistance instructions already loaded on the client device.

3. The method of claim 1 , wherein the assistance output contains instructions to be executed on the client device.

4. The method of claim 2 3, wherein the instructions are scripts.

5. The method of claim 3 4, wherein the scripts are configured to aid the user in the completion of a task.

6. The method of claim 1 , wherein the modality is altered by allowing more time for user input.

7. The method of claim 1 , wherein the modality is altered by reducing a difficulty level of an artificial intelligence asset engaging the user.

8. The method of claim 1 , wherein the modality is altered by presenting a different scene to the user.

9. The method of claim 1 , wherein the client device information or the assistance output includes a stream of encrypted data packets.

10. The method of claim 9 , wherein each data packet in the stream of encrypted data packets includes a header that indicates a place in a decryption order for the packet.

11. The method of claim 10 , further comprising using the decryption order of the encrypted packets to reassemble the data stream with the server when the packets are received out of order.

12. The method of claim 9 , wherein the stream of data packets is sent via an unreliable protocol.

13. The method of claim 12 , wherein the unreliable protocol is User Datagram Protocol (UDP).

14. A system comprising:
a processor, and
a memory coupled to the processor;

wherein the processor is configured to perform a method, the method comprising:
receiving client device information from a client device with a server via a network connection, wherein the client device information includes client latency data;
determining an assistance output that takes into account the client latency data, wherein determining the assistance output comprises at least choosing the appropriate generating an assistance output based on client latency data including that includes a measurement of time between user inputs generated at a client device, wherein determining the assistance output includes utilizing utilizes the input time measurements measurement of time between user inputs to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and

sending the assistance output from the server to the client device, wherein the assistance output allows the user to overcome the effects of latency.

15. The system of claim 14 , wherein the client device information or the assistance output includes a stream of encrypted data packets.

16. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method, the method comprising:
receiving client device information from a client device with a server via a network connection, wherein the client device information includes client latency data
determining an assistance output that takes into account the client latency data, wherein determining the assistance output comprises at least choosing the appropriate assistance output based on client latency data includinggenerating an assistance output based client latency data that includes a measurement of time between user inputs, wherein determining the assistance output includes utilizingwherein the assistance output utilizes the input time measurementsmeasurement of time between user inputs to implement the inputs with the server using the same input time measurementsdifferences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and
sending the assistance output from the server to the client device, wherein the assistance output allows the user to overcome the effects of latency.

17. The non-transitory computer readable medium of claim 16 , wherein the client device information or the assistance output includes a stream of encrypted data packets.

18. A method comprising:
sending client device information from a client device to a server via a network connection, wherein the client device information includes client latency data a measurement of time between user inputs;
receiving an assistance output from the server, wherein the assistance output takes into account the client latency data including a measurement of time between user inputs, wherein the assistance output is chosen based at least on the client latency data, wherein choosing the assistance output includes utilizing utilizes the input time measurements measurement of time between user to implement the inputs with the server using the same input time measurements differences with which the inputs were generated at the client device, wherein the assistance output is configured to alter a modality of user experience with the client device; and

implementing assistance corresponding to the assistance output with the client device, wherein the assistance output allows the user to overcome the effects of latency.

19. The method of claim 18 , wherein the assistance output contains a signal that triggers execution of assistance instructions already loaded on the client device.

20. The method of claim 18 , wherein the assistance output contains instructions to be executed on the client device.

21. The method of claim 19 20, wherein the instructions are scripts.

22. The method of claim 20 21, wherein the scripts are configured to aid the user in the completion of a task.

23. The method of claim 18 , wherein the modality is altered by allowing more time for user input.

24. The method of claim 18 , wherein the modality is altered by reducing a difficulty level of an artificial intelligence asset engaging the user.

25. The method of claim 18 , wherein the modality is altered by presenting a different scene to the user.

26. The method of claim 18 , wherein the client devic

Assignees

• Sony Interactive Entertainment LLC

Inventors

• Yong Kelvin
• Cotta Bryan

Classifications

• H04L65/80

  Responding to QoS · CPC title

• H04L65/61 Primary

  for supporting one-way streaming services, e.g. Internet radio · CPC title

• H04L69/08

  Protocols for interworking; Protocol conversion · CPC title

• H04L63/0428

  wherein the data content is protected, e.g. by encrypting or encapsulating the payload · CPC title

• H04L43/087 Primary

  Jitter · CPC title