Graphical instruction data processing method and apparatus, and system

Patent metadata

Field	Value
Publication number	US-2018213232-A1
Application number	US-201815926547-A
Country	US
Kind code	A1
Filing date	Mar 20, 2018
Priority date	Jan 29, 2016
Publication date	Jul 26, 2018
Grant date	—

Abstract

A graphical instruction data processing method and apparatus, and a system are disclosed, to help reduce a quantity of transmitted graphical instruction data, and lower a requirement on bandwidth. Aspects of the disclosure provide a method for processing graphical instruction data. The method includes obtaining, by a server device in a cloud interactive system, graphical instruction data of a frame, and determining whether the frame satisfies a key frame setting condition. Further, the method includes when the frame is determined to fail to satisfy the key frame setting condition, comparing the graphical instruction data of the frame with graphical instruction data of a current key frame, to obtain differential data, and sending the differential data to user equipment in the cloud interactive system. The user equipment reconstructs the graphical instruction data of the frame according to the current key frame and the differential data.

First claim

What is claimed is:

1 . A method for processing graphical instruction data, comprising:
obtaining, by processing circuitry of a server device that interacts with user equipment in an interactive system, graphical instruction data of a frame; determining whether the frame satisfies a key frame setting condition; when the frame is determined to fail to satisfy the key frame setting condition, comparing the graphical instruction data of the frame with graphical instruction data of a current key frame, to obtain differential data; and sending the differential data to the user equipment, the user equipment reconstructing the graphical instruction data of the frame according to the current key frame and the differential data.

2 . The method according to claim 1 , wherein after the determining whether the frame satisfies the key frame setting condition, the method further comprises:
when the frame is determined to satisfy the key frame setting condition, recording the frame as a new current key frame; and sending the graphical instruction data of the frame to the user equipment.

3 . The method according to claim 1 , wherein the determining whether the frame satisfies the key frame setting condition comprises:
calculating a difference between the frame and the current key frame; and determining, according to whether the difference is out of a threshold range, whether the frame satisfies the key frame setting condition.

4 . The method according to claim 1 , further comprising:
after obtaining the differential data, compressing the differential data, and sending the compressed differential data to the user equipment.

5 . The method according to claim 1 , further comprising:
capturing a drawing operation of a graphical interface for the frame; generating graphical instruction data based on the drawing operation; placing the graphical instruction data into a processing queue; and obtaining the graphical instruction data of the frame from the processing queue.

6 . The method according to claim 1 , wherein the comparing the graphical instruction data of the frame with the graphical instruction data of the current key frame to obtain the differential data further comprises:
determining an optimal matching length and an offset location of the frame to the current key frame; and including the optimal matching length and the offset location in the differential data.

7 . The method according to claim 1 , further comprising:
obtaining, by a first thread, the graphical instruction data of the frame; and comparing, by a second thread, the graphical instruction data of the frame with the graphical instruction data of the current key frame to obtain the differential data.

8 . The method according to claim 7 , further comprising:
sending, by a third thread that is a background thread, the differential data.

9 . A method for graphical instruction data processing, comprising:
receiving, by processing circuitry of user equipment that interacts with a server device in an interactive system, data of a frame that is sent by the server device; determining whether the frame is a key frame; when the frame is determined not to be a key frame, obtaining a current key frame; determining that the data of the frame is differential data between the frame and the current key frame; and obtaining graphical instruction data of the frame according to the data of the frame and the current key frame.

10 . The method according to claim 9 , wherein after identifying whether the frame is the key frame, the method further comprises:
when the frame is determined to be the key frame, determining that the data of the frame is the graphical instruction data of the frame; and recording the frame as a current key frame.

11 . The method according to claim 9 , further comprising:
processing the graphical instruction data of the frame, to generate a graphical interface of the frame.

12 . The method according to claim 9 , wherein the data of the frame is compressed data, and the method further comprises:
after receiving the compressed data of the frame that is sent by the server device, decompressing the compressed data.

13 . The method according to claim 9 , further comprising:
receiving an optimal matching length and an offset location in the differential data; and recovering the graphical instruction data of the frame according to the current key frame, the optical matching length and the offset location.

14 . The method according to claim 9 , wherein the identifying whether the frame is the key frame further comprises:
detecting whether the data of the frame includes a specific flag that is used to indicate the key frame.

15 . An apparatus, comprising:
interface circuitry configured to receive data of a frame that is sent by a server device that interacts with the apparatus in an interactive system; and processing circuitry configured to:
determine whether the frame is a key frame;
when the frame is determined not to be a key frame, obtain a current key frame;
determine that the data of the frame is differential data between the frame and the current key frame; and
obtain graphical instruction data of the frame according to the data of the frame and the current key frame.

16 . The apparatus according to claim 15 , wherein the processing circuitry is configured to:
when the frame is determined to be the key frame, determine that the data of the frame is the graphical instruction data of the frame; and record the frame as a current key frame.

17 . The apparatus according to claim 15 , wherein the processing circuitry is configured to:
process the graphical instruction data of the frame, to generate a graphical interface of the frame via a display screen.

18 . The apparatus according to claim 15 , wherein
the interface circuitry is configured to receive compressed data in the data of the frame; and the processing circuitry is configured to decompress the compressed data.

19 . The apparatus according to claim 15 , wherein
the interface circuitry is configured to receive an optimal matching length and an offset location in the differential data; and the processing circuitry is configured to recover the graphical instruction data of the frame according to the current key frame, the optical matching length and the offset location.

20 . The apparatus according to claim 15 , wherein the processing circuitry is configured to
detect whether the data of the frame includes a specific flag that is used to indicate the key frame.

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Du Xingge
• Nie Zhiming
• Li Congbing
• Ai Feng
• GU Yu
• Wang Yangjun
• Cao Wensheng
• Ye Jinfeng
• Wang Weiguang
• Han Xiang
• Cheng Dongzhe
• Chen Guole
• Zhou Henan
• Zhuang Zhiwei
• Shen Chao

Classifications

• G06F9/543 Primary

  User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE] · CPC title

• G06F9/54

  Interprogram communication · CPC title

• A63F13/355

  Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client · CPC title

• H04N19/48

  using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data (motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513) · CPC title

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title