Image processing method and computer system

Patent metadata

Field	Value
Publication number	US-11908040-B2
Application number	US-202117487306-A
Country	US
Kind code	B2
Filing date	Sep 28, 2021
Priority date	Mar 30, 2019
Publication date	Feb 20, 2024
Grant date	Feb 20, 2024

Abstract

An image processing method and a computer system. The method may be applied to a cloud-side server in a cloud mobile phone. The server may be a virtualization server, a host operating system and a guest operating system are deployed on the server, a user mode graphics driver is deployed in the guest operating system, and a kernel mode graphics driver is deployed in the host operating system. The user mode graphics driver and the kernel mode graphics driver collaborate with each other to implement image rendering of the server. Then, the server may send a rendered image to the cloud mobile phone. Accordingly, an instruction translation process is reduced, to reduce overheads of a processor and improve image processing efficiency.

First claim

What is claimed is:

1. An image processing method, wherein the method is applied to a computer system comprising a host operating system, wherein a kernel mode graphics driver and a first guest operating system are installed in the host operating system, a user mode graphics driver is deployed in the first guest operating system, the first guest operating system further comprises an image compositor directly connected to an image capture program, and the method comprises:
generating, by the user mode kernel driver based on a first application programming interface (API) call request, a first instruction that can be identified by a graphics processing unit;
sending the first instruction to the kernel mode graphics driver, wherein the first API call request is used to request to perform an image rendering operation; and
controlling, by the kernel mode graphics driver based on the first instruction, the graphics processing unit to perform image rendering.

2. The method according to claim 1 , further comprising:
determining, by the image compositor, a status of the image capture program; and
skipping performing an image composition operation on a plurality of layers after the image capture program is in a disabled state.

3. The method according to claim 2 , wherein, before determining, by the image compositor, the status of the image capture program, the method further comprises:
registering, by the image capture program, state information with the compositor, wherein the state information is used to indicate that the image capture program is in an enabled state or in the disabled state.

4. The method according to claim 2 , wherein if the image capture program is in the enabled state, a rate at which the image compositor performs image composition is the same as a rate at which the image capture program performs image capture.

5. The method according to claim 2 , wherein if the image capture program is in the enabled state, the method further comprises:
capturing, by the image capture program, a composite image obtained by the image compositor through composition;
encoding and compressing, by the image capture program, the composite image; and
sending, by the image capture program, image data obtained through encoding and compression to a remote end.

6. The method according to claim 2 , wherein the computer system further comprises an image encoder, and if the image capture program is in the enabled state, the method further comprises:
encoding and compressing, by the image encoder, a composite image obtained by the image compositor through composition;
capturing, by the image capture program, image data obtained through encoding and compression; and
sending, by the image capture program, the image data to a remote end.

7. The method according to claim 2 , further comprising:
reading, by the image compositor, a plurality of layers obtained by the graphics processing unit through rendering;
sending, by the image compositor, an image composition instruction to the user mode graphics driver by using a generic buffer manager, wherein the image composition instruction is used to request to perform the image composition operation on the plurality of layers;
generating, by the user mode graphics driver based on the image composition instruction, a second instruction that can be identified by the graphics processing unit;
sending the second instruction to the kernel mode graphics driver; and
controlling, by the kernel mode graphics driver based on the second instruction, the graphics processing unit to perform the image composition operation on the plurality of layers.

8. A computer system, comprising a host operating system deployed in the computer system, a kernel mode graphics driver and a first guest operating system deployed in the host operating system, the first guest operating system further comprises an image compositor directly connected to an image capture program, and a user mode graphics driver deployed in the first guest operating system;
wherein the user mode kernel driver is configured to:
receive a first application programming interface (API) call request, wherein the first API call request is used to request to perform an image rendering operation; and
generate, based on the first API call request, a first instruction that can be identified by the graphics processing unit, and send the first instruction to the kernel mode graphics driver; and
the kernel mode graphics driver is configured to control, according to the first instruction, the graphics processing unit to perform image rendering.

9. The computer system according to claim 8 , wherein the image compositor is configured to:
determine a status of the image capture program; and
skip performing an image composition operation on the plurality of layers when the image capture program is in a disabled state.

10. The computer system according to claim 9 , wherein the image capture program is configured to register state information with the compositor before the image compositor determines the status of the image capture program, wherein the state information is used to indicate that the image capture program is in an enabled state or in the disabled state.

11. The computer system according to claim 9 , wherein if the image capture program is in the enabled state, a rate at which the image compositor performs image composition is the same as a rate at which the image capture program performs image capture.

12. The computer system according to claim 9 , wherein
the image capture program is configured to:
when the image capture program is in the enabled state,
capture a composite image obtained by the image compositor through composition,
encode and compress the composite image, and
send image data obtained through encoding and compression to a remote end.

13. The computer system according to claim 9 , wherein the computer system further comprises an image encoder, wherein
the image encoder is configured to:
when the image capture program is in the enabled state,
encode and compress the composite image obtained by the image compositor through composition; and
the image capture program is configured to:
capture image data obtained through encoding and compression, and
send the image data to a remote end.

14. The computer system according to claim 9 , wherein the image compositor being configured to:
when the image capture program is in the enabled state, perform the image composition operation on the plurality of layers obtained by the graphics processing unit through rendering comprises:
the image compositor is configured to:
when the image capture program is in the enabled state, read the plurality of layers obtained by the graphics processing unit through rendering;
the image compositor is configured to send an image composition instruction to the user mode graphics driver by using a generic buffer manager, wherein the image composition instruction is used to request to perform the image composition operation on the plurality of layers;
the user mode graphics driver is configured to:
generate, based on the image composition instruction, a second instruction that can be identified by the graphics processing unit, and
send the second instruction to the kernel mode graphics driver; and
the kernel mode graphics driver is configured to control, based on the second instruction, the graphics processing unit to perform the image composition operation on the plurality of layers.

15. A computer system, wherein the computer system comprises a first processor, a memory, and a graphics processing unit, wherein

Assignees

• Huawei Tech Co Ltd

Inventors

• Liu Lingfei
• Chen Lixin
• Xiong Yang

Classifications

• G06T1/20 Primary

  Processor architectures; Processor configuration, e.g. pipelining · CPC title

• G06T1/0007

  Image acquisition · CPC title

• G06T9/00

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• G06F9/45558 Primary

  Hypervisor-specific management and integration aspects · CPC title

• G06F2009/45579

  I/O management, e.g. providing access to device drivers or storage · CPC title