Screen mirroring display method using layer orders of target controls and electronic device

Patent metadata

Field	Value
Publication number	US-11907604-B2
Application number	US-202017616833-A
Country	US
Kind code	B2
Filing date	Jun 2, 2020
Priority date	Jun 5, 2019
Publication date	Feb 20, 2024
Grant date	Feb 20, 2024

Abstract

A screen mirroring display method includes a destination device receiving a first message from a first source device and a second message from a second source device, where the first message includes a first drawing instruction. The first drawing instruction instructs the destination device to draw a first target control in a first interface displayed by the first source device. The second message includes a second drawing instruction. The second drawing instruction instructs the destination device to draw a second target control in a second interface displayed by the second source device. Then the destination device draws a screen mirroring interface according to the first drawing instruction and the second drawing instruction, where the screen mirroring interface includes the first target control and the second target control.

First claim

What is claimed is:

1. A method comprising:
receiving, from a first source device, a first message-comprising:
a first drawing instruction instructing to draw one or more first target controls, wherein each of the one or more first target controls is a control in a first interface displayed by the first source device; and
first view information comprising a first layer order of the one or more first target controls in a screen mirroring interface;

receiving, from a second source device, a second message comprising:
a second drawing instruction instructing to draw one or more second target controls, wherein each of the one or more second target controls is a control in a second interface displayed by the second source device; and
second view information comprising a second layer order of the one or more second target controls in the screen mirroring interface;

generating, based on the first view information and the second view information, third view information comprising the first layer order and the second layer order in the screen mirroring interface; and
executing the first drawing instruction and the second drawing instruction based on the third view information to draw the screen mirroring interface, wherein the screen monitoring interface comprises the one or more first target controls and the one or more second target controls.

2. The method of claim 1 , wherein before executing the first drawing instruction and the second drawing instruction, the method further comprises:
obtaining a configuration file corresponding to both the first interface and the second interface, wherein the configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface and a second display location of each of the one or more second target controls in the screen mirroring interface; and
splitting and recombining, based on the configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

3. The method of claim 2 , further comprising:
executing the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
executing the second drawing instruction at the second display location based on the second layer order in the third view information to draw the one or more second target controls.

4. The method of claim 1 , wherein before executing the first drawing instruction and the second drawing instruction, the method further comprises:
obtaining a first configuration file corresponding to the first interface, wherein the first configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface;
obtaining a second configuration file corresponding to the second interface, wherein the second configuration file records a second display location of each of the one or more second target controls in the screen mirroring interface; and
splitting and recombining, based on the first configuration file and the second configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

5. The method of claim 4 , further comprising:
executing the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
executing the second drawing instruction at the second display location based on the second layer order in the third view information to draw the one or more second target controls.

6. The method of claim 1 , wherein first display locations of the one or more first target controls in the first interface and the screen mirroring interface are the same, and wherein second display locations of the one or more second target controls in the second interface and the screen mirroring interface are the same.

7. The method of claim 1 , wherein before receiving the first message, the method further comprises displaying a third interface, and wherein the screen mirroring interface further comprises one or more third target controls in the third interface.

8. An electronic device comprising:
one or more processors; and
a memory configured to store instructions, wherein when executed by the one or more processors, the instructions cause the electronic device to:
receive, from a first source device, a first message comprising:
a first drawing instruction instructing to draw one or more first target controls, wherein each of the one or more first target controls is a control in a first interface displayed by the first source device; and
first view information comprising a first layer order of the one or more first target controls in the screen mirroring interface;

receive, from a second source device, a second message comprising:
a second drawing instruction instructing to draw one or more second target controls, wherein each of the one or more second target control is a control in a second interface displayed by the second source device; and
second view information comprising a second layer order of the one or more second target controls in the screen mirroring interface;

generate, based on the first view information and the second view information, third view information comprising the first layer order and the second layer order in the screen mirroring interface; and
execute the first drawing instruction and the second drawing instruction based on the third view information to draw the screen mirroring interface, wherein the screen mirroring interface comprises the one or more first target controls and the one or more second target controls.

9. The electronic device of claim 8 , wherein before executing the first drawing instruction and the second drawing instruction, when executed by the one or more processors, the instructions further cause the electronic device to:
obtain a configuration file corresponding to both the first interface and the second interface, wherein the configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface and a second display location of each of the one or more second target controls in the screen mirroring interface; and
split and recombine, based on the configuration file, the one or more first target controls in the first view information and the one or more second target controls in the second view information to obtain the third view information.

10. The electronic device of claim 9 , wherein when executed by the one or more processors, the instructions further cause the electronic device to:
execute the first drawing instruction at the first display location based on the first layer order in the third view information to draw the one or more first target controls; and
execute the second drawing instruction at the second display location based on the second layer order in the third view information to draw the second target controls.

11. The electronic device of claim 8 , wherein before executing the first drawing instruction and the second drawing instruction, when executed by the one or more processors, the instructions further cause the electronic device to:
obtain a first configuration file corresponding to the first interface, wherein the first configuration file records a first display location of each of the one or more first target controls in the screen mirroring interface;
o

Assignees

• Huawei Tech Co Ltd

Inventors

• Fan Zhenhua
• Cao Yuan
• Bian Sucheng
• Yang Wanyi
• Li Pengcheng
• Wei Xi

Classifications

• G06F3/1454 Primary

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• H04M1/724095

  Worn on the wrist, hand or arm · CPC title

• H04M1/72412

  using two-way short-range wireless interfaces · CPC title