Cross-device object drag method and device

Patent metadata

Field	Value
Publication number	US-12393328-B2
Application number	US-202418746068-A
Country	US
Kind code	B2
Filing date	Jun 18, 2024
Priority date	Jul 29, 2020
Publication date	Aug 19, 2025
Grant date	Aug 19, 2025

Abstract

The method comprises: a first terminal displays an object on a display of the first terminal. The first terminal receives a drag operation entered by a user. The drag operation is used to initiate drag for the object. The first terminal displays, on the display of the first terminal in response to the drag operation, an animation in which the object moves with the drag operation. The first terminal sends drag data to a second terminal after determining that a drag intent of the user is cross-device drag. The drag data is used by the second terminal to display the object on a display of the second terminal.

First claim

What is claimed is:

1. A first terminal, comprising:
at least one processor; and
a memory coupled to the at least one processor and configured to store programming instructions that, when executed by the at least one processor, cause the first terminal to:
display an object on a display of the first terminal;
receive a drag operation for dragging the object;
display, on the display of the first terminal in response to the drag operation, an animation in which the object moves with the drag operation;
determine a first edge from which the object is to be dragged out based on direction of the drag operation;
display a first interface element on the first edge after determining that a distance between the object and the first edge is less than a predetermined distance, and
send drag data to the second terminal, wherein the drag data is used by the second terminal to display the object on a display of the second terminal.

2. The first terminal according to claim 1 , wherein the programming instructions, when executed by the at least one processor, further cause the first terminal to:
in a process in which the object moves on the display of the first terminal, display a second region of the object on the display of the first terminal when a first region of the object is dragged out of the display of the first terminal, wherein
the drag data is used by the second terminal to display the first region of the object on the display of the second terminal, and the second region of the object displayed on the first terminal and the first region of the object displayed on the second terminal can implement complete presentation of content of the object.

3. The first terminal according to claim 1 , wherein the drag operation comprises at least an operation of triggering the object to move, and the second region of the object displayed on the display of the first terminal dynamically changes with the operation.

4. The first terminal according to claim 1 , wherein after the display a second region of the object on the display of the first terminal, the programming instructions, when executed by the at least one processor, further cause the first terminal to:
receive third drag data from the second terminal, wherein the third drag data is sent by the second terminal to the first terminal after the second terminal receives a drag operation for the first region of the object displayed on the second terminal, and the third drag data comprises coordinate information of a first corner of the object, wherein
the second region of the object displayed on the display of the first terminal dynamically changes with a change of the third drag data.

5. The first terminal according to claim 1 , wherein the drag data comprises first drag data and second drag data; and
before sending the drag data to the second terminal, the programming instructions, when executed by the at least one processor, further cause the first terminal to:
obtain the first drag data from a drag start event when the object starts to be dragged; and
obtain the second drag data from a drag movement event in the process in which the object moves on the display of the first terminal.

6. The first terminal according to claim 5 , wherein the object is a window or a partial region of a window, and the window comprises an interface of an application;
the first drag data comprises the interface of the application and rectangle information of the object; and
the second drag data comprises coordinate information of a first corner of the object.

7. The first terminal according to claim 5 , wherein the object is a video component, a floating window, a picture-in-picture, or a freeform window;
the first drag data comprises rectangle information of the object, and a layer name of the object on a current display interface of the first terminal; and
the second drag data comprises coordinate information of a first corner of the object.

8. The first terminal according to claim 7 , wherein after the first terminal determines that a drag intent of the drag operation is cross-device drag, the programming instructions, when executed by the at least one processor, further cause the first terminal to:
send screen recording data to the second terminal, wherein the screen recording data and the drag data are used by the second terminal to display a partial region or an entire region of the object on the display of the second terminal.

9. The first terminal according to claim 1 , wherein after sending drag data to the second terminal, the programming instructions, when executed by the at least one processor, further cause the first terminal to:
receive a drag release operation that is used to indicate that drag for the object ends; and
send indication information to the second terminal in response to the drag release operation, wherein the indication information is used to indicate the second terminal to display the entire region of the object on the display of the second terminal.

10. A second terminal, comprising:
at least one processor; and
a memory coupled to the at least one processor and configured to store programming instructions that, when executed by the at least one processor, cause the second terminal to:
receive drag data from the first terminal, wherein the drag data is sent by the first terminal after the first terminal detects a drag intent of a cross-device drag on a first edge of the display of the first terminal;
display a second interface element on a second edge in which the object is to be dragged, wherein the second interface element indicates the first terminal from which the object is dragged out, and
display the object on a display of the second terminal based on the drag data.

11. The second terminal according to claim 10 , wherein the display the object on the display of the second terminal based on the drag data comprises:
display a first region of the object based on the drag data on the display of the second terminal when determining that the first region of the object is dragged out of the display of the first terminal, wherein
a second region that is of the object and that is displayed on the first terminal and the first region of the object displayed on the second terminal can implement complete presentation of content of the object.

12. The second terminal according to claim 10 , wherein the drag data comprises first drag data and second drag data; and the first region of the object displayed on the display of the second terminal dynamically changes with a change of the second drag data.

13. The second terminal according to claim 12 , wherein the object is a window or a partial region of a window, and the window comprises an interface of an application;
the first drag data comprises the interface of the application and rectangle information of the object; and
the second drag data comprises coordinate information of a first corner of the object.

14. The second terminal according to claim 12 , wherein the object is a video component, a floating window, a picture-in-picture, or a freeform window;
the first drag data comprises rectangle information of the object, and a layer name of the object on a current display interface of the first terminal; and
the second drag data comprises coordinate information of a first corner of the object.

15. The second terminal according to claim 14 , wherein the programming instructions, when executed by the at least one processor, further cause the second terminal to:
receive screen recording data from the first terminal; and
the display a first region of the object based on the drag data on

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhou Xingchen
• Lin Youhui
• Wang Huan
• Cao Yuan
• Ding Ning
• Wei Xi
• Wang Haijun

Classifications

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/0486 Primary

  Drag-and-drop · CPC title

• G06F3/0485 Primary

  Scrolling or panning · CPC title