Cross-device object drag method and device

Patent metadata

Field	Value
Publication number	US-12455682-B2
Application number	US-202118007120-A
Country	US
Kind code	B2
Filing date	Jul 27, 2021
Priority date	Jul 29, 2020
Publication date	Oct 28, 2025
Grant date	Oct 28, 2025

Abstract

A second terminal displays, on a display of the second terminal, an object dragged from a first terminal; the second terminal displays a second cursor on the object; the second terminal receives data of a motion operation that is input by a user by using an input device of the first terminal; and the second terminal displays, on the display of the second terminal based on the motion operation, an animation in which the object moves with the second cursor.

First claim

What is claimed is:

1. A method implemented by a second terminal, wherein the method comprises:
establishing a connection with a first terminal;
receiving drag data from the first terminal;
displaying, on a display device based on the drag data, a shadow of an object dragged from the first terminal;
displaying a first cursor on the shadow of the object;
receiving, from the first terminal, an operation parameter, wherein the operation parameter is received by the first terminal after a motion operation based on a user motion operation of the first terminal;
simulating a drag event via a virtual input device of the second terminal according to the operation parameter; and
displaying, on the display device based on the motion operation, a shadow animation in which the shadow of the object moves with the first cursor,
wherein the drag data and the operation parameter are initially received after the first cursor is dragged out of an edge of a first terminal display of the first terminal, wherein the shadow of the object moves with the first cursor on the first terminal display,
wherein the object is a text or a file, wherein the drag data comprises drag event content and a bitmap of the shadow, wherein when the object is the text, the drag event content comprises the text, and wherein when the object is the file, the drag event content is a file path.

2. The method of claim 1 , wherein before displaying the object dragged from the first terminal, the method further comprises receiving shuttle state information from the first terminal, wherein the shuttle state information indicates that a shuttle starts.

3. The method of claim 1 , wherein the drag data and the motion operation are configured to dispatch the drag event for the object.

4. The method of claim 3 , further comprising generating a press operation, wherein the shadow animation is based on the motion operation, the press operation, and the drag data.

5. The method of claim 4 , wherein generating the press operation comprises:
simulating a press event according to a second operation parameter of the press operation; and
simulating a motion event according to the operation parameter from the first terminal, wherein the operation parameter is included in the motion event received by the first terminal after the user motion operation, and
wherein displaying the shadow animation in which the object moves with the first cursor comprises displaying, on the display device in response to the press event and the motion event based on the drag data, the animation in which the object moves with the first cursor.

6. The method of claim 5 , wherein the operation parameter comprises at least one of a mouse button flag bit, coordinate information, scroll wheel information, or button location information.

7. The method of claim 3 , further comprising creating a view control whose transparency is greater than a threshold, and wherein the view control is configured to dispatch the drag event.

8. The method of claim 1 , further comprising:
creating the virtual input device after establishing the connection with the first terminal; or
receiving a notification message from the first terminal, and creating the virtual input device in response to the notification message, wherein the virtual input device simulates an input event according to the operation parameter.

9. A method comprising:
displaying an object and a first cursor on the object;
receiving, by an input device, a drag operation input by a user, wherein the drag operation is configured to dispatch a drag for the object;
displaying, on a display device in response to the drag operation, a shadow animation in which a shadow of the object moves with the first cursor;
receiving, an operation parameter after a motion operation based on a user motion operation; and
start sending drag data and the operation parameter to a second terminal when determining that the first cursor is dragged out of an edge of the display device, wherein a virtual input device the second terminal simulates a drag event according to the operation parameter,
wherein the object is a text or a file, wherein the drag data comprises drag event content and a bitmap of the shadow, wherein when the object is the text, the drag event content comprises the text, and wherein when the object is the file, the drag event content is a file path.

10. The method of claim 9 , wherein the drag operation further comprises a press operation, and wherein when determining that the first cursor is dragged out of the edge of the display device, the method further comprises sending, to the second terminal, data of the motion operation.

11. The method of claim 10 , wherein sending the data of the motion operation comprises:
intercepting a motion event in a process in which the user performs the motion operation using the input device; and
sending, to the second terminal, the operation parameter included in the motion event.

12. The method of claim 11 , wherein the operation parameter comprises at least one of a mouse button flag bit, coordinate information, scroll wheel information, or button location information.

13. The method of claim 9 , wherein after determining that the first cursor is dragged out of the edge of the display device, the method further comprises sending shuttle state information to the second terminal, wherein the shuttle state information indicates that a shuttle starts.

14. The method of claim 9 , wherein after determining that the first cursor is dragged out of the edge of the display device, the method further comprises hiding the first cursor and the shadow of the object.

15. The method of claim 9 , further comprising displaying an invisible window, wherein transparency of the invisible window is greater than a threshold, wherein the invisible window is configured to receive the drag event, and wherein before sending the drag data to the second terminal, the method further comprises:
obtaining the drag event content from the drag event that is received by the invisible window; and
obtaining the bitmap of the shadow.

16. A first terminal, comprising:
an input device configured to receive a drag operation input by a user, wherein the drag operation is configured to dispatch a drag for an object;
a display device configured to:
display the object and a first cursor on the object;
display, in response to the drag operation, a shadow animation in which a shadow of the object moves with the first cursor; and

a processor coupled to the input device and the display device, wherein the processor is configured to:
receive, an operation parameter after a motion operation based on a user motion operation;
determine that the first cursor is dragged out of an edge of the display device; and
start to send drag data and the operation parameter to a second terminal when determining that the first cursor is dragged out of the edge of the display device, wherein a virtual input device the second terminal simulates a drag event according to the operation parameter,

wherein the object is a text or a file, wherein the drag data comprises drag event content and a bitmap of the shadow, wherein when the object is the text, the drag event content comprises the text, and wherein when the object is the file, the drag event content is a file path.

17. The first terminal of claim 16 , wherein after the first terminal determines that the first cursor is dragged out of the edge of the display device, the processor is further configured to send, to the second terminal, shuttle state information indicatin

Assignees

• Huawei Tech Co Ltd

Inventors

• Lu Yuedong
• Wang Haijun
• Zhou Xueer
• Zhou Xingchen

Classifications

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G06F3/04886

  by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus · CPC title

• G06F3/0485

  Scrolling or panning · CPC title

• G09G2360/121

  using a cache memory · CPC title

• G09G5/08

  Cursor circuits · CPC title