Cross-device object drag method and device

Patent metadata

Field	Value
Publication number	US-12073071-B2
Application number	US-202118015383-A
Country	US
Kind code	B2
Filing date	Jul 27, 2021
Priority date	Jul 29, 2020
Publication date	Aug 27, 2024
Grant date	Aug 27, 2024

Abstract

This application provides a cross-device object drag method and a device, and relates to the field of electronic devices. This improves usage efficiency of collaborative use of a plurality of terminals, makes drag more direct and explicit, and improves user experience in drag. A specific solution is as follows: A first terminal displays an object on a display of the first terminal. The first terminal receives a drag operation input by a user. The drag operation is used to initiate drag for the object. The first terminal displays, on the display of the first terminal in response to the drag operation, an animation in which the object moves with the drag operation. The first terminal sends drag data to a second terminal after determining that a drag intent of the user is cross-device drag. The drag data is used by the second terminal to display the object on a display of the second terminal.

First claim

What is claimed is:

1. A first terminal, comprising:
at least one processor; and
a memory coupled to the at least one processor and configured to store programming instructions that, when executed by the at least one processor, cause the first terminal to:
display an object on a first display of the first terminal;
receive a drag operation input by a user, wherein the drag operation is used to initiate drag for the object;
display on the first display of the first terminal in response to the drag operation, an animation in which the object moves with the drag operation;
display a first interface element on a first edge from which the object is to be dragged out from the first display of the first terminal to a second terminal;
obtain first drag data from a drag start event when the object starts to be dragged, wherein the first drag data comprises rectangle information of the object, and a layer name of the object on a current display interface of the first terminal;
obtain second drag data from a drag movement event in the process in which the object moves on the first display of the first terminal, wherein the second drag data comprises coordinate information of the first corner of the object and
send drag data including the first drag data and the second drag data to the second terminal after determining that a drag intent of the user is cross-device drag, wherein the drag data is used by the second terminal to display the object on a second display of the second terminal;
wherein the object is a video component, a floating window, a picture-in-picture, or a freeform window.

2. The first terminal according to claim 1 , wherein the programming instructions, when executed by the at least one processor, further cause the first terminal to:
when a first region of the object is dragged out of the first display of the first terminal, display a second region of the object on the first display of the first terminal, such that the second region of the object displayed on the first terminal and the first region of the object displayed on the second terminal can implement complete presentation of content of the object.

3. The first terminal according to claim 1 , wherein the drag operation comprises an operation of triggering the object to move, and the second region of the object displayed on the display of the first terminal dynamically changes with the drag operation.

4. The first terminal according to claim 1 , wherein the programming instructions, when executed by the at least one processor, further cause the first terminal to:
after displaying the second region of the object on the first display of the first terminal, receive third drag data from the second terminal in response to sending a drag operation of the user for the first region of the object displayed on the second terminal, wherein the third drag data comprises coordinate information of a first corner of the object, wherein
the second region of the object displayed on the first display of the first terminal dynamically changes with a change of the third drag data.

5. The first terminal according to claim 1 , wherein programming instructions, when executed by the at least one processor, further cause the first terminal to:
after sending the drag data to the second terminal, receive a drag release operation input by the user, wherein the drag release operation is used to indicate that drag for the object ends; and
send indication information to the second terminal in response to the drag release operation, wherein the indication information is used to indicate the second terminal to display the entire region of the object on the second display of the second terminal.

6. The first terminal according to claim 1 , wherein determining that the drag intent of the user is cross-device drag comprises:
determining that the object is dragged to a drag sensing region disposed on an edge of the first display of the first terminal; or
determining that a distance between the object and an edge of the first display of the first terminal is less than a predetermined distance.

7. The first terminal according to claim 1 , wherein the programming instructions, when executed by the at least one processor, further cause the first terminal to:
after the first terminal determines that the drag intent of the user is cross-device drag, send screen recording data to the second terminal, wherein the screen recording data and the drag data are used by the second terminal to display a partial region or an entire region of the object on the second display of the second terminal.

8. A second terminal, comprising:
at least one processor; and
a memory coupled to the at least one processor and configured to store programming instructions that, when executed by the at least one processor, cause the second terminal to:
receive drag data from a first terminal, wherein the drag data is related to a cross-device drag operation of an object displayed on a first display of the first terminal;
display a second interface element on a second edge in which the object is to be dragged from the first terminal,
display at least part of the object on a second display of the second terminal based on the drag data;
receive an operation for controlling the at least part of the object on the second display of the second terminal via an input device of the second terminal; and
in response to the operation, control displaying of the at least part of the objection on the second display of the second terminal, wherein the object is a video component, a floating window, a picture-in-picture, or a freeform window, wherein the operation includes at least one of an operation for stop displaying the at least of the objection on the second display or a drag operation for a first region of the at least part of the object displayed on the second display of the second terminal, wherein the first region displayed on the second display of the second terminal dynamically changes with the drag operation.

9. The second terminal according to claim 8 , wherein the programming instructions cause the second terminal to display the at least part of the object on the second display of the second terminal based on the drag data by
displaying a first region of the object based on the drag data on the second display of the second terminal when determining that the first region of the object is dragged out of the first display of the first terminal such that the first region of the object displayed on the second display of the second terminal and a second region displayed on the first terminal can implement complete presentation of content of the object.

10. The second terminal according to claim 8 , wherein the drag data comprises first drag data and second drag data; and
a first region of the object displayed on the second display of the second terminal dynamically changes with a change of the second drag data.

11. The second terminal according to claim 10 , wherein the object is a window or a partial region of a window, and the window comprises an interface of an application;
the first drag data comprises the interface of the application and rectangle information of the object; and
the second drag data comprises coordinate information of the first corner of the object.

12. A second terminal, comprising:
at least one processor; and
a memory coupled to the at least one processor and configured to store programming instructions that, when executed by the at least one processor, cause the second terminal to:
receive drag data from a first terminal, wherein the drag data is related to a cross-device drag operation of an object displayed on a first display of th

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhou Xingchen
• Lin Youhui
• Wang Huan
• Cao Yuan
• Ding Ning
• Wei Xi
• Wang Haijun

Classifications

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/0486 Primary

  Drag-and-drop · CPC title

• G06F3/0485 Primary

  Scrolling or panning · CPC title