Electronic device and method for providing virtual input tool

Patent metadata

Field	Value
Publication number	US-11340776-B2
Application number	US-201916428066-A
Country	US
Kind code	B2
Filing date	May 31, 2019
Priority date	Aug 2, 2018
Publication date	May 24, 2022
Grant date	May 24, 2022

Abstract

An electronic device is provided. The electronic device includes a communication circuitry, at least one memory storing instructions, a display, and at least one processor. The at least one processor, when executing the instructions, is configured to display, using the communication circuitry, a first user interface of an application being executed in the electronic device on a display of an external device, while displaying the first user interface on the display of the external device, receive a specified input, and in response to receiving the specified input, display, on the display of the electronic device, a virtual touch pad in a first area and a virtual keyboard in a second area distinct from the first area.

First claim

What is claimed is:

1. An electronic device, comprising:
communication circuitry;
at least one memory storing instructions;
a display; and
at least one processor,
wherein the at least one processor, when executing the instructions, is configured to:
execute an application,
transmit, using the communication circuitry, user interface information to an external device, wherein the external device displays a first user interface of the application based on the user interface information,
while the first user interface is displayed by the external device, receive a specified input,
in response to receiving the specified input, display, on the display of the electronic device, a virtual touch pad in a first area and a virtual keyboard in a second area distinct from the first area,
while displaying the virtual touch pad in the first area and the virtual keyboard in the second area, receive a drag input moving from the first area toward the second area, and
while a contact of the drag input is maintained, in response to the drag input moving across a key of the virtual keyboard:
disable a function of the virtual keyboard,
display a visual representation on the virtual keyboard for indicating that the virtual keyboard is disabled and that the drag input continues while in the second area, in response to disabling the function of the virtual keyboard, and
recognize the drag input as a part of an input on the virtual touch pad other than the virtual keyboard.

2. The electronic device of claim 1 , wherein the at least one processor, when executing the instructions, is further configured to:
while the first user interface is displayed by the external device, display a second user interface of the application in the first area and the second area; and
in response to receiving the specified input, display the virtual touch pad and the virtual keyboard that are changed by the second user interface.

3. The electronic device of claim 1 , wherein the at least one processor, when executing the instructions, is further configured to:
transmit, by using the communication circuitry, information to change the first user interface displayed by the external device based on a path of the drag input.

4. The electronic device of claim 1 , wherein the visual representation comprises:
a translucent layer over the virtual keyboard, or a dim or blur on the virtual keyboard.

5. The electronic device of claim 1 , wherein the at least one processor, when executing the instructions, is further configured to:
while displaying the virtual touch pad in the first area and the virtual keyboard in the second area, receive a drag input starting in the first area; and
in response to identifying that the drag input is directed from the first area toward the second area while a contact of the drag input is maintained, change a representation of the virtual keyboard to preclude contact between the drag input and the virtual keyboard.

6. The electronic device of claim 5 , wherein the at least one processor, when executing the instructions, is further configured to:
in response to identifying that the drag input is directed from the second area to the first area while the contact of the drag input is maintained, restore the representation of the virtual keyboard.

7. The electronic device of claim 1 , wherein the at least one processor, when executing the instructions, is further configured to:
in response to identifying that an orientation of the electronic device is changed while displaying the virtual touch pad in the first area and the virtual keyboard in the second area, change an arrangement of the virtual touch pad and the virtual keyboard.

8. The electronic device of claim 1 , wherein the at least one processor, when executing the instructions, is further configured to:
in response to receiving a touch input for moving a side of the virtual keyboard while displaying the virtual touch pad in the first area and the virtual keyboard in the second area, move the virtual keyboard from the second area.

9. The electronic device of claim 8 , wherein the at least one processor, when executing the instructions, is further configured to:
in response to receiving a touch input for moving a different side of the virtual keyboard while displaying the virtual touch pad in the first area and the virtual keyboard in the second area, enlarge or reduce an area displaying the virtual keyboard.

10. The electronic device of claim 1 ,
wherein the at least one processor, when executing the instructions, is further configured to:
while the first user interface of the application is displayed by the external device, display a second user interface of the application in the first area and the second area, and

wherein the specified input corresponds to a touch input on a designated object in the second user interface.

11. The electronic device of claim 1 , wherein the specified input corresponds to changing an orientation of the electronic device to a specified orientation.

12. The electronic device of claim 1 ,
wherein the at least one processor, when executing the instructions, is further configured to:
while the first user interface is displayed by the external device, display a second user interface of the application in the first area and the second area, and

wherein the specified input corresponds to a touch input on a text input portion included in the first user interface or a text input portion included in the second user interface.

13. The electronic device of claim 1 , wherein the second area is disposed below the first area.

14. A non-transitory computer readable storage medium storing a program, wherein the program, when executed by a processor of an electronic device, causes the electronic device to:
execute an application;
transmit user interface information to another electronic device, wherein the other electronic device displays a first user interface of the application based on the user interface information;
in response to receiving a specified input while the first user interface is displayed by the other electronic device, display, on a display of the electronic device, a virtual touch pad in a first area and a virtual keyboard in a second area distinct from the first area;
while displaying the virtual touch pad in the first area and the virtual keyboard in the second area, receive a drag input moving from the first area toward the second area; and
while a contact of the drag input is maintained and in response to the drag input moving across a key of the virtual keyboard:
disable a function of the virtual keyboard,
display a visual representation on the virtual keyboard for indicating that the virtual keyboard is disabled and that the drag input continues while in the second area, in response to disabling the function of the virtual keyboard, and
recognize the drag input as a part of an input on the virtual touch pad other than the virtual keyboard.

15. The non-transitory computer readable storage medium of claim 14 , wherein the program, when executed by the processor of the electronic device, further causes the electronic device to:
while the first user interface is displayed by the other electronic device, display a second user interface of the application in the first area and the second area; and
in response to receiving the specified input, display the virtual touch pad and the virtual keyboard that are changed by the second user interface.

16. The non-transitory computer readable storage medium of claim 14 , wherein the program, when executed by the processor of the elec

Assignees

• Samsung Electronics Co Ltd

Inventors

• Bang Myojin
• Moon Minjeong
• Yoon Seoyoung
• Moon Minjung
• Han Jaegi
• Heo Jiyoon

Classifications

• G06F2203/04803

  Split screen, i.e. subdividing the display area or the window area into separate subareas · CPC title

• G06F3/03547

  Touch pads, in which fingers can move on a surface · CPC title

• G06F2203/04804

  Transparency, e.g. transparent or translucent windows · CPC title

• G06F3/04886 Primary

  by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus · CPC title

• G06F3/023

  Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes · CPC title