Method of interacting with multiple devices

Patent metadata

Field	Value
Publication number	US-10345913-B2
Application number	US-201514667194-A
Country	US
Kind code	B2
Filing date	Mar 24, 2015
Priority date	Mar 28, 2014
Publication date	Jul 9, 2019
Grant date	Jul 9, 2019

Abstract

The present disclosure provides a method that allows user to select an object on a first device, select a modification in order to modify the object and transferring information so that the modified object may be displayed on another device.

First claim

What is claimed is:

1. A method of controlling a first terminal to provide a modified object, the method comprising:
detecting a first gesture to select at least one object;
in response to detecting a second gesture to modify an object from among the at least one selected object, modifying the object corresponding to the second gesture;
in response to detecting a third gesture to transmit the modified object, identifying a second terminal from among a plurality of second terminals based on a direction of the third gesture, and a relationship between a function of the second terminal and a command corresponding to the third gesture; and
transmitting the modified object to the identified second terminal based on the third gesture.

2. The method as claimed in claim 1 , wherein the detecting the first gesture, the detecting the second gesture and the detecting the third gesture are performed by the first terminal.

3. The method as claimed in claim 1 , further comprising:
transmitting a command corresponding to the second gesture, an identifier of the second terminal, and the selected object to a third terminal based on the third gesture;
modifying the selected object in the third terminal according to the command corresponding to the second gesture;
transmitting the modified object from the third terminal to the second terminal; and
providing the modified object on the second terminal.

4. The method as claimed in claim 1 , wherein the second gesture is an air gesture that corresponds to a modification.

5. The method as claimed in claim 1 , further comprising:
selecting a folder based on the first gesture indicating the folder on the first terminal being detected;
compressing the folder; and
transmitting a compressed file comprising the folder to the second terminal.

6. The method as claimed in claim 1 , further comprising:
selecting a content on the first terminal corresponding to the object based on the first gesture,
transmitting the selected content to a third terminal and an identifier of the second terminal based on the third gesture to transmit the content;
detecting a figure in the content on the third terminal;
transmitting the content from which the figure is detected from the third terminal to the second terminal; and
displaying the content including the detected figure on the second terminal.

7. The method as claimed in claim 1 , further comprising:
selecting a letter displayed on the first terminal corresponding to the first gesture;
converting the letter into text data; and
transmitting the text data to the second terminal so that the text data may be displayed on the second terminal.

8. The method as claimed in claim 1 , wherein the selected object is a file in a first file type, and
wherein the second command controls the second terminal to convert the file from the first file type to a second file type.

9. A method of controlling a second terminal to provide a modified object, the method comprising:
detecting, by a camera included in the second terminal, an air gesture command comprising a first gesture to select at least one object displayed by a first terminal and a second gesture to modify an object from among the at least one object;
identifying the first terminal from among a plurality of first terminals based on a direction of the first gesture, and a relationship between the air gesture command and a function of the first terminal;
transmitting a request to the first terminal to request the selected object;
receiving the selected object;
modifying the object corresponding to the second gesture; and
providing the modified object on the second terminal.

10. A system comprising:
a first terminal configured to provide an object and detect a selection command for selecting at least one object;
a plurality of second terminals, each of the plurality of second terminals comprising a camera and being configured to recognize a user gesture using the camera; and
a third terminal configured to receive the at least one object from the first terminal and the recognized user gesture from each of the plurality of second terminals, modify a first object corresponding to the recognized user gesture from among the at least one object according to the recognized user gesture, identify a second terminal from among the plurality of second terminals based on a direction of the recognized user gesture, a relationship between a command corresponding to the recognized user gesture and a function of the second terminal, and provide the modified first object to the second terminal.

11. The system as claimed in claim 10 , wherein the first terminal is configured to store a plurality of objects and select the at least one object from among the plurality of stored objects based on the detected selection command.

12. The system as claimed in claim 10 , wherein each of the plurality of second terminals is configured to transmit the recognized user gesture to at least one of the third terminal and the first terminal.

13. The system as claimed in claim 10 , wherein the first terminal comprises the second terminal.

14. The system as claimed in claim 10 , wherein the third terminal comprises a display device, and
wherein the display device is configured to display the object.

15. The system as claimed in claim 14 , wherein the first terminal comprises a second display device,
wherein the first terminal is configured to display a folder on the second display device, and transmit the folder to a cloud server based on the selection command indicating the folder,
wherein the cloud server is configured to generate a compressed file by compressing the folder, and transmit the generated compressed file to the third terminal, and
wherein the display device is configured to provide the generated compressed file.

16. The system as claimed in claim 14 , wherein the first terminal is configured to store a content, and transmit the content to a cloud server based on the selection command indicating the content,
wherein the cloud server is configured to detect a figure from the content and transmit the content and the figure to the display device, and
wherein the display device is configured to display the content and the figure.

17. The system as claimed in claim 10 , wherein the first terminal comprises a display,
wherein the display is configured to display a folder,
wherein based on detection of a gesture selecting the folder, the first terminal is configured to compress the folder to a compressed file and transmit the compressed file to the third terminal, and
wherein the third terminal is configured to provide the compressed file.

18. The system as claimed in claim 10 , wherein the third terminal comprises a display device,
wherein the first terminal is configured to store a content, detect a figure included in the content based on the selection command indicating the content, and transmit the content and the figure to the third terminal, and
wherein the display device is configured to display the content including the figure.

19. The system as claimed in claim 10 , wherein the first terminal comprises a first display device and the third terminal comprises a second display device,
wherein the first terminal is configured to display a letter on the first display device, convert the letter into a text file in response to the letter being selected, and transmit the text file to the third terminal, and
wherein the third terminal is configured to display text data of the text file on the second displa

Assignees

• Samsung Electronics Co Ltd

Inventors

• Jain Saurabh
• Bugalia Nishant

Classifications

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/0487

  using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/0486

  Drag-and-drop · CPC title