Display apparatus and control method thereof

Patent metadata

Field	Value
Publication number	US-10386932-B2
Application number	US-201615209326-A
Country	US
Kind code	B2
Filing date	Jul 13, 2016
Priority date	Jul 16, 2015
Publication date	Aug 20, 2019
Grant date	Aug 20, 2019

Abstract

A display apparatus includes a display configured to display an image; a communicator configured to communicate with an input apparatus, the input apparatus including at least one sensor that senses a user's gesture input; and at least one processor configured to, in response to the gesture input being sensed by the sensor of the input apparatus, determine a command which corresponds to the sensed gesture input among a plurality of commands corresponding to a plurality of functions supported by the display apparatus, and implement an operation corresponding to the determined command, and wherein the command corresponding to the gesture input is based on at least one among content and a first user interface displayed on the display, or a user's input prior to the gesture input. Thus, the display apparatus implements operations in response to a user's gesture input, thereby providing more familiar and closer interaction with a user.

First claim

What is claimed is:

1. A display apparatus comprising:
a display, implemented by a display panel, configured to display an image;
a communicator, implemented by a communication circuitry, configured to communicate with a remote controller, the remote controller comprising a motion sensor which senses a gesture input based on a movement of the remote controller; and
a controller, implemented by at least one hardware processor, configured to:
receive signals corresponding to gesture inputs being sensed by the motion sensor from the remote controller, the gesture inputs comprising a first gesture input drawing a figure having a predetermined shape and a second gesture input drawing a letter or a numeral in an area of the drawn figure,
display a window having the predetermined shape of the drawn figure corresponding to a moving path of the sensed first gesture input and display the letter or the numeral in the window corresponding to a moving path of the sensed second gesture input on the display based on the received signals,
based on the predetermined shape of the window, identify a command regarding the letter or the numeral from among a plurality of commands corresponding to a plurality of functions supported by the display apparatus, and
perform a search operation depending on a keyword corresponding to the identified command and display search results on the display.

2. The display apparatus according to claim 1 , wherein the controller is further configured to control the display to display a user interface corresponding to the window having the predetermined shape corresponding to the first gesture input, the second gesture input being input in response to the displayed window.

3. The display apparatus according to claim 2 , wherein the user interface corresponds to a shape of a drawing object corresponding to the moving path of a pointer in accordance with the first gesture input.

4. The display apparatus according to claim 3 , wherein the user interface comprises a search box for one among an internal search and an external search,
the internal search searches for at least one among a function supported by the display apparatus, stored content, and a selectable channel, and
the external search searches Internet or for a connectable external apparatus.

5. The display apparatus according to claim 4 , wherein the controller is further configured to implement one among the internal search and the external search, based on at least one among a shape and color of the user interface, and a user's previous input.

6. The display apparatus according to claim 4 , wherein the second gesture input comprises a prefix that is input to the search box, and
the controller is configured to implement the internal search or the external search in accordance with the input prefix, and control the display to display a search result.

7. The display apparatus according to claim 1 , wherein the gesture input further comprises at least one among straight lines and curved lines having directivity.

8. The display apparatus according to claim 3 , wherein the remote controller comprises a plurality of buttons, and
the controller is further configured to receive a user's previous input comprising a user's selection with regard to one among the plurality of buttons, identify a button selected by a user, and control the display to display the user interface corresponding to the identified button.

9. The display apparatus according to claim 1 , further comprising a memory configured to store a table with the plurality of commands corresponding to a plurality of gesture inputs, and
the plurality of commands corresponding to the plurality of gesture inputs are set by a user.

10. A method of controlling a display apparatus, the method comprising:
receiving signals corresponding to gesture inputs from a remote controller, the remote controller comprising a motion sensor for sensing the gesture inputs comprising a first gesture input drawing a figure having a predetermined shape and a second gesture input drawing a letter or a numeral in an area of the drawn figure based on movements of the remote controller;
displaying a window having the predetermined shape of the drawn figure corresponding to a moving path of the sensed first gesture input and display the letter or the numeral in the window corresponding to a moving path of the sensed second gesture input on a display based on the received signals;
based on the predetermined shape of the window, identifying a command regarding the letter or the numeral from among a plurality of commands corresponding to a plurality of functions supported by the display apparatus; and
performing a search operation depending on a keyword corresponding to the identified command and displaying search results on the display.

11. The method according to claim 10 , further comprising displaying a user interface corresponding to the window having the predetermined shape corresponding to the first gesture input, the second gesture input being input in response to the displayed window.

12. The method according to claim 11 , wherein the user interface corresponds to a shape of a drawing object corresponding to the moving path of a pointer in accordance with the first gesture input.

13. The method according to claim 12 , wherein the user interface comprises a search box for one among an internal search and an external search,
wherein the internal search searches for at least one among a function supported by the display apparatus, stored content, and a selectable channel, and the external search searches Internet or for a connectable external apparatus.

14. The method according to claim 13 , further comprising performing one among the internal search and the external search, based on at least one among a shape and color of the user interface and a user's previous input.

15. The method according to claim 13 , wherein the second gesture input comprises a prefix that is input to the search box, and
the method further comprising performing the internal search or the external search in accordance with the input prefix, and displaying a search result.

16. The method according to claim 10 , wherein the gesture input further comprises at least one among straight lines and curved lines having directivity.

17. The method according to claim 12 , wherein the remote controller comprises a plurality of buttons,
the method further comprises receiving a user's previous input comprising a user's selection with regard to one among the plurality of buttons, and
the displaying the user interface comprises determining a button selected by a user, and displaying the user interface corresponding to the determined button.

18. The method according to claim 10 , further comprising setting or modifying the plurality of commands corresponding to a plurality of gesture inputs.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kang Ho-Woong

Classifications

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/03547

  Touch pads, in which fingers can move on a surface · CPC title