Image display apparatus for controlling an object displayed on a screen and method for operating image display apparatus

Patent metadata

Field	Value
Publication number	US-10310702-B2
Application number	US-201314913869-A
Country	US
Kind code	B2
Filing date	Sep 27, 2013
Priority date	Sep 27, 2013
Publication date	Jun 4, 2019
Grant date	Jun 4, 2019

Abstract

An image display apparatus and a method for operating an image display apparatus are disclosed. According to embodiments of the present invention, the image display apparatus comprises: a microphone; a display unit configured to output a pointer on a screen; and a controller generating a representative image corresponding to a first voice signal and attaching the representative image to the pointer when the first voice signal is input into the microphone in a state in which the pointer is output on the screen. Here, the controller enables the representative image attached to the pointer to be displayed along a moving path of the pointer in response to the movement of the pointer on the screen and, when a specific object on the screen is selected using the pointer to which the representative image is attached, enables a function related to the representative image corresponding to the first voice signal to be applied to the selected specific object while a display corresponding to the selection is output.

First claim

The invention claimed is:

1. An image display apparatus comprising:
a microphone;
a display configured to display a pointer on a screen; and
a hardware controller operably coupled to the microphone and the display and configured to:
receive a first voice signal through the microphone while the pointer is displayed on the screen,
cause the display to display a first image indicating a first function corresponding to the first voice signal, wherein the first image is displayed along with the pointer and attached to the pointer,
cause the display to display the first image attached to the pointer along a moving path of the pointer, in response to the movement of the pointer on the screen,
execute the first function associated with the first image for a first object when the first object on the screen is selected using the pointer with the first image attached thereto, and
execute the first function associated with the first image for a second object when the second object on the screen is selected using the pointer while the pointer with the first image attached thereto is displayed,
receive a second voice signal for changing the first image through the microphone while the pointer with the first image attached thereto is displayed, and
cause the display to display a second image indicating a second function corresponding to the second voice signal, wherein the second image is displayed along with the pointer and attached to the pointer instead of the first image.

2. The apparatus of claim 1 , wherein the hardware controller, when a voice indicating a predetermined function is included in the first voice signal,
generates the first image by detecting another image associated with the first function from a memory or a predetermined web server, and
controls the first image to be continuously output in the attached state to the pointer after executing the first function associated with the first image to the selected first object.

3. The apparatus of claim 1 , further comprising a receiver configured to receive from an external input device a pointing signal for moving the pointer with the first image or the second image attached thereto.

4. The apparatus of claim 1 , wherein the hardware controller controls the first image or the second image attached to the pointer to be hidden when the movement of the pointer is not sensed for a preset period of time and the hidden image to be output again in response to the pointer being moved, in the state that the first image or the second image is attached to the pointer.

5. The apparatus of claim 1 , wherein the hardware controller controls a preset animation effect or a predetermined notification sound to be output when the first or second image is attached to the pointer in response to the input of the first or second voice signal.

6. The apparatus of claim 1 , wherein the hardware controller controls at least one object corresponding to another voice signal to be selected based on a specific region of the screen when the another voice signal is input in a state that the pointer with the first or second image attached thereto has been moved to the specific region of the screen.

7. The apparatus of claim 1 , wherein the hardware controller generates a third image indicating additional information related to the first function, attaches the third image to the first image, and controls the third image to be moved according to the movement of the pointer, when the additional information related to the first function is included in the first voice signal.

8. The apparatus of claim 7 , wherein the hardware controller, when a specific object on the screen is selected using the pointer with the third image and the first image attached thereto, controls the first function associated with the first image to be applied to the selected first object based on the additional information corresponding to the third image.

9. The apparatus of claim 1 , wherein the hardware controller generates the first image corresponding to the first voice signal when an entrance into a voice recognition mode is sensed based on an input signal.

10. The apparatus of claim 9 , wherein the hardware controller, when the entrance of the voice recognition mode is sensed, changes a shape of the pointer, and attaches the first image to the pointer in a manner of overlaying at least part of the pointer with the changed shape.

11. The apparatus of claim 9 , wherein the hardware controller controls the display to output a visual effect that the first or second image is detached from the pointer or the first or second image to disappear from the screen when the voice recognition mode is released, and
outputs only an indicator corresponding to a selection when a specific object on the screen is selected using the pointer from which the first or second image has disappeared.

12. The apparatus of claim 1 , wherein the hardware controller, when another voice signal is input through the microphone after specific objects are selected using the pointer with the second image attached thereto, controls the display to attach thumbnail images of the selected specific objects to the second image.

13. The apparatus of claim 12 , wherein the hardware controller controls the thumbnail images not to be moved according to the movement of the pointer, and
controls a specific object corresponding to at least one selected thumbnail image to be deselected when the at least one thumbnail image is selected from the thumbnail images using the pointer with the second image attached thereto.

14. The apparatus of claim 12 , wherein the hardware controller controls the display to output thumbnail images of objects for which the second function corresponding to the second voice signal has been executed and thumbnail images of objects for which the second function is to be executed, in a visually distinguishing manner.

15. The apparatus of claim 1 , wherein the hardware controller, when it is recognized that a plurality of functions are included in the first voice signal, generates the first image corresponding to the first function and a third image corresponding to a third function, respectively, and attaches the first and third images to the pointer, and
controls the first and third images to be moved according to the movement of the pointer.

16. The apparatus of claim 15 , wherein the hardware controller controls the first image corresponding to the first function, which is to be executed earlier, to be attached closer to the pointer, and
controls the first image to be detached from the pointer or disappear when the first function is executed, and controls the third image corresponding to the third function, which is to be executed next, to be attached close to the pointer.

17. The apparatus of claim 1 , wherein the hardware controller, when a voice indicating a predetermined function is not included in the first voice signal, generates a text image converted from the first voice signal through voice recognition, as the first image, and
outputs the text image on a specific object when the specific object on the screen is selected using the pointer with the first image attached thereto.

18. The apparatus of claim 1 , wherein when the second voice signal is received, a visual effect that the first image is changed into the second image in a turning manner is output.

19. A method for operating an image display apparatus, the method comprising:
displaying a pointer on a screen of a display of the image display apparatus, the pointer being moved according to a

Assignees

• Lg Electronics Inc

Inventors

• Jang Saehun
• Park Sihwa
• Kim Jungdo
• Kim Hyeonhui
• Choi Jiho
• Yeo Junhee

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/038

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title