Display terminal device connectable to external display device and method therefor

Patent metadata

Field	Value
Publication number	US-9582903-B2
Application number	US-201313937579-A
Country	US
Kind code	B2
Filing date	Jul 9, 2013
Priority date	Jul 30, 2012
Publication date	Feb 28, 2017
Grant date	Feb 28, 2017

Abstract

The present invention is to maintain the viewability of display without impairing operability on a terminal side, even when the details of a touch operation performed on a display terminal device are transmitted to an external display device for display. In the present invention, when a touch operation is detected in an external transmission mode, the display terminal device generates details of a composite screen obtained by superimposing operation information (operation icon or animation image) indicating details of the touch operation on contents being displayed on the display screen (terminal screen), and transmits the contents of the composite screen to the external display device so as to change display contents on the external display device (display contents on its screen).

First claim

What is claimed is:

1. A display terminal device having a display screen on which a touch operation can be performed at an arbitrary point, the display terminal device comprising:
a controlling section which performs control to display, on the display screen, first screen information for the display screen, and to generate second screen information identical to the first screen information and transmit the generated second screen information to an external display device;
a judging section which, when a gesture operation by a finger performing an arbitrary touch operation is detected on a point on the display screen on which the first screen information is being displayed, detects the point of the touch operation on the display screen, and judges which gesture operation type, from among a plurality of gesture operation types prepared in advance including at least a pinch-out operation type and a flick operation type, an operation type of operation contents of the gesture operation on the display screen corresponds to; and
a superimposing section which selects a pinch-out operation imaging image representing, as a gesture image, a pinch-out operation by a gesture by fingers of a hand if the judged gesture operation type is the pinch-out operation type, and selects a flick operation imaging image representing, as a gesture image, a flick operation by a gesture by fingers of a hand if the judged gesture operation type is the flick operation type, and superimposes the selected operation imaging image near the detected point of the touch operation on the second screen information,
wherein, when the gesture operation is detected, the controlling section performs control to transmit, to the external display device, composite second screen information obtained by superimposing the operation imaging image on the second screen information, without changing display contents of the first screen information being displayed on the display screen.

2. The display terminal device according to claim 1 , further comprising a storage section which stores, as the operation imaging image, a different operation animation image representing a different gesture operation in association with each of the plurality of gesture operation types,
wherein the superimposing section superimposes a stored operation animation image corresponding to the judged gesture operation type on the second screen information.

3. The display terminal device according to claim 1 , wherein, when the external display device is connected to the display terminal device, the controlling section performs control to generate the second screen information or the composite second screen information and transmit the generated second screen information or the generated composite second screen information to the connected external display device.

4. The display terminal device according to claim 3 , wherein the controlling section judges whether the external display device connected to the display terminal device is a specified external display device specified in advance, and, when it is judged that a specified external display device is connected to the display terminal device, the controlling section performs control to generate the second screen information or the composite second screen information and to transmit the generated second screen information or the obtained composite second screen information to the connected external display device.

5. The display terminal device according to claim 1 , wherein, when the display terminal device is set in an external transmission mode, the controlling section performs control to generate the second screen information or the composite second screen information and transmit the generated second screen information or the generated composite second screen information to the connected external display device.

6. The display terminal device according to claim 1 , wherein, when a predetermined time has elapsed after detecting the touch operation, the controlling section controls the external display device such that display contents being displayed on the external display device becomes identical to display contents being displayed on the display screen of the display terminal device.

7. A method for a display terminal device having a display screen on which a touch operation can be performed at an arbitrary point, the method comprising:
performing control to display, on the display screen, first screen information for the display screen, and to generate second screen information identical to the first screen information and transmit the generated second screen information to an external display device;
when a gesture operation by a finger performing an arbitrary touch operation is detected on a point on the display screen on which the first screen information is being displayed, detecting the point of the touch operation on the display screen, and judging which gesture operation type, from among a plurality of gesture operation types prepared in advance including at least a pinch-out operation type and a flick operation type, an operation type of operation contents of the gesture operation on the display screen corresponds to; and
selecting a pinch-out operation imaging image representing, as a gesture image, a pinch-out operation by a gesture by fingers of a hand if the judged gesture operation type is the pinch-out operation type, and selecting a flick operation imaging image representing, as a gesture image, a flick operation by a gesture by fingers of a hand if the judged gesture operation type is the flick operation type, and superimposing the selected operation imaging image near the detected point of the touch operation on the second screen information,
wherein, when the gesture operation is detected, control is performed to transmit, to the external display device, composite second screen information obtained by superimposing the operation imaging image on the second screen information, without changing display contents of the first screen information being displayed on the display screen.

Assignees

• Casio Computer Co Ltd

Inventors

• Hirotani Takayuki

Classifications

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06F3/01 Primary

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F2203/04801

  Cursor retrieval aid, i.e. visual aspect modification, blinking, colour changes, enlargement or other visual cues, for helping user do find the cursor in graphical user interfaces · CPC title