Portable terminal device and method for operating the same

Patent metadata

Field	Value
Publication number	US-10278064-B2
Application number	US-201715681928-A
Country	US
Kind code	B2
Filing date	Aug 21, 2017
Priority date	Aug 10, 2012
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

A portable terminal device and a method for operating the same are provided. The portable terminal device includes a communicator configured to perform communication with an external device, a display configured to display a same image as an image displayed on the external device, an inputter configured to receive an input of a selection command, and a controller configured to perform an operation corresponding to an object included in the image at a time when the selection command is input.

First claim

What is claimed is:

1. A terminal device comprising:
a communicator configured to communicate with an external device;
a display; and
at least one processor configured to:
control the communicator to receive, from the external device, an image being displayed on the external device and control the display to display the received image, and
in response to a selection command to select an object included in the displayed image being input, control the display to display a task execution menu comprising a menu corresponding to the object, and,
in response to a selection command to select the menu being input:
determine a type of the object, and
perform an operation corresponding to the object,

wherein the at least one processor is configured to recognize and distinguish between image object types and text object types, and
wherein the menu varies depending on the type of the object recognized by the at least one processor in the displayed image.

2. The terminal device of claim 1 , wherein when the selected object comprises a phone number, the at least one processor is further configured to perform a call using the phone number.

3. The terminal device of claim 1 , wherein when the selected object comprises a text or an image, the at least one processor is further configured to:
perform a search for the text or the image, and
control the display to display a result of the search.

4. The terminal device of claim 1 , further comprising:
a storage,
wherein, when the selection command is input, the at least one processor is further configured to:
capture the image, and
store the captured image in the storage.

5. The terminal device of claim 4 , wherein the at least one processor is further configured to:
control the display to display a task execution menu including the captured image and a menu corresponding to the object, and
in response to a selection command to select the menu being input, perform an operation corresponding to the menu.

6. The terminal device of claim 5 , wherein the at least one processor is further configured to:
control the display to display the task execution menu including a search menu when the object included in the captured image comprises a search window, and
in response to the selection command to select the search menu being input, control the display to display a result for a text included in the search window.

7. The terminal device of claim 5 , wherein the at least one processor is further configured to:
display the task execution menu including a call connection menu when the object included in the captured image comprises a phone number, and
in response to the selection command to select the call connection menu being input, perform a call using the phone number.

8. The terminal device of claim 5 , wherein the at least one processor is further configured to:
display the task execution menu including a search menu for an image or a text when the object included in the captured image comprises the image or the text, and
in response to the selection command to select the search menu being input, perform a search for the image or the text and control the display to display a result of the search.

9. The terminal device of claim 4 , wherein the at least one processor is further configured to:
display a plurality of captured images, stored in the storage, according to a user command, and
in response to one of the plurality of captured images being selected, display the selected captured image and menu corresponding to an object included in the selected captured image.

10. The terminal device of claim 4 , wherein the at least one processor is further configured to automatically delete, from the storage, the captured image that exceeds a predetermined period based on storage history information of the captured image stored in the storage.

11. A method for controlling a terminal device that communicates with an external device, the method comprising:
displaying an image being displayed on the external device;
receiving a selection command to select an object included in the displayed image;
displaying a task execution menu comprising a menu corresponding to the object;
determining, using at least one processor of the terminal device, a type of the object and distinguishing between different type of objects, and
in response to a selection command to select the menu being input, performing an operation corresponding to the object,
wherein the different object types in the displayed image capable of being determined and distinguished between include an image object type and a text object type, and
wherein the menu varies depending on the type of the object recognized by the at least one processor in the displayed image.

12. The method of claim 11 , wherein the performing comprises when the selected object comprises a phone number, performing a call using the phone number.

13. The method of claim 11 , wherein the performing comprises when the selected object comprises a text or an image, performing a search for the text or the image and displaying a result of the search.

14. The method of claim 11 , further comprising when the selection command is input, capturing the image and storing the captured image.

15. The method of claim 14 , wherein the performing comprises:
displaying a task execution menu including the captured image and a menu corresponding to the object; and
in response to a selection command to select the menu being input, performing an operation corresponding to the menu.

16. The method of claim 15 , wherein the performing comprises:
displaying the task execution menu including a search menu when the object included in the captured image comprises a search window; and
in response to the selection command to select the search menu being input, displaying a result for a text included in the search window.

17. The method of claim 15 , wherein the performing comprises:
displaying the task execution menu including a call connection menu when the object included in the captured image comprises a phone number; and
in response to the selection command to select the call connection menu being input, performing a call using the phone number.

18. The method of claim 15 , wherein the performing comprises:
displaying the task execution menu including a search menu for an image or a text when the object included in the captured image comprises the image or the text; and
in response to the selection command to select the search menu being input, performing performs a search for the image or the text and displaying a result of the search.

19. The method of claim 14 , further comprising:
displaying a plurality of pre-stored captured images, according to a user command; and
in response to one of the plurality of captured images being selected, displaying the selected captured image and menu corresponding to an object included in the selected captured image.

20. The method of claim 14 , further comprising automatically deleting the captured image that exceeds a predetermined period based on storage history information of pre-stored captured images.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Do-Hyoung
• Lee Sang-Il
• Rhee Taik-Heon
• Kang Seong-Hoon
• Kuk Sung-Bin
• Eun Dong-Jin
• Jung Min-Kyu

Classifications

• H04N21/8133

  specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme · CPC title

• H04N21/4122

  additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423) · CPC title

• H04W8/24 Primary

  Transfer of terminal data · CPC title

• H04N21/8153

  comprising still images, e.g. texture, background image · CPC title

• H04N21/4722

  for requesting additional data associated with the content · CPC title