Method and apparatus for identifying a device from a camera input

Patent metadata

Field	Value
Publication number	US-10855899-B2
Application number	US-201916454962-A
Country	US
Kind code	B2
Filing date	Jun 27, 2019
Priority date	Jan 20, 2011
Publication date	Dec 1, 2020
Grant date	Dec 1, 2020

Abstract

A method of controlling a device is provided including identifying a registered device from a screen input by a camera, receiving a user input for the identified device, and transmitting a control command corresponding to the input to the identified device.

First claim

What is claimed is:

1. A method for controlling an external device, the method performed by an electronic device and comprising:
obtaining, by a camera of the electronic device, an image including a first external device connected to the electronic device;
comparing the image including the first external device with images stored in a memory of the electronic device;
identifying the first external device as a registered device based on the image including the first external device;
receiving, from the first external device, first metadata of first contents stored in the first external device;
displaying the image including the first external device on the electronic device;
displaying first visual objects corresponding to the first contents around the first external device included in the image on the electronic device, based on the first metadata of the first contents;
receiving, from a second external device, second metadata of second contents stored in the second external device, wherein the second external device is included in the image;
displaying second visual objects corresponding to the second contents stored in the second external device on the electronic device, based on the second metadata of the second contents;
displaying third visual objects corresponding to third contents stored in the electronic device on the electronic device;
receiving a first user input to drag one of the first visual objects to a predetermined region corresponding to the electronic device;
receiving, from the first external device, one of the first contents corresponding to the dragged one of the first visual objects;
receiving a second user input to drag one of the second visual objects to the first external device included in the image;
transmitting, to the first external device, information for reproducing one of the second contents corresponding to the dragged one of the second visual objects;
receiving a third user input to drag one of the third visual objects to the first external device included in the image; and
transmitting, to the first external device, one of the third contents corresponding to the dragged one of the third visual objects.

2. The method of claim 1 , wherein the transmitted one of the third contents is reproduced by the first external device.

3. The method of claim 1 , further comprising:
transmitting an address of the one of the third contents to the first external device.

4. The method of claim 1 , wherein the first external device is at least one of a television, a laptop, and a refrigerator.

5. The method of claim 1 , wherein the first visual objects comprise at least one of content thumbnails, and content file names.

6. The method of claim 1 , wherein the first user input is a drag and drop input.

7. The method of claim 6 , wherein a content address is extracted based on the dropped one of the first visual objects.

8. An electronic apparatus comprising:
a camera;
a display;
a memory;
a communication interface; and
at least one processor in operative communication with the camera, the display, the memory, and the communication interface, the at least one processor configured to control to:
control the camera to obtain an image including a first external device connected to the electronic device;
compare the image including the first external device with images stored in the memory;
identify the first external device as a registered device based on the image including the first external device;
control the communication interface to receive, from the first external device, first metadata of first contents stored in the first external device;
control the display to display the image including the first external device;
control the display to display first visual objects corresponding to the first contents around the first external device included in the image, based on the first metadata of the first contents;
control the communication interface to receive, from a second external device, second metadata of second contents stored in the second external device, wherein the second external device is included in the image;
control the display to display second visual objects corresponding to the second contents stored in the second external device connected to the electronic device, based on the second metadata of the second contents;
control the display to display third visual objects corresponding to third contents stored in the electronic device;
receive a first user input to drag one of the first visual objects to a predetermined region corresponding to the electronic device;
control the communication interface to receive, from the first external device, one of the first contents corresponding to the dragged one of the first visual objects;
receive a second user input to drag one of the second visual objects to the first external device included in the image;
control the communication interface to transmit, to the first external device, information for reproducing one of the second contents corresponding to the dragged one of the second visual objects;
receive a third user input to drag one of the third visual objects to the first external device included in the image; and
control the communication interface to transmit, to the first external device, one of the third contents corresponding to the dragged one of the third visual objects.

9. The electronic apparatus of claim 8 , wherein the transmitted one of the third contents is reproduced by the first external device.

10. The electronic apparatus of claim 8 , wherein the at least one processor is further configured to control the communication interface to transmit an address of the one of the third contents to the first external device.

11. The electronic apparatus of claim 8 , wherein the first external device is at least one of a television, a laptop, and a refrigerator.

12. The electronic apparatus of claim 8 , wherein the first visual objects comprise at least one of content thumbnails, content metadata, and content file names.

13. The electronic apparatus of claim 8 , wherein the first user input is a drag and drop input.

14. The electronic apparatus of claim 13 , wherein a content address is extracted based on the dropped one of the first visual objects.

15. A computer program product comprising a computer readable storage medium having recorded thereon a computer program for executing a method for controlling an external device, the method performed by an electronic device and comprising:
obtaining, by a camera of the electronic device, an image including a first external device connected to the electronic device;
comparing the image including the first external device with images stored in a memory of the electronic device;
identifying the first external device as a registered device based on the image including the first external device;
receiving, from the first external device, first metadata of first contents stored in the first external device;
displaying the image including the first external device on the electronic device;
displaying first visual objects corresponding to the first contents around the first external device included in the image on the electronic device, based on the first metadata of the first contents;
receiving, from a second external device, second metadata of second contents stored in the second external device, wherein the second external device is included in the image;
displaying second visual objects corresponding to the second contents stored in the second external device on the electronic device, based on the second metadata of the second contents;
d

Assignees

• Samsung Electronics Co Ltd

Inventors

• Eun Dong-Jin
• Kim Hark-Joon
• Kang Seong-Hoon

Classifications

• H04N21/42204 Primary

  User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205) · CPC title

• H04N23/62 Primary

  Control of parameters via user interfaces · CPC title

• H04N21/41265

  having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204) · CPC title

• H04N21/4402

  involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)} · CPC title

• H04N21/436

  Interfacing a local distribution network, e.g. communicating with another STB {or one or more peripheral devices} inside the home · CPC title