Apparatus and method for controlling internet of things devices

Patent metadata

Field	Value
Publication number	US-11409509-B2
Application number	US-201916368185-A
Country	US
Kind code	B2
Filing date	Mar 28, 2019
Priority date	May 28, 2014
Publication date	Aug 9, 2022
Grant date	Aug 9, 2022

Abstract

An electronic device including a memory is disclosed. The memory stores instructions controlling the electronic device to acquire information on a first external electronic device, access a server storing a software program related to the first external electronic device, receive at least a portion of the software program related to the first external electronic device from the server through the communication interface, install the at least a portion of the software program, transmit the at least a portion of the information on the first external electronic device and/or at least one part of the received at least a portion of the software program to a second external electronic device, and provide a user interface to the display using the installed at least a portion of the software program. The user interface is used for the second external electronic device to perform an operation related to the first external electronic device.

First claim

What is claimed is:

1. A system comprising:
a mobile device including:
a first wireless communication interface;
a camera;
a display;
a first non-volatile memory; and
a first processor electrically connected to the first wireless communication interface, the camera, the display, and the first non-volatile memory; and

a media device including:
a second wireless communication interface configured to support a Bluetooth® protocol;
a third wireless communication interface configured to support a wireless fidelity (Wi-Fi) protocol;
a second non-volatile memory;
a wired communication port configured to transmit audio/video (AN) data to a television;
a power connector configured to receive power supply; and
a second processor electrically connected to the second wireless communication interface, the third wireless communication interface, the non-volatile second memory, the wired communication port, and the power connector,
wherein the first non-volatile memory stores instructions that, when executed, cause the mobile device to:
capture an image of a quick response (QR) code associated with an Internet-of-Things (IoT) device using the camera,
obtain information from the image of the QR code,
receive software codes corresponding to the obtained information from a server through the first wireless communication interface,
transmit at least a first portion of the received software codes to the media device,
provide, on the display, a user interface using at least a second portion of the software codes, the user interface being configured control the IoT device,
receive a user input through the user interface provided on the display, and
based on the user input, transmit a control signal to the media device, the control signal being used by the media device for remotely controlling the IoT device.

2. The system of claim 1 , wherein the instructions further cause the mobile device to:
receive, through the first wireless communication interface, information on an application store that provides the software codes associated with the IoT device; and
display at least one image related to the software codes on the display based on the received information on the application store.

3. The system of claim 1 , wherein the instructions further cause the mobile device to:
receive, through the first wireless communication interface, information on an application store that provides the software codes associated with the IoT device;
display at least one category related to the software codes on the display based on the received information on the application store; and
display a plurality of images including an image related to the software codes in response to a user input selecting one of the at least one displayed category.

4. The system of claim 1 , wherein the at least a first portion of the software codes comprises at least one of identification information of the software codes and identification information of the IoT device.

5. The system of claim 1 , wherein the instructions further cause the mobile device to: display a location of the IoT device on the display.

6. A mobile device comprising:
a wireless communication interface;
a camera;
a display;
a processor; and
a memory storing instructions that, when executed by the processor, cause the mobile device to:
capture an image of a quick response (QR) code associated with an Internet-of-Things (IoT) device using the camera,
obtain information from the image of the QR code,
receive software codes corresponding to the obtained information from a server through the wireless communication interface,
transmit at least a first portion of the software codes to an external device,
provide, on the display, a user interface using an at least a second portion of the software codes, the user interface being configured to control the IoT device,
receive a user input through the user interface provided on the display, and
based on the user input, transmit a control signal to the external device, the control signal being used by the external device for remotely controlling the IoT device.

7. The mobile device of claim 6 , wherein the at least a first portion of the software codes comprises at least one of identification information of the software codes or identification information of the IoT device.

8. The mobile device of claim 6 , wherein the instructions further cause the mobile device to display a location of the IoT device on the display.

9. The mobile device of claim 6 , wherein the external device is configured to:
in response to receiving the control signal to control the IoT device via a wireless fidelity (Wi-Fi) communication interface, generate a signal for controlling the IoT device, independently of transmission of audio/video (A/V) data via a wired communication interface.

10. The mobile device of claim 6 ,
wherein the external device is configured to:
transmit, via a wired communication interface, audio/video (A/V) data to a connected display device,
receive the at least a first portion of the software codes from the mobile device, and
in response to the control signal to control the IoT device via the wireless communication interface, generate a signal for controlling the IoT device based on the at least a first portion of the software codes, independently of transmission of the A/V data via the wired communication interface.

11. A system comprising:
a mobile device including:
a first wireless communication interface;
a camera;
a touchscreen display;
a first non-volatile memory; and
a first processor electrically connected to the first wireless communication interface, the camera, the display, and the first non-volatile memory; and

a media device including:
a second wireless communication interface configured to support a Bluetooth®protocol;
a third wireless communication interface configured to support a wireless fidelity (Wi-Fi) protocol;
a second non-volatile memory;
a wired communication port configured to transmit audio/video (A/V) data to a television;
a power connector configured to receive power supply; and
a second processor electrically connected to the second wireless communication interface, the third wireless communication interface, the second non-volatile memory, the wired communication port, and the power connector,
wherein the first non-volatile memory stores instructions that, when executed, cause the first processor to:
scan a quick response (QR) code associated with an Internet-of-Things (IoT) device, using the camera,
access, through the first wireless communication interface, a server that stores a software program related to the IoT device, based on the scanned QR code;
receive at least a portion of the software program from the server, through the first wireless communication interface;
store, on the first non-volatile memory, the at least a portion of the software program received from the server;
transmit at least a first portion of the software program to the media device;
provide an image and text on the display, using at least a second portion of the software program;
receive a user input through the display; and
transmit a signal requesting to control the IoT device via the Internet to the media device, based on the user input, and
wherein the second non-volatile memory stores the at least a first portion of the software program including control software for controlling a plurality of different IoT devices, and instructions that, when executed, cause the second processor to:
independently of transmission of the AN data via the wired communication port, and in response to the signal requesting to control the IoT device via

Assignees

• Samsung Electronics Co Ltd

Inventors

• Yoon Seokhyun

Classifications

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• H04W4/60

  Subscription-based services using application servers or record carriers, e.g. SIM application toolkits · CPC title

• H04L69/18

  Multiprotocol handlers, e.g. single devices capable of handling multiple protocols · CPC title

• H04L12/282

  based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204) · CPC title

• H04L12/2832

  Interconnection of the control functionalities between home networks (single bridge functionality H04L12/4625) · CPC title