Discovery of and connection to remote devices

Patent metadata

Field	Value
Publication number	US-12567322-B2
Application number	US-202418744965-A
Country	US
Kind code	B2
Filing date	Jun 17, 2024
Priority date	May 21, 2019
Publication date	Mar 3, 2026
Grant date	Mar 3, 2026

Abstract

A method includes receiving a signal that indicates a location of a control device that is configured to change an operating state of a controlled device. The method also includes identifying a first visible device and a second visible device in one or more images, matching the first visible device with the control device based on a location of the first visible device matching the location of the control device, matching the second visible device with the controlled device, pairing the control device with a host device, and controlling the control device using the host device to change the operating state of the controlled device.

First claim

What is claimed is:

1 . A method, comprising:
receiving a signal that indicates a location of a control device, wherein the control device is configured to change an operating state of a controlled device; identifying a first visible device and a second visible device in one or more images; matching the first visible device with the control device based on a location of the first visible device matching the location of the control device; matching the second visible device with the controlled device; pairing the control device with a host device; and controlling the control device using the host device to change the operating state of the controlled device.

2 . The method of claim 1 , wherein matching the second visible device with the controlled device comprises:
changing the operating state of the controlled device using the control device; and detecting a change of an operating state of the second visible device in the one or more images.

3 . The method of claim 1 , wherein matching the second visible device with the controlled device is based on a user input that identifies the controlled device.

4 . The method of claim 1 , wherein the signal further indicates a device type for the control device, and matching the first visible device with the control device is further based on the device type for the control device matching a device type for the first visible device.

5 . The method of claim 4 , wherein the device type for the control device is a switch and the controlled device is a light.

6 . The method of claim 5 , wherein matching the first visible device with the control device is further based on a visible output of the control device that is recognized in the one or more images.

7 . The method of claim 1 , wherein the one or more images are captured using an imaging device that is associated with the host device.

8 . The method of claim 1 , further comprising:
defining an association between the control device and the controlled device to enable the host device to change the operating state of the controlled device.

9 . A non-transitory computer-readable storage device including program instructions executable by one or more processors that, when executed, cause the one or more processors to perform operations, the operations comprising:
receiving a signal that indicates a location of a control device, wherein the control device is configured to change an operating state of a controlled device; identifying a first visible device and a second visible device in one or more images; matching the first visible device with the control device based on a location of the first visible device matching the location of the control device; matching the second visible device with the controlled device; pairing the control device with a host device; and controlling the control device using the host device to change the operating state of the controlled device.

10 . The non-transitory computer-readable storage device of claim 9 , wherein matching the second visible device with the controlled device comprises:
changing the operating state of the controlled device using the control device; and detecting a change of an operating state of the second visible device in the one or more images.

11 . The non-transitory computer-readable storage device of claim 9 , wherein matching the second visible device with the controlled device is based on a user input that identifies the controlled device.

12 . The non-transitory computer-readable storage device of claim 9 , wherein the signal further indicates a device type for the control device, and matching the first visible device with the control device is further based on the device type for the control device matching a device type for the first visible device.

13 . The non-transitory computer-readable storage device of claim 12 , wherein the device type for the control device is a switch and the controlled device is a light.

14 . The non-transitory computer-readable storage device of claim 13 , wherein matching the first visible device with the control device is further based on a visible output of the control device that is recognized in the one or more images.

15 . The non-transitory computer-readable storage device of claim 9 , wherein the one or more images are captured using an imaging device that is associated with the host device.

16 . The non-transitory computer-readable storage device of claim 9 , wherein the operations further comprise:
defining an association between the control device and the controlled device to enable the host device to change the operating state of the controlled device.

17 . A system, comprising:
a memory; and one or more processors that are configured to execute instructions that are stored in the memory, wherein the instructions, when executed, cause the one or more processors to: receive a signal that indicates a location of a control device, wherein the control device is configured to change an operating state of a controlled device; identify a first visible device and a second visible device in one or more images; match the first visible device with the control device based on a location of the first visible device matching the location of the control device; match the second visible device with the controlled device; pair the control device with a host device; and control the control device using the host device to change the operating state of the controlled device.

18 . The system of claim 17 , wherein the instructions that cause the one or more processors to match the second visible device with the controlled device further cause the one or more processors to:
change the operating state of the controlled device using the control device; and detect a change of an operating state of the second visible device in the one or more images.

19 . The system of claim 17 , wherein the instructions that cause the one or more processors to match the second visible device with the controlled device further cause the one or more processors to obtain a user input that identifies the controlled device.

20 . The system of claim 17 , wherein the signal further indicates a device type for the control device, and matching the first visible device with the control device is further based on the device type for the control device matching a device type for the first visible device.

21 . The system of claim 20 , wherein the device type for the control device is a switch and the controlled device is a light.

22 . The system of claim 21 , wherein the instructions that cause the one or more processors to match the first visible device with the control device further cause the one or more processors to recognize a visible output of the control device in the one or more images.

23 . The system of claim 17 , wherein the one or more images are captured using an imaging device that is associated with the host device.

24 . The system of claim 17 , wherein the instructions, when executed, further cause the one or more processors to:
define an association between the control device and the controlled device to enable the host device to change the operating state of the controlled device.

Assignees

• Apple Inc

Inventors

• Norris Jeffrey S
• Sommer Bruno M
• Da Veiga Alexandre

Classifications

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• H04W8/005

  Discovery of network devices, e.g. terminals · CPC title

• G08C2201/31

  Voice input · CPC title

• G06V10/22

  by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition · CPC title

• H04W76/10

  Connection setup · CPC title