Remote state following devices

Patent metadata

Field	Value
Publication number	US-11770501-B2
Application number	US-202117374047-A
Country	US
Kind code	B2
Filing date	Jul 13, 2021
Priority date	Jul 9, 2016
Publication date	Sep 26, 2023
Grant date	Sep 26, 2023

Abstract

A system and method for a remote state following device that includes an electronic device with a controllable operating state; an imaging device; and control system that when targeted at a control interface interprets a visual state from the control interface, and modifies the operating state in coordination with the visual state.

First claim

We claim:

1. A system comprising:
an imaging device that captures image data of an environment;
a control system communicatively coupled to the imaging device and an electronic device, the control system comprising a visually monitored interface control mode with configuration to:
detect a control interface through identification of a pairing identifier of the control interface in the image data,
interpret a visual state of the control interface, and
modulate an operating state of the electronic device in coordination with the visual state.

2. The system of claim 1 ,
wherein configuration to modulate the operating state in coordination with the visual state is restricted to modulate the operating state during detection of the control interface.

3. The system of claim 1 , wherein there are at least two types of detectable control interfaces, and wherein a first type of control interface has a first set of visual states that are mapped to two distinct operating states and a second type of control interface that has a second set of visual states that are mapped to a range of operating states.

4. The system of claim 1 , wherein the control interface is a non-electric element.

5. The system of claim 1 , wherein the control interface comprises at least one interaction region, wherein the interpretation of visual state comprises configuration to detect a user gesture within the interaction region, and wherein the detected gesture and the interaction region map to a targeted operating state.

6. The system of claim 1 , wherein the control system further comprises a pairing mode, wherein during a pairing mode, the control system is configured to detect the pairing identifier in a sub-region of the image data, and upon detection of the pairing identifier, register that sub-region for detection of a control interface.

7. The system of claim 1 , further comprising an ambient activity sensor, and wherein the control system comprises activating the visually monitored interface control mode upon activation of the ambient activity sensor.

8. The system of claim 1 , further comprising a directable housing that at least partially encases the imaging device and couples to the electronic device.

9. The system of claim 1 , wherein the visually monitored interface control mode further comprises configuration to:
detect a second control interface through identification of a second pairing identifier of the control interface in the image data,
interpret a second visual state of the second control interface, and
modulate the operating state of the electronic device in coordination with the visual state and the second visual state.

10. The system of claim 1 , wherein the control interface is a thermometer meter.

11. The system of claim 10 , wherein the configuration to modulate the operating state of the electronic device_in coordination with the visual state modifies a temperature setting of the electronic device.

12. The system of claim 1 , wherein the control interface is graphical display of a user interface.

13. The system of claim 1 , wherein the control interface is a mechanical mechanism with two or more physical states.

14. The system of claim 1 , wherein the interface control mode further comprises configuration to trigger an alert based on the visual state.

15. A method for control of an electronic device comprising:
capturing, using an imaging device, image data of an environment;
at a control system communicatively coupled to the imaging device and the electronic device, detecting a control interface through identification of a pairing identifier of the control interface in the image date;
interpreting a visual state of the control interface; and
modulating an operating state of the electronic device in coordination with the visual state.

16. The method of claim 15 , wherein detecting the control interface through identification of a pairing identifier of the control interface comprises: detecting the pairing identifier in a sub-region of the image data, and upon detecting of the pairing identifier, registering that sub-region for detection of a control interface.

17. The method of claim 15 , wherein the control interface is a thermometer meter; and wherein modulating the_operating state of the electronic device in coordination with the visual state comprises modifying a temperature setting of the electronic device.

18. The method of claim 15 , wherein the control interface is graphical display of a user interface.

19. The method of claim 15 , wherein the control interface is a mechanical mechanism with two or more physical states.

20. The method of claim 15 , wherein interpreting a visual state of the control interface comprises detecting a set of visual physical states of the control interface.

21. The method of claim 15 , wherein interpreting a visual state of the control interface comprises detecting a visual gesture with an interaction region of the control interface.

Assignees

• Grabango Co

Inventors

• Glaser William
• Van Osdol Brian

Classifications

• H05B47/1975

  Gesture control · CPC title

• H05B47/19

  via wireless transmission · CPC title

• H04N7/18 Primary

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• G06F18/213

  Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods · CPC title

• G06V10/245

  by locating a pattern; Special marks for positioning · CPC title