Smart home control using modular sensing device

Patent metadata

Field	Value
Publication number	US-9939913-B2
Application number	US-201615253790-A
Country	US
Kind code	B2
Filing date	Aug 31, 2016
Priority date	Jan 4, 2016
Publication date	Apr 10, 2018
Grant date	Apr 10, 2018

Abstract

A modular sensing device and method of operating a smart home device includes initiating a control mode from a plurality of modes on the modular sensing device, where the control mode determines a manner in which user gestures are interpreted. Based on initiating the control mode, a connection with the smart home device can be established. Furthermore, the modular sensing device and method can further include receiving sensor data corresponding to the user gestures, translating the sensor data into a corresponding control command, and transmitting the control command to the smart home device. The corresponding control command can be executable to control the smart home device in accordance with the user gesture.

First claim

What is claimed is:

1. A method of operating a smart home device, the method being performed by a modular sensing device comprising:
initiating a control mode from a plurality of modes on the modular sensing device, the control mode configured to determine a manner in which user gestures are interpreted, wherein initiating the control mode comprises at least one of:
upon detecting an inductive pairing between the modular sensing device and the smart home device, automatically initiating the control mode in response to the inductive pairing; and
upon detecting execution of an application associated with the smart home device, automatically initiating the control mode in response to the execution of the application;

based on initiating the control mode, establishing a connection with the smart home device;
receiving sensor data, via an inertial measurement unit of the modular sensing device, corresponding to the user gestures;
translating the sensor data into a corresponding control command, the corresponding control command being executable to control the smart home device in accordance with the user gesture; and
transmitting the control command to the smart home device.

2. The method of claim 1 ,
wherein establishing the connection with the smart home device comprises establishing a relayed connection with the smart home device through the computing device in response to the execution of the application.

3. The method of claim 2 , wherein the control command is transmitted to the smart home device via the relayed connection through the computing device executing the application, the application configured to control the smart home device.

4. The method of claim 1 , wherein the smart home device comprises a home device operable by wireless signals, including at least one of a home appliance, temperature system, lighting system, or an audio system.

5. The method of claim 1 , wherein the control command is transmitted directly to the smart home device.

6. The method of claim 1 , wherein the control command is operable to control at least one adjustable parameter on the smart home device.

7. A modular sensing device comprising:
an inertial measurement unit to generate sensor data corresponding to user gestures performed by a user;
a wireless communication module to establish a communication link with a smart home device;
a mode selector to select a control mode from a plurality of modes on the modular sensing device, the control mode to configure a manner in which the user gestures are interpreted, wherein selecting the control mode comprises at least one of:
upon detecting an inductive pairing between the modular sensing device and the smart home device, automatically initiating the control mode in response to the inductive pairing; and
upon detecting execution of an application associated with the smart home device, automatically initiating the control mode in response to the execution of the application; and

a controller to execute the control mode causing the controller to:
translate the sensor data to generate control commands based on the user gestures, the control commands being executable to operate the smart home device; and
transmit the control commands to the smart home device over the communication link.

8. The modular sensing device of claim 7 , wherein the control commands are operable to control at least one adjustable parameter on the smart home device.

9. The modular sensing device of claim 7 , further comprising:
an inductive interface;
wherein the control mode further causes the controller to:
detect, via the inductive interface, an inductive pairing between the modular sensing device and the smart home device;
wherein the wireless communication module establishes the communication link with the smart home device in response to the inductive pairing.

10. The modular sensing device of claim 7 , wherein the wireless communication module comprises a BLUETOOTH low energy module.

11. The modular sensing device of claim 7 , wherein the wireless communication module establishes the communication link with the smart home device in response to the user initiating an execution of an application associated with the smart home device on a computing device, and wherein the controller establishes the communication link with the smart home device by establishing a relayed connection with the smart home device through the computing device in response to the execution of the application.

12. The modular sensing device of claim 11 , wherein the control commands are transmitted to the smart home device via the relayed connection with the computing device executing the application, the application configured to control the smart home device.

13. The modular sensing device of claim 7 , wherein the controller transmits the control commands directly to the smart home device via the communication link.

14. The modular sensing device of claim 7 , wherein the controller implements a plurality of state machines, each respective state machine being associated with a corresponding user gesture that, when performed by the user, causes a state transition by the respective state machine, and wherein the state transition of the respective state machine causes the modular sensing device to generate a corresponding control command, executable to operate the smart home device, based on the corresponding user gesture.

15. A non-transitory computer-readable medium storing instructions for operating a smart home device with a modular sensing device, wherein the instructions, when executed by one or more processors of the modular sensing device, cause the one or more processors to:
initiate a control mode from a plurality of modes on the modular sensing device, the control mode configured to determine a manner in which user gestures are interpreted, wherein initiating the control mode comprises at least one of:
upon detecting an inductive pairing between the modular sensing device and the smart home device, automatically initiating the control mode in response to the inductive pairing; and upon detecting execution of an application associated with the smart home device, automatically initiating the control mode in response to the execution of the application;

based on initiating the control mode, establishing a connection with the smart home device;
receiving sensor data, via an inertial measurement unit of the modular sensing device, corresponding to the user gestures;
translating the sensor data into a corresponding control command, the corresponding control command being executable to control the smart home device in accordance with the user gesture; and
transmitting the control command to the smart home device.

16. The non-transitory computer-readable medium of claim 15 , wherein the smart home device comprises a home device operable by wireless signals, including at least one of a home appliance, temperature system, lighting system, or an audio system.

17. The non-transitory computer-readable medium of claim 15 , wherein establishing the connection with the smart home device comprises establishing a relayed connection with the smart home device through the computing device in response to the execution of the application.

18. The non-transitory computer-readable medium of claim 17 , wherein the control command is transmitted to the smart home device via the relayed connection through the computing device executing the application, the application configured to control the smart home device.

19. The non-transitory computer-read

Assignees

• Sphero Inc

Inventors

• Carroll Jonathan
• Berberian Paul

Classifications

• A63H27/12

  Helicopters (A63H27/04 takes precedence); Flying tops · CPC title

• G06F3/02

  Input arrangements using manually operated switches, e.g. using keyboards or dials · CPC title

• G08C2201/32

  Remote control based on movements, attitude of remote control device · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• H04L12/2803

  Home automation networks · CPC title