Modular sensing device implementing state machine gesture interpretation

Patent metadata

Field	Value
Publication number	US-2017192518-A1
Application number	US-201615253799-A
Country	US
Kind code	A1
Filing date	Aug 31, 2016
Priority date	Jan 4, 2016
Publication date	Jul 6, 2017
Grant date	—

Abstract

A modular sensing device can include an inertial measurement unit to generate sensor data corresponding to user gestures performed by a user, a mode selector enabling the user to select a mode of the modular sensing device out of a plurality of modes, and one or more output devices to generate output based on the user gestures and the selected mode. The modular sensing device can further include a controller to implement a plurality of state machines. Each state machine can be associated with a corresponding user gesture by a sensor data signature. The state machine can execute a state transition when the sensor data matches the sensor data signature. The executed state transition can cause the controller to generate a corresponding output via the one or more output devices specific to the selected mode and based on the corresponding user gesture.

First claim

What is claimed is:

1 . A modular sensing device comprising:
an inertial measurement unit to generate sensor data corresponding to user gestures performed by a user; a mode selector enabling the user to select a mode of the modular sensing device out of a plurality of modes; one or more output devices to generate output based on the user gestures and the selected mode; and a controller to implement a plurality of state machines, each respective one of the plurality of state machines being associated with a corresponding user gesture by a sensor data signature, wherein the respective state machine executes a state transition when the sensor data matches the sensor data signature, the executed state transition causing the controller to generate a corresponding output via the one or more output devices specific to the selected mode and based on the corresponding user gesture.

2 . The modular sensing device of claim 1 , wherein the respective state machine continuously iterates based on the sensor data from the inertial measurement unit and automatically executes the state transition when the sensor data matches the sensor data signature.

3 . The modular sensing device of claim 1 , wherein the modular sensing device is insertable into a wearable device, and wherein the corresponding user gesture comprises a sequence of actions performed by the user utilizing the wearable device.

4 . The modular sensing device of claim 1 , wherein the state transition of the respective state machine causes the controller to generate distinct outputs based on the selected mode.

5 . The modular sensing device of claim 1 , wherein the corresponding output comprises one or more control commands enabling the user to control a remote controlled device using the modular sensing device.

6 . The modular sensing device of claim 1 , wherein the one or more output devices include a haptic system, an audio system, and a visual system.

7 . The modular sensing device of claim 4 , wherein the controller initiates a sub-mode of the modular sensing device when the user performs a particular user gesture, the sub-mode causing the controller to modify interpretation of the state transition for the selected mode, and wherein the modular sensing device generates the corresponding output based on the modified interpretation.

8 . The modular sensing device of claim 3 , wherein the sensor data signature provides the respective state machine with a threshold error tolerance for each of the sequence of actions.

9 . The modular sensing device of claim 1 , wherein the respective state machine comprises a finite set of states, one or more inputs, one or more outputs, a transition function, and an initial state.

10 . The modular sensing device of claim 1 , wherein the respective state machine comprises a set of states, and wherein each state in the set of states transitions in sequential order in order to cause the state transition.

11 . The modular sensing device of claim 3 , wherein, for a particular iteration, the respective state machine terminates when the corresponding user gesture diverges from the sequence of actions.

12 . The modular sensing device of claim 3 , wherein, for a particular iteration, the respective state machine automatically terminates if one of the set of states does not transition.

13 . The modular sensing device of claim 1 , wherein the controller initiates a second mode, from the plurality of modes of the modular sensing device, when the user performs a specific user gesture.

14 . The modular sensing device of claim 1 , wherein the modular sensing device is configured to be portable and insertable into at least one compatible apparatus.

15 . The modular sensing device of claim 14 , wherein the at least one compatible apparatus comprises a wrist-worn device and a wielded device.

16 . A method of generating outputs based on user gestures, the method being performed by a modular sensing device and comprising:
receiving a mode selection input to select a mode from a plurality of selectable modes; in response to the mode selection input, utilize a plurality of state machines to interpret user gestures in accordance with the selected mode, each respective one of the plurality of state machines being associated with a corresponding user gesture by a sensor data signature, wherein the respective state machine executes a state transition when the sensor data matches the sensor data signature; and in response to the executed state transition, generating a corresponding output via one or more output devices of the modular sensing device specific to the selected mode and based on the corresponding user gesture.

17 . The method of claim 16 , wherein the selected mode comprises a drive mode, the drive mode enabling the user to control a self-propelled device with the modular sensing device.

18 . The method of claim 16 , wherein the selected mode comprises a smart home control mode, the smart home control mode enabling the user to control at least one smart home device using the modular sensing device.

19 . The method of claim 16 , wherein the selected mode comprises a gaming mode, the gaming mode causing the modular sensing device to output task-oriented instructions for the user to perform in connection with a game.

20 . The method of claim 16 , wherein the one or more output devices include a haptic driver, one or more light elements, and one or more audio elements.

Assignees

• Sphero Inc

Inventors

• Hygh David
• Polo Fabrizio

Classifications

• A63F13/28

  responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light · CPC title

• A63H23/04

  Self-propelled boats, ships or submarines · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• A63H27/12

  Helicopters (A63H27/04 takes precedence); Flying tops · CPC title