Air writing and gesture system with interactive wearable device

Patent metadata

Field	Value
Publication number	US-10055563-B2
Application number	US-201615074003-A
Country	US
Kind code	B2
Filing date	Mar 18, 2016
Priority date	Apr 15, 2015
Publication date	Aug 21, 2018
Grant date	Aug 21, 2018

Abstract

A wearable device interactive system and techniques, methods and apparatuses thereof are described. A wearable device may sense a movement by a user wearing the wearable device. The wearable device may also determine whether a path of the movement corresponds to one or more predefined patterns. The wearable device may further perform one or more operations in response to a determination that the path of the movement corresponds to at least one of the one or more predefined patterns.

First claim

What is claimed is:

1. A method, comprising:
detecting, by a processor of a wearable device, a presence of a remote device in a vicinity of the wearable device;
determining, by the processor, whether an authentication is successful with respect to the remote device; and
triggering, by the processor, the remote device to perform one or more operations responsive to a determination that the authentication is successful with respect to the remote device by wirelessly communicating with the remote device,
wherein the determining of whether the authentication is successful with respect to the remote device comprises:
detecting a movement;
analyzing a path of the movement; and
determining that the authentication is successful responsive to a result of the analyzing indicating that the path of the movement resembles a predefined pattern indicating that the authentication is successful,

wherein the detecting of the movement comprises:
receiving, from an image sensor of the wearable device, data indicative of a movement of the wearable device; and

recognizing one or more motion vectors through a stream of image frames sensed by the image sensor to identify one or more air gestures performed by the user,
wherein the performing of the one or more operations comprises:
obtaining, from one or more image sensors of the wearable device, a visual image of a hand and one or more objects;
identifying a protrusion from the hand in the visual image;
determining an object among the one or more objects being pointed by the protrusion; and
rendering a transaction to purchase another object similar to the object.

2. The method of claim 1 , wherein the detecting of the movement further comprises receiving data indicative of a movement of the wearable device from an accelerometer, a gyro sensor, or a combination thereof.

3. The method of claim 1 , wherein the determining of whether the authentication is successful with respect to the remote device further comprises:
receiving a voice command;
analyzing a voice in the voice command; and
determining that the authentication is successful responsive to a result of the analyzing indicating the voice in the voice command being recognized as a prerecorded voice.

4. The method of claim 1 , wherein the determining of whether the authentication is successful with respect to the remote device further comprises:
monitoring a heart rate;
analyzing a variation in the heart rate; and
determining that the authentication is successful responsive to the variation in the heart rate matching a pre-recorded variation in the heart rate based on a result of the analyzing.

5. A method, comprising:
receiving, by a processor of a wearable device, data from one or more sensors of the wearable device;
determining, by the processor, whether an authentication is successful with respect to the wearable device; and
performing, by the processor responsive to a determination that the authentication is successful, one or more operations in response to the received data,
wherein the one or more sensors comprise at least one image sensor,
wherein the one or more operations comprise either or both of:
detecting an air gesture performed by a user of the wearable device represented by a movement of the wearable device based on one or more motion vectors indicated in a stream of image frames sensed by the at least one image sensor; and
rendering a transaction to purchase an object similar to another object in a visual image sensed by the at least one image sensor, and

wherein the determining of whether the authentication is successful with respect to the wearable device comprises:
detecting a movement;
analyzing a path of the movement; and
determining that the authentication is successful responsive to a result of the analyzing indicating that the path of the movement resembles a predefined pattern indicating that the authentication is successful.

6. The method of claim 5 , wherein at least one sensor of the one or more sensors further comprises a microphone, wherein the receiving of the data from the one or more sensors comprises receiving audible data from the microphone, and wherein the performing of the one or more operations comprises:
determining that the audible data comprises a voice command; and
initiating an authentication process responsive to the voice command.

7. The method of claim 5 , wherein at least one sensor of the one or more sensors further comprises a gyro sensor, wherein the receiving of the data from the one or more sensors comprises receiving gyro data indicative of a vibration sensed by the gyro sensor, and wherein the performing of the one or more operations comprises:
recording the gyro data; and
transmitting the gyro data to a remote device such that the vibration is reproduced by the remote device.

8. The method of claim 5 , wherein at least one sensor of the one or more sensors further comprises a thermal sensor, wherein the receiving of the data from the one or more sensors comprises receiving thermal data from the thermal sensor, and wherein the performing of the one or more operations comprises:
determining a temperature indicated by the thermal data; and
performing at least one of a plurality of tasks, the plurality of tasks comprising:
presenting the temperature audibly, visually, or both audibly and visually;
transmitting information indicative of the temperature to a remote device;
determining whether the temperature exceeds a threshold; and
transmitting a warning message to the remote device or presenting a warning message audibly, visually, or both audibly and visually responsive to a determination that the temperature exceeds the threshold.

9. The method of claim 5 , wherein at least one sensor of the one or more sensors further comprises a pressure sensor, wherein the receiving of the data from the one or more sensors comprises receiving pressure data from the pressure sensor, and wherein the performing of the one or more operations comprises:
determining an altitude of the wearable device based on the pressure data; and
presenting information indicating the altitude audibly, visually, or both audibly and visually.

10. The method of claim 5 , wherein at least one sensor of the one or more sensors further comprises one or more ultrasonic transducers, wherein the receiving of the data from the one or more sensors comprises receiving ultrasonic data from the one or more ultrasonic transducers, and wherein the performing of the one or more operations comprises:
generating a depth map using the ultrasonic data; and
determining a spatial relationship between an object and the one or more ultrasonic transducers based at least in part on the depth map.

11. The method of claim 5 , wherein at least one sensor of the one or more sensors further comprises one or more light sensors, wherein the receiving of the data from the one or more sensors comprises receiving lighting data from the one or more light sensors, and wherein the performing of the one or more operations comprises:
generating a depth map using the lighting data; and
determining a spatial relationship between an object and the one or more light sensors based at least in part on the depth map.

12. An apparatus, comprising:
one or more sensors comprising at least one image sensor; and
a processor coupled to receive sensor data from the one or more sensors, the processor configured to perform operations comprising:
detecting an air gesture performed by a user of the apparatus represented by a movement of the apparatus based on one or more motion vectors indicated in a stream of image frames sensed by the at least one imag

Assignees

• Mediatek Inc

Inventors

• Huang Yu-Hao
• Chang Chih-Kai
• Chen Chun-Chia
• Liu Tsu-Ming

Classifications

• G06V10/80

  Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level (multimodal speaker identification or verification G10L17/10) · CPC title

• G06F18/25

  Fusion techniques · CPC title

• G06K9/6288

  Physics · mapped topic

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G06F21/316

  by observing the pattern of computer usage, e.g. typical user behaviour · CPC title