Mobile device environment detection using an audio sensor and a reference signal

Patent metadata

Field	Value
Publication number	US-9736782-B2
Application number	US-201514708376-A
Country	US
Kind code	B2
Filing date	May 11, 2015
Priority date	Apr 13, 2015
Publication date	Aug 15, 2017
Grant date	Aug 15, 2017

Abstract

A mobile device configured to modify the mobile device's behavior based on the local environment of the mobile device. The mobile device determines the local environment based on a comparison of sound detected by the mobile device's audio sensor to sound detected by an exterior audio sensor. In particular, the mobile device determines if it is covered and, if covered, the mobile device determines properties of the covering material.

First claim

The invention claimed is:

1. A mobile device configured to determine a local environment of the mobile device, the mobile device comprising:
a device audio sensor configured to detect sound waves; and
a processor configured to:
determine a variation between the detected sound waves and a reference signal;
determine the local environment of the mobile device based on the determined variation;
detect if the local environment of the mobile device is a covered environment or an uncovered environment;
determine that the mobile device is covered if the variation between the sound frequency profile outside the local environment and the device sound frequency profile is greater than a predetermined threshold variation; and
modify a behavior of the mobile device based on the determined local environment; and

a communication interface configured to receive a sound frequency profile outside the local environment, wherein:
the device audio sensor is configured to output a device sound frequency profile representing sound from the local environment of the mobile device detected by the device audio sensor and the reference signal comprises the sound frequency profile outside the local environment.

2. A mobile device configured to determine a local environment of the mobile device, the mobile device comprising:
a device audio sensor configured to detect sound waves;
a processor configured to:
determine a variation between the detected sound waves and a reference signal;
determine the local environment of the mobile device based on the determined variation;
detect if the local environment of the mobile device is a covered environment or an uncovered environment; and
modify a behavior of the mobile device based on the determined local environment; and

a communication interface configured to receive a sound frequency profile outside the local environment, wherein:
the device audio sensor is configured to output a device sound frequency profile representing sound from the local environment of the mobile device detected by the device audio sensor and the reference signal comprises the sound frequency profile outside the local environment;
the sound frequency profile outside the local environment represents sound detected by an environment audio sensor separate from and located at a distance from the mobile device and the environment audio sensor is communicatively coupled to the mobile device via the communication interface in order to communicate the sound frequency profile outside the local environment; and
the processor is configured to determine the variation between the sound frequency profile outside the local environment and the device sound frequency profile based on a calculated damping profile representing a level of attenuation across a range of frequencies of the device sound frequency profile compared to the sound frequency profile outside the local environment.

3. A system comprising:
the mobile device of claim 2 ; and
the environment audio sensor separate from and located at the distance from the mobile device and the environment audio sensor is communicatively coupled to the mobile device via the communication interface in order to communicate the sound frequency profile outside the local environment, wherein the environment audio sensor is an audio sensor located separate from a user of the mobile device.

4. The mobile device of claim 2 , wherein when the processor detects the mobile device to be in a covered environment, the processor is further configured to estimate at least one of a type of the material covering the mobile device, the density of the material covering the mobile device, or a thickness of the material covering the mobile device.

5. The mobile device of claim 2 , wherein the processor is configured to determine the variation between the sound frequency profile outside the local environment and the device sound frequency profile by integrating over the mathematical difference between the device sound frequency profile and the sound frequency profile outside the local environment.

6. The mobile device of claim 2 , wherein the calculated damping profile comprises a ratio of the sound frequency profile outside the local environment and the device sound frequency profile.

7. The mobile device of claim 2 , wherein when the processor determines that the mobile device is covered, the processor is configured to compare the calculated damping profile to stored damping profiles for various materials to determine a stored damping profile that the calculated damping profile is most similar to.

8. The mobile device of claim 2 , wherein when the processor determines that the mobile device is covered, the processor is configured to compare the calculated damping profile to stored damping profiles for various materials to determine a set of the stored damping profiles that the calculated damping profile is most similar to.

9. The mobile device of claim 8 , wherein the processor is configured to determine the set of the stored damping profiles that the calculated damping profile is most similar to by determining the set of the stored damping profiles that minimizes the following equation:
F ( DP d )=abs( DP a −Σ i=1 N DP i ),

where abs is the absolute value, DPd is the determined set of stored damping profiles including N of the stored damping profiles where N is an integer greater than or equal to one, DPa is the calculated damping profile, and DPi is the ith calculated damping profile in the determined set of stored damping profiles.

10. The mobile device of claim 8 , wherein the processor is configured to determine the set of the stored damping profiles that the calculated damping profile is most similar to by determining the set of the stored damping profiles that minimizes the following equation:
F ( DP d ,M i )=abs( DP a −ΣΣ i=1 N *DP i )

where abs is the absolute value, * represents multiplication, DPd is the determined set of stored damping profiles including N of the stored damping profiles where N is an integer greater than or equal to one, M is a set of multiplicative factors applied to the determined set of stored damping profiles, DPa is the calculated damping profile, DPd,i is an ith damping profile in the determined set of stored damping profiles, and Mi is a ith multiplicative factor applied to the ith damping profile.

11. The mobile device of claim 2 , wherein modifying the behavior of the mobile device includes at least one of:
changing a ringer volume of the mobile device;
setting a vibrating mode of the mobile device;
setting a behavior of a display of the mobile device;
setting a behavior of displaying notifications to a user of the mobile device;
turning off a display of the mobile device while the mobile device is determined to be covered;
increasing the ringer volume of the mobile device while the mobile device is determined to be in a bag;
turning off vibrate while the mobile device is determined to be in a bag; or
reducing the ringer volume of the mobile device while the mobile device is determined to be uncovered.

12. A system comprising:
an ultrasonic device configured to output an ultrasonic signal having a known properly:
a mobile device configured to determine a local environment of the mobile device, the mobile device comprising
a device audio sensor configured to:
output a device sound frequency profile representing sound from the local environment of the mobile device detected by the device audio sensor, and
detect the ultrasonic signal out by the ultrasonic device; and

a processor configured to:
determine a variation between the detected ultrasoni

Assignees

• Sony Mobile Communications Inc
• Sony Corp

Inventors

• Nilsson Jan

Classifications

• H04M2250/12

  including a sensor for measuring a physical value, e.g. temperature or motion · CPC title

• H04W52/0254 Primary

  detecting a user operation or a tactile contact or a motion of the device · CPC title

• H04W52/0251

  using monitoring of local events, e.g. events related to user activity · CPC title

• H04W68/005

  Transmission of information for alerting of incoming communication · CPC title

• H04M19/042

  with variable loudness of the ringing tone, e.g. variable envelope or amplitude of ring signal · CPC title