Mobile terminal and image processing method thereof

Patent metadata

Field	Value
Publication number	US-9977651-B2
Application number	US-201514683309-A
Country	US
Kind code	B2
Filing date	Apr 10, 2015
Priority date	Oct 17, 2012
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

The present disclosure discloses an image processing method of a mobile terminal, and a mobile terminal. To process an image, an audio signal is collected using a sensor of the mobile terminal. Air-blowing signal intensity is acquired by performing a windowed fast Fourier transform (FFT) on the audio signal to obtain a frequency domain signal of the audio signal. The frequency domain signal of the audio signal is divided into at least one time-slice frequency domain signal. It is then identified whether the audio signal is an air-blowing signal according to the at least one time-slice frequency domain signal and a preset property of the air-blowing signal. The air-blowing signal intensity is acquired according to the at least one time-slice frequency domain signal when the audio signal is identified as an air-blowing signal. An image is acquired according to the air-blowing signal intensity. In this manner, the image processing method using the air-blowing signal intensity may provide improved processing efficiency and simplified operation.

First claim

What is claimed is:

1. An image processing method of a mobile terminal, comprising:
collecting an audio signal using a sensor of the mobile terminal;
performing a windowed fast Fourier transform (FFT) on the audio signal to obtain a frequency domain signal of the audio signal;
dividing the frequency domain signal of the audio signal into at least one time-slice frequency domain signal;
identifying whether the audio signal is an air-blowing signal according to the at least one time-slice frequency domain signal and a preset property of the air-blowing signal; and
acquiring an air-blowing signal intensity according to the at least one time-slice frequency domain signal when the audio signal is identified as an air-blowing signal;
determining whether a specified to-be-processed area in an image is selected;
processing, according to the air-blowing signal intensity, the specified to-be-processed area when the specified to-be-processed area in the image is selected, and the entire image when no specified to-be-processed area in the image is selected, wherein processing according to the air-blowing signal intensity comprises:
acquiring an image processing parameter according to the air-blowing signal intensity and according to a preset correspondence relationship between the air-blowing signal intensity and an image processing parameter, and
processing, according to the image processing parameter, the specified to-be-processed area when the specified to-be-processed area in the image is selected, and the entire image when no specified to-be-processed area in the image is selected; and
disposing an air-blowing tool on the image, wherein a disposed location of the air-blowing tool indicates a value of the image processing parameter.

2. The method according to claim 1 , wherein the step of identifying whether the audio signal is the air-blowing signal according to the at least one time-slice frequency domain signal and the preset property of the air-blowing signal comprises:
identifying, according to each time-slice frequency domain signal among the at least one time-slice frequency domain signal and the preset property of the air-blowing signal, whether the time-slice frequency domain signal is an air-blowing signal;
determining a proportion of time-slice frequency domain signals that are air-blowing signals among the at least one time-slice frequency domain signal;
determining whether the proportion of the time-slice frequency domain signals that are air-blowing signals among the at least one time-slice frequency domain signal is greater than or equal to a first preset threshold; and
determining, when the proportion of the time-slice frequency domain signals that are air-blowing signals among the at least one time-slice frequency domain signal is greater than or equal to the first preset threshold, that the audio signal is the air-blowing signal; or otherwise, determining that the audio signal is not the air-blowing signal.

3. The method according to claim 1 , wherein after the step of collecting the audio signal and before the step of performing windowed fast Fourier transform (FFT) on the audio signal to obtain the frequency domain signal of the audio signal, the method further comprises:
performing a smoothing processing and an equalization processing on the audio signal.

4. The method according to claim 3 , wherein the step of acquiring the air-blowing signal intensity according to the at least one time-slice frequency domain signal comprises:
acquiring an average signal intensity of each time-slice frequency domain signal among the at least one time-slice frequency domain signal to obtain at least one average signal intensity; and
using an average value of the at least one average signal intensity as the air-blowing signal intensity.

5. The method according to claim 1 , wherein the preset property of the air-blowing signal comprises at least one of that:
a maximum intensity of low frequency signals is greater than an average intensity of high frequency signals and reaches a second preset threshold;
a mean square error of low frequency signal intensities is less than or equal to a third preset threshold; and
a maximum intensity of the high frequency signals is less than or equal to a fourth preset threshold.

6. A mobile terminal, comprising:
a sensor module, configured to collect an audio signal;
an acquiring module, configured to acquire an air-blowing signal intensity according to the collected audio signal, wherein the acquiring module comprises:
a processing unit, configured to perform a windowed fast Fourier transform (FFT) on the audio signal to obtain a frequency domain signal of the audio signal;
a division unit, configured to divide the frequency domain signal of the audio signal into at least one time-slice frequency domain signal;
an identification unit, configured to identify whether the audio signal is an air-blowing signal according to the at least one time-slice frequency domain signal and a preset property of the air-blowing signal; and
an acquiring unit, configured to acquire the air-blowing signal intensity according to the at least one time-slice frequency domain signal when the audio signal is identified as an air-blowing signal; and
a processing module, configured to process, according to the air-blowing signal intensity, a specified to-be-processed area when the specified to-be-processed area in the image is selected, and the entire image when no specified to-be-processed area in the image is selected, wherein the processing module is configured to acquire an image processing parameter according to the air-blowing signal intensity and according to a preset correspondence relationship between the air-blowing signal intensity and an image processing parameter, and to process, according to the image processing parameter, the specified to-be-processed area when the specified to-be-processed area in the image is selected, and the entire image when no specified to-be-processed area in the image is selected, and
further configured to dispose an air-blowing tool on the image, wherein a disposed location of the air-blowing tool indicates a value of the image processing parameter.

7. The mobile terminal according to claim 6 , wherein the identification unit is configured:
to identify, according to each time-slice frequency domain signal among the at least one time-slice frequency domain signal and the preset property of the air-blowing signal, whether the time-slice frequency domain signal is an air-blowing signal;
to determine a proportion of time-slice frequency domain signals that are air-blowing signals among the at least one time-slice frequency domain signal;
to determine whether the proportion of the time-slice frequency domain signals that are air-blowing signals among the at least one time-slice frequency domain signal is greater than or equal to a first preset threshold; and
to determine, when the proportion of the time-slice frequency domain signals that are air-blowing signals among the at least one time-slice frequency domain signal is greater than or equal to the first preset threshold, that the audio signal is the air-blowing signal; or otherwise, determine that the audio signal is not the air-blowing signal.

8. The mobile terminal according to claim 6 , wherein the processing unit is further configured to perform a smoothing processing and an equalization processing on the audio signal after the sensor module collects the audio signal and before the processing unit performs windowed FFT on the audio signal to obtain the frequency domain signal of the audio signal.

9. The mobile terminal according to claim 8 , wherein the acquiring unit is configured to acquire an average signa

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Dong Liqian
• Liu Qisong
• Ge Wenbing
• Pan Yucun
• Li Xiaoyi
• Bian Qianwei
• Zhou Dan

Classifications

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title