Method for control of camera module based on physiological signal

Patent metadata

Field	Value
Publication number	US-9444998-B2
Application number	US-201514843593-A
Country	US
Kind code	B2
Filing date	Sep 2, 2015
Priority date	Sep 2, 2014
Publication date	Sep 13, 2016
Grant date	Sep 13, 2016

Abstract

A control method of an electronic device is disclosed. The method includes receiving an input signal including a physiological signal of a subject to be examined through a sensor module of the electronic device, detecting an input operation based on at least the input signal, and acquiring an image through a camera module according to the input operation.

First claim

What is claimed is:

1. A method of controlling an electronic device, the method comprising:
receiving an input signal including a physiological signal of a subject to be examined through a sensor module of the electronic device;
detecting an input operation based on at least the input signal; and
acquiring an image through a camera module according to the input operation.

2. The method of claim 1 , wherein the physiological signal includes a Photoplethysmography (PPG) measurement signal.

3. The method of claim 1 , wherein detecting the input operation comprises detecting a contact operation including contacting at least a part of a surface of the sensor module.

4. The method of claim 1 , wherein the input operation is detected based on one of the physiological signal received through the sensor module and a signal level or a signal pattern of another input signal.

5. The method of claim 1 , wherein detecting the input operation comprises:
detecting a contact operation including a contact on at least a part of a surface of the sensor module; and
detecting a state in which the contact is maintained for a predetermined time after the contact operation;
and
wherein acquiring the image comprises:
changing a setting of the camera module according to the contact operation; and
acquiring the image through the camera module when the predetermined time elapses.

6. The method of claim 5 , wherein changing the setting comprises controlling a focus of the camera module or controlling a white balance of the camera module.

7. The method of claim 1 , wherein detecting the input operation comprises detecting an approach operation including approaching a surface of the sensor module within a particular range; and
wherein acquiring the image comprises changing a setting of the camera module according to the approach operation.

8. The method of claim 1 , wherein detecting the input operation comprises detecting a separation operation including being separated from a surface of the sensor module.

9. The method of claim 1 , wherein detecting the input operation comprises:
detecting a contact operation including contacting at least a part of a surface of the sensor module; and
detecting a separation operation including being separated from the surface of the sensor module;
and
wherein acquiring the image comprises:
changing a setting of the camera module according to the contact operation; and
acquiring the image through the camera module according to the separation operation.

10. The method of claim 9 , wherein detecting the input operation comprises detecting a state in which a contact is maintained after the contact operation; and
wherein acquiring the image comprises waiting for a predetermined time based on a time for which the contact is maintained before the image is acquired.

11. The method of claim 1 , further comprising acquiring heart rate information of the subject to be examined based on the input signal.

12. The method of claim 11 , further comprising displaying the heart rate information on the image.

13. The method of claim 12 , wherein displaying the heart rate information comprises:
identifying the subject to be examined in the image; and
displaying the heart rate information to be associated with the identified subject to be examined.

14. The method of claim 13 , wherein displaying the heart rate information to be associated with the identified subject to be examined comprises displaying the heart rate information on a part corresponding to a face or a chest of the subject to be examined.

15. The method of claim 11 , further comprising displaying the heart rate information on a preview image acquired through the camera module.

16. The method of claim 11 , further comprising storing the image while the image includes the heart rate information.

17. The method of claim 1 , wherein the input signal includes an optical signal of an illumination sensor included in the sensor module.

18. The method of claim 1 , wherein the input operation is detected based on at least the input signal and whether a button functionally connected to the sensor module is open or shut.

19. An electronic device comprising:
a camera module;
a sensor module that receives an input signal including a physiological signal of a subject to be examined; and
a control module that detects an input operation at least based on the input signal and acquires an image through the camera module according to the input operation.

20. The electronic device of claim 19 , wherein the physiological signal includes a Photoplethysmography (PPG) measurement signal.

21. The electronic device of claim 19 , wherein the control module detects a contact operation including a contact on at least a part of a surface of the sensor module.

22. The electronic device of claim 19 , wherein the input operation is detected based on a signal level or a signal pattern of the physiological signal or another input signal received through the sensor module.

23. The electronic device of claim 19 , wherein the control module detects a contact operation including a contact on at least a part of a surface of the sensor module, detects a state in which the contact is maintained for a predetermined time after the contact operation, changes a setting of the camera module according to the contact operation, and acquires the image through the camera module when the predetermined time elapses.

24. The electronic device of claim 23 , wherein the control module changes the setting of the camera module by controlling a focus or a white balance of the camera module according to the contact operation.

25. A method comprising:
receiving a physiological signal of a user through a biometric sensor of an electronic device; and
acquiring an image through a camera module of the electronic device at least based on a change in the physiological signal, wherein the acquiring includes acquiring the image through the camera module when the physiological signal is no longer received.

26. The method of claim 25 , wherein acquiring the image comprises determining whether the physiological signal changes based on a level or a pattern of the physiological signal.

27. A mobile terminal comprising:
a camera module arranged on a front surface or a rear surface of a body of the mobile terminal;
a sensor module for receiving a physiological signal of a user, the sensor module formed on the front surface or the rear surface of the body; and
a control module for acquiring an image through the camera module at least based on a change in the physiological signal, the control module functionally connected to the camera module and the sensor module, wherein the control module is adapted to acquire the image through the camera module when the physiological signal is no longer received.

28. The mobile terminal of claim 27 , wherein the control module determines whether the physiological signal changes based on a level or a pattern of the physiological signal.

29. A non-transitory computer-readable recording medium having a program recorded thereon to perform a method, the method comprising:
receiving a physiological signal of a user through a biometric sensor of an electronic device; and
acquiring an image through a camera module of the electronic device at least based on a change in the physiological signal, where

Assignees

• Samsung Electronics Co Ltd
• Samsung Electronics Co Ltd

Inventors

• Kim Namjin
• Hyun Sora
• Seo Hyunho
• Chun Changhyun
• Koo Yunemo
• Kim Gaeyoun
• Kim Geonsoo
• Kim Heedeog
• Shin Sunghyuk
• Lee Kihuk
• Lee Chulhwan
• Cheong Cheolho
• Choi Seungmin

Classifications

• A61B5/1172

  using fingerprinting · CPC title

• A61B5/0205

  Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition · CPC title

• G06F3/015 Primary

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F1/169

  the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes (G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033) · CPC title