Method for control of camera module based on physiological signal

Patent metadata

Field	Value
Publication number	US-9794474-B2
Application number	US-201615239307-A
Country	US
Kind code	B2
Filing date	Aug 17, 2016
Priority date	Sep 2, 2014
Publication date	Oct 17, 2017
Grant date	Oct 17, 2017

Abstract

A method is provided. The method includes executing a camera application at an electronic device; activating a heart rate monitor (HRM) sensor operatively coupled with a first surface of the electronic device in response to the execution of the camera application; receiving an input signal via the HRM sensor; and capturing, using a processor operatively coupled with the electronic device, an image via an image sensor operatively coupled with a second surface of the electronic device based at least in part on the input signal.

First claim

What is claimed is:

1. A method comprising:
executing a camera application at an electronic device;
activating a heart rate monitor (HRM) sensor disposed in a first surface of the electronic device based on the execution of the camera application;
receiving an input signal via the HRM sensor;
identifying, using a processor operatively coupled with the electronic device, a movement of a user or an object external to the electronic device based at least in part on the input signal; and
capturing, using the processor, an image via an image sensor disposed in a second surface of the electronic device based at least in part on a determination that the movement satisfies a specified condition.

2. The method of claim 1 , wherein activating the HRM sensor comprises:
generating a signal via the HRM sensor,
wherein at least part of the signal is received via the input signal as reflected by a user or the object external to the electronic device.

3. The method of claim 1 , wherein the input signal comprises a photoplethysmography (PPG) measurement signal corresponding to a user of the electronic device.

4. The method of claim 3 , wherein the capture of the image is performed based at least in part on a determination that the PPG measurement signal falls into a specified range or a specified pattern.

5. The method of claim 1 , wherein capturing the image comprises:
setting the image sensor with a first setting based at least in part on a determination that the input signal corresponds to an input;
setting the image sensor with a second setting based at least in part on a determination that the input signal corresponds to another input; and
wherein the image is captured according to a corresponding setting of the first setting and the second setting.

6. The method of claim 5 , wherein the corresponding setting comprises adjustment of a focus or a white balance with respect to the image sensor.

7. The method of claim 1 , further comprising:
presenting the image as a preview via a display operatively coupled with the electronic device; and
replacing the image presented via the display with another image captured via another image sensor operatively coupled with another image sensor in response to another input signal.

8. An apparatus comprising:
an image sensor disposed in a first surface of the apparatus;
a heart rate monitor (HRM) sensor disposed in a second surface of the apparatus; and
a processor adapted to:
execute a camera application;
activate the HRM sensor based on the execution of the camera application;
receive an input signal via the HRM sensor;
identify, based at least in part on the input signal, a movement of a user or an object external to the apparatus; and
capture an image using the image sensor based at least in part on a determination that the movement satisfies a specified condition.

9. The apparatus of claim 8 , wherein the processor is adapted to:
emit a signal using the HRM sensor towards the user or the object external to the apparatus; and
receive, using the HRM sensor, at least part of the signal as reflected by the user or the object as at least part of the input signal.

10. The apparatus of claim 8 , wherein the input signal comprises a photoplethysmography (PPG) measurement signal corresponding to a user of the apparatus.

11. The apparatus of claim 10 , wherein the processor is adapted to:
perform the capture of the image based at least in part on a determination that the PPG measurement signal falls into a specified range or a specified pattern.

12. The apparatus of claim 8 , further comprising a display forming at least part of the first surface of the apparatus,
wherein the processor is adapted to:
determine physiological information corresponding to a user of the apparatus based at least in part on the input signal; and
present, via the display, the physiological information in relation with the image.

13. The apparatus of claim 8 , wherein the image comprises a first image and a second image, wherein the processor is adapted to:
capture the first and second images while the input signal is received; and
generate another image based on at least one portion of the first image and at least one portion of the second image.

14. An apparatus comprising:
a plurality of image sensors to capture an image, the plurality of image sensors including a first image sensor and a second image sensor;
a touchscreen display;
a biometric sensor to receive an input signal related to the capturing; and
a processor adapted to:
present, via the touchscreen display, a preview obtained from at least one of the first image sensor and the second image sensor;
identify whether the preview is obtained using the first image sensor or the second image sensor;
activate the biometric sensor if the preview is obtained using the first image sensor; and
refrain from activating the biometric sensor if the preview is obtained using the second image sensor.

15. The apparatus of claim 14 , wherein the processor is adapted to:
based on the identification that the preview is obtained using the second image sensor, receive another input signal via the touchscreen display; and
perform the capturing using the second image sensor in response to the other input signal.

16. The method of claim 1 , wherein the movement includes at least one of an approach operation, a contact operation, and a release operation.

17. The method of claim 7 , further comprising:
in response to the other input signal, deactivating the HRM sensor if the other image is displayed.

18. The apparatus of claim 8 , further comprising:
another image sensor disposed in a second surface of the apparatus; and
a touchscreen display disposed in a first surface of the apparatus,
wherein the processor is adapted to:
present, via the touchscreen display, a preview obtained via the image sensor or the other image sensor;
prior to activating the HRM sensor, identify whether the preview is obtained using the image sensor or the other image sensor; and
based on the identification, refrain from activating the biometric sensor if the preview is obtained using the other image sensor.

19. The apparatus of claim 8 , wherein the movement includes at least one of an approach operation, a contact operation, and a release operation.

20. The apparatus of claim 14 , wherein the processor is adapted to:
based on the activating, receiving the input signal using the biometric sensor; and
perform the capturing using the first image sensor in response to the input signal.

Assignees

• Samsung Electronics Co Ltd
• Samsung Electronics Co Ltd

Inventors

• Kim Namjin
• Hyun Sora
• Seo Hyunho
• Chun Changhyun
• Koo Yunemo
• Kim Gaeyoun
• Kim Geonsoo
• Kim Heedeog
• Shin Sunghyuk
• Lee Kihuk
• Lee Chulhwan
• Cheong Cheolho
• Choi Seungmin

Classifications

• A61B5/02416

  using photoplethysmograph signals, e.g. generated by infrared radiation (A61B5/14552 takes precedence) · CPC title

• A61B5/0205

  Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition · CPC title

• G06F1/169

  the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes (G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033) · CPC title

• A61B5/024

  Measuring pulse rate or heart rate · CPC title

• G06F3/015 Primary

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title