Facial Skin Mask Generation for Heart Rate Detection

Patent metadata

Field	Value
Publication number	US-2016110868-A1
Application number	US-201414518596-A
Country	US
Kind code	A1
Filing date	Oct 20, 2014
Priority date	Oct 20, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

A facial skin mask may be generated based on isolating a head part in a captured image, removing a first pixel that is indicative of non-skin from the head part in the captured image, and removing a second pixel that is indicative of having a high velocity from the head part in the captured image. Heart rate may be detected based on the change of color of the pixels of the generated facial skin mask

First claim

What is claimed:

1 . A device comprising:
a processor; and a memory coupled with the processor, the memory having stored thereon executable instructions that when executed by the processor cause the processor to effectuate operations comprising:
receiving data of a captured image, the data of the captured image comprising a subset of data of an anatomical head, the subset of data of the anatomical head comprising a plurality of representative pixels having a respective plurality of pixel values; and
determining whether each pixel of the plurality of representative pixels has the respective plurality of pixel values within a threshold value that is indicative of skin.

2 . The device of claim 1 , the operations further comprising:
determining whether the plurality of representative pixels average a value that is within a threshold indicative of an acceptable skin mask.

3 . The device of claim 1 , the operations further comprising:
responsive to determining that the plurality of representative pixels average a value within a threshold value indicative of skin of an acceptable skin mask, creating a facial skin mask with each pixel of the plurality of representative pixels within the threshold value that is indicative of skin.

4 . The device of claim 1 , the operations further comprising:
responsive to determining that the plurality of representative pixels average a value within a threshold value that is indicative of skin of an acceptable skin mask, determining velocity of each pixel of the plurality of representative pixels that has a plurality of respective pixel velocity values within a threshold value that is indicative of an acceptable velocity; and creating a facial skin mask based on each pixel of the plurality of representative pixels having:
the plurality of respective pixel velocity values within the threshold value that is indicative of the acceptable velocity, and
the respective plurality of pixel values within the threshold value that is indicative of skin.

5 . The device of claim 4 , wherein the plurality of respective pixel velocity values of each pixel is based on the use of an optical flow technique.

6 . The device of claim 1 , the operations further comprising:
creating a facial skin mask with each pixel of the plurality of representative pixels that have the respective plurality of pixel values within the threshold value that is indicative of skin; and providing instructions to display a graphic overlay based on the facial skin mask.

7 . The device of claim 6 , wherein the graphic overlay comprises a depiction of a scar.

8 . The device of claim 1 , the operations further comprising:
creating a facial skin mask with each pixel of the plurality of representative pixels that have the respective plurality of pixel values that is within the threshold value that is indicative of skin; and providing instructions to determine a heart rate based on the facial skin mask.

9 . The device of claim 1 , wherein the respective plurality of pixel values are based on a color channel.

10 . The device of claim 1 , wherein the captured image comprises an image based a non-visible light.

11 . A computer readable storage medium comprising computer executable instructions that when executed by a computing device cause said computing device to perform the computer executable instructions comprising:
receiving data of a captured image, the data of the captured image comprising a subset of data of an anatomical head, the subset of data of the anatomical head comprising a plurality of representative pixels having a respective plurality of pixel values; and determining whether each pixel of the plurality of representative pixels has the respective plurality of pixel values within a threshold value that is indicative of skin.

12 . The computer readable storage medium of claim 11 , further instructions comprising:
determining whether the plurality of representative pixels average a value that is within a threshold indicative of an acceptable skin mask.

13 . The computer readable storage medium of claim 11 , further operations comprising:
creating a facial skin mask with each pixel of the plurality of representative pixels that have the respective plurality pixel values within the threshold value that is indicative of skin; and providing instructions to display a graphic overlay based on the facial skin mask.

14 . The computer readable storage medium of claim 13 , wherein the graphic overlay comprises a depiction of a scar.

15 . The computer readable storage medium of claim 11 , wherein the captured image is an image based on non-visible light.

16 . A method comprising:
receiving a first data of a first captured image, the first data of the first captured image comprising a first subset of data of an anatomical head; converting a first plurality of representative pixels of the first subset of data of the anatomical head to a red, green, and blue (RGB) channel, the first plurality of representative pixels having a respective first plurality of pixel values based on the RGB channel; and determining whether each pixel of the first plurality of representative pixels has a respective plurality of pixel values within a first threshold value that is indicative of skin.

17 . The method of claim 16 , further comprising:
responsive to determining that the first plurality of representative pixels average a first value that is not within a threshold indicative of skin of an acceptable skin mask, converting a second plurality of representative pixels of a second subset of data of an anatomical head of a second captured image to a red, green, and blue (RGB) channel, each pixel of the second plurality of representative pixels having a respective second plurality of pixel values based on the RGB channel; comparing the first plurality of representative pixels that average the first value with the second plurality of representative pixels that average a second value; and creating a facial skin mask with each pixel of the second plurality of representative pixels within the threshold value that is indicative of skin based on the comparing of the first plurality of representative pixels that average the first value with the second plurality of representative pixels that average the second value.

18 . The method of claim 16 , wherein the first captured image is an image based on YUV.

19 . The method of claim 16 , further comprising:
responsive to determining that a second plurality of representative pixels a second subset of data of an anatomical head of a second captured image average a second value within a threshold value indicative of skin of an acceptable skin mask, determining velocity of each pixel of a second plurality of representative pixels that has a plurality of respective pixel velocity values within a threshold value that is indicative of an acceptable velocity; and creating a facial skin mask based on each pixel of the second plurality of representative pixels having:
the plurality of respective pixel velocity values within the threshold value that is indicative of the acceptable velocity, and
the second respective plurality of pixel values within the threshold value that is indicative of skin.

20 . The method of claim 19 , wherein the pixel velocity value of each pixel of the second plurality of representative pixels is based on the use of an optical flow technique.

Assignees

• Microsoft Corp

Inventors

• Cheng Beibei
• Walker Benjamin William
• Hoof Jonathan Ross
• Kennett Daniel
• Ahmad Anis

Classifications

• A61B5/024 Primary

  Measuring pulse rate or heart rate · CPC title

• G06V40/165

  using facial parts and geometric relationships · CPC title

• G06V40/167

  using comparisons between temporally consecutive images · CPC title

• G06T7/0012

  Biomedical image inspection · CPC title

• G06F18/24

  Classification techniques · CPC title