Facial skin mask generation for heart rate detection

Patent metadata

Field	Value
Publication number	US-10026171-B2
Application number	US-201715406181-A
Country	US
Kind code	B2
Filing date	Jan 13, 2017
Priority date	Oct 20, 2014
Publication date	Jul 17, 2018
Grant date	Jul 17, 2018

Abstract

A facial skin mask may be generated based on isolating a head part in a captured image, removing a first pixel that is indicative of non-skin from the head part in the captured image, and removing a second pixel that is indicative of having a high velocity from the head part in the captured image. Heart rate may be detected based on the change of color of the pixels of the generated facial skin mask.

First claim

What is claimed:

1. An apparatus comprising:
a processor; and
a memory coupled with the processor, the memory having stored thereon executable instructions that when executed by the processor cause the processor to effectuate operations comprising:
receiving data associated with a captured image, the data associated with the captured image comprising a subset of data of an anatomical head, the subset of data of the anatomical head comprising a plurality of representative pixels having a respective plurality of pixel values;
determining whether each pixel of the plurality of representative pixels has the respective plurality of pixel values within a threshold value that is indicative of skin;
creating a facial skin mask based on a non-visible light image when the pixel values are not within the threshold value that is indicative of skin; and
providing instructions to display a graphic overlay based on the facial skin mask.

2. The apparatus of claim 1 , wherein the respective plurality of pixel values are based on a position of the plurality of representative pixels on the anatomical head.

3. The apparatus of claim 1 , wherein the respective plurality of pixel values are based on depth of the plurality of representative pixels.

4. The apparatus of claim 1 , wherein the creating the facial skin mask is further based on each pixel of the plurality of representative pixels having a plurality of respective pixel velocity values within a threshold velocity value, wherein the plurality of respective pixel velocity values of each pixel is determined using an optical flow technique.

5. A method comprising:
receiving data associated with a captured image, the data associated with the captured image comprising a subset of data of an anatomical head, the subset of data of the anatomical head comprising a plurality of representative pixels having a respective plurality of pixel values;
determining whether each pixel of the plurality of representative pixels has the respective plurality of pixel values within a threshold value that is indicative of skin; and
creating a facial skin mask based on a non-visible light image when the pixel values are not within the threshold value that is indicative of skin, wherein the creating the facial skin mask is further based on each pixel of the plurality of representative pixels having a plurality of respective pixel velocity values within a threshold velocity value, wherein the plurality of respective pixel velocity values of each pixel is determined using an optical flow technique.

6. The method of claim 5 , wherein the respective plurality of pixel values are based on a position of the plurality of representative pixels on the anatomical head.

7. The method of claim 5 , wherein the respective plurality of pixel values are based on depth of the plurality of representative pixels.

8. The method of claim 5 , further comprising providing instructions to display a graphic overlay based on the facial skin mask.

9. An apparatus comprising:
a processor; and
a memory coupled with the processor, the memory having stored thereon executable instructions that when executed by the processor cause the processor to effectuate operations comprising:
receiving a first data associated with a first captured image comprising a first subset of data of an anatomical head;
converting a first plurality of representative pixels of the first subset of data of the anatomical head to a color channel, the first plurality of representative pixels having a respective first plurality of pixel values based on the color channel;
determining whether each pixel of the first plurality of representative pixels has a respective plurality of pixel values within a first threshold value that is indicative of skin;
responsive to determining that the first plurality of representative pixels average a first value that is not within a first skin mask threshold, converting a second plurality of representative pixels of a second subset of data of an anatomical head associated with a second captured image to a color channel, each pixel of the second plurality of representative pixels having a respective second plurality of pixel values based on the color channel; and
creating a facial skin mask with each pixel of the second plurality of representative pixels within a threshold value that is indicative of skin based on a comparison of the first plurality of representative pixels that average the first value with the second plurality of representative pixels that average a second value.

10. The apparatus of claim 9 , the operations further comprising displaying a graphic overlay based on the facial skin mask.

11. The apparatus of claim 9 , the operations further comprising determining heart rate based on color of the pixels of the facial skin mask.

12. The apparatus of claim 9 , wherein the creating the facial skin mask is further based on each pixel of the second plurality of representative pixels having a plurality of respective pixel velocity values within a threshold velocity value, wherein the plurality of respective pixel velocity values of each pixel of the second plurality of representative pixels is determined using an optical flow technique.

13. The apparatus of claim 9 , wherein the respective first plurality of pixel values are based on a position of the first plurality of representative pixels on the anatomical head.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Cheng Beibei
• Walker Benjamin William
• Hoof Jonathan Ross
• Kennett Daniel
• Ahmad Anis

Classifications

• A61B5/024 Primary

  Measuring pulse rate or heart rate · CPC title

• G06V40/165

  using facial parts and geometric relationships · CPC title

• G06V40/167

  using comparisons between temporally consecutive images · CPC title

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• G06F18/24

  Classification techniques · CPC title