Determining artery location using camera-based sensing

Patent metadata

Field	Value
Publication number	US-10939833-B2
Application number	US-201815951098-A
Country	US
Kind code	B2
Filing date	Apr 11, 2018
Priority date	May 1, 2017
Publication date	Mar 9, 2021
Grant date	Mar 9, 2021

Abstract

In one embodiment, a computer-readable non-transitory storage medium embodies software that is operable when executed to, in real time, capture a number of images of a user; identify one or more regions of interest corresponding to one or more superficial arteries of the user. The identification is based on a signal-to-noise ratio of photoplethysmogram (PPG) data obtained from the plurality of images. The software is further operable to measure, based on the PPG data, blood volume pulse (BVP) signals; and based on the measured BVP signals, compute one or more cardiological metrics for the user.

First claim

The invention claimed is:

1. One or more computer-readable non-transitory storage media embodying software that is operable when executed by a client system to, in real-time:
capture, by one or more cameras of the client system, a plurality of images of a user;
locate, by the client system, a plurality of superficial arteries of the user;
partition, by the client system, the plurality of images into one or more regions of interest corresponding to one or more of the superficial arteries of the user;
measure, by the client system, blood volume pulse signals at one or more of the regions of interest based on photoplethysmogram data obtained from the plurality of images; and
compute, by the client system, one or more cardiological metrics for the user based on the blood volume pulse signals.

2. The media of claim 1 , wherein the plurality of images is captured by a single camera.

3. The media of claim 1 , wherein the software is further operable to compute a respiratory rate using a composite blood volume pulse signal, wherein the composite blood volume pulse signal is based on concurrent measurements of blood volume pulse change across one or more nasal arteries.

4. The media of claim 3 , wherein the software is further operable to refine the composite blood volume pulse signal using a measurement of blood volume pulse change across a non-nasal artery.

5. The media of claim 1 , wherein the software is operable to locate the superficial arteries using pre-available human arterial layout information refined during one or more baseline measurements of the user.

6. The media of claim 1 , wherein the software is further operable to compute a blood pressure of the user based on blood volume pulse or a pulse wave transit time.

7. The media of claim 1 , wherein the software is operable to locate the superficial arteries based on a signal-to-noise ratio of the photoplethysmogram data.

8. The media of claim 7 , wherein the software is further operable to select one or more of the superficial arteries based on the signal-to-noise ratio of the photoplethysmogram data.

9. A method executed by a client system comprising, in real-time:
capturing, by one or more cameras of the client system, a plurality of images of a user;
locating, by the client system, a plurality of superficial arteries of the user;
partitioning, by the client system, the plurality of images into one or more regions of interest corresponding to one or more of the superficial arteries of the user;
measuring, by the client system, blood volume pulse signals at one or more of the regions of interest based on photoplethysmogram data obtained from the plurality of images; and
computing, by the client system, one or more cardiological metrics for the user based on the blood volume pulse signals.

10. The method of claim 9 , wherein the plurality of images is captured by a single camera.

11. The method of claim 9 , further comprising computing a respiratory rate using a composite blood volume pulse signal, wherein the composite blood volume pulse signal is based on concurrent measurements of blood volume pulse change across one or more nasal arteries.

12. The method of claim 11 , further comprising refining the composite blood volume pulse signal using a measurement of blood volume pulse change across a non-nasal artery.

13. The method of claim 9 , wherein locating the superficial arteries comprises using pre-available human arterial layout information refined during one or more baseline measurements of the user.

14. The method of claim 9 , wherein computing the cardiological metrics for the user comprises computing a blood pressure of the user based on blood volume pulse or a pulse wave transit time.

15. The method of claim 9 , wherein locating the superficial arteries is based on a signal-to-noise ratio of the photoplethysmogram data.

16. The method of claim 15 , further comprising selecting one or more of the superficial arteries based on the signal-to-noise ratio of the photoplethysmogram data.

17. A system comprising:
one or more processors; and
a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions by a client system to, in real-time:
capture, by one or more cameras of the client system, a plurality of images of a user;
locate, by the client system, a plurality of superficial arteries of the user;
partition, by the client system, the plurality of images into one or more regions of interest corresponding to one or more of the superficial arteries of the user;
measure, by the client system, blood volume pulse signals at one or more of the regions of interest based on photoplethysmogram data obtained from the plurality of images; and
compute, by the client system, one or more cardiological metrics for the user based on the blood volume pulse signals.

18. The system of claim 17 , wherein the plurality of images is captured by a single camera.

19. The system of claim 17 , wherein the processors are further operable to compute a respiratory rate using a composite blood volume pulse signal, wherein the composite blood volume pulse signal is based on concurrent measurements of blood volume pulse change across one or more nasal arteries.

20. The system of claim 19 , wherein the processors are further operable to refine the composite blood volume pulse signal using a measurement of blood volume pulse change across a non-nasal artery.

21. The system of claim 17 , wherein the processors are operable to locate the superficial arteries using pre-available human arterial layout information refined during one or more baseline measurements of the user.

22. The system of claim 17 , wherein the processors are operable to locate the superficial arteries based on a signal-to-noise ratio of the photoplethysmogram data.

23. The system of claim 22 , wherein the processors are further operable to select one or more of the superficial arteries based on the signal-to-noise ratio of the photoplethysmogram data.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Khwaja Ayesha
• Young James
• Wortham Cody
• Sadi Sajid
• Jain Jawahar

Classifications

• A61B5/349

  Detecting specific parameters of the electrocardiograph cycle · CPC title

• G06V40/174

  Facial expression recognition · CPC title

• G06V40/15

  Biometric patterns based on physiological signals, e.g. heartbeat, blood flow · CPC title

• G06V40/171

  Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships · CPC title

• G06V40/176

  Dynamic expression · CPC title