System for monitoring an occupant of a motor vehicle

Patent metadata

Field	Value
Publication number	US-12569151-B2
Application number	US-202218284034-A
Country	US
Kind code	B2
Filing date	Mar 14, 2022
Priority date	Mar 25, 2021
Publication date	Mar 10, 2026
Grant date	Mar 10, 2026

Abstract

The monitoring system ( 1 ) comprises:
a light source ( 3 ), an image acquisition device ( 5 ) comprising a shutter ( 11 ) which allows light to pass during a period (P 1 ) when the source is active and during a period (P 2 ) when the source is inactive, the light received by a sensor ( 9 ) comprising a component (Ca) due to ambient illumination and a component (Ci) due to the light source; a processing unit ( 7 ) configured for determining a physiological parameter of the occupant by photoplethysmography.

The shutter ( 11 ) allows light to pass during a third period (P 3 ), said light comprising the component (Ca) due to ambient illumination and the processing unit ( 7 ) being configured for subtracting this component (Ca) from the light received ( 9 ) during the other two periods for the purpose of isolating the component (Ci) due to the source in acquired images.

First claim

The invention claimed is:

1 . A system for monitoring an occupant of a motor vehicle, the system comprising:
a pulsed light source configured for emitting a train of light pulses towards the occupant, the train of light pulses comprising a first light pulse; an image acquisition device configured to acquire one or more images, the image acquisition device comprising an image sensor and a first shutter configured for allowing a reflected light to pass towards the image sensor during a first acquisition period in which the pulsed light source emits the first light pulse, wherein the image acquisition device further comprises a time-of-flight camera, a second shutter configured for allowing the reflected light to pass towards the image sensor during a second acquisition period in which the pulsed light source is inactive, and a third shutter configured for allowing the reflected light to pass towards the image sensor during a third acquisition period, the third acquisition period being initiated outside the first and the second acquisition periods, the pulsed light source being inactive during the third acquisition period, wherein the second acquisition period is initiated outside the first acquisition period, wherein a duration of each of the first and the second acquisition periods is at least equal to the duration of the first light pulse emitted by the pulsed light source, wherein the reflected light received by the image sensor in the first acquisition period and the second acquisition period comprises an ambient light component due to ambient illumination and an emitted light component due to at least one light pulse of the train of light pulses emitted by the pulsed light source; and a processing unit configured for determining at least one physiological parameter of the occupant by photoplethysmography based on one or more images acquired by the image acquisition device, and for defining a physiological state of the occupant based on the at least one physiological parameter, wherein the reflected light received by the image sensor in the third acquisition period comprises the ambient light component due to the ambient illumination, and wherein the processing unit is configured for subtracting the ambient light component due to the ambient illumination from the reflected light received by the image sensor during the first and the second acquisition periods, in order to isolate the emitted light component due to the first light pulse emitted by the pulsed light source in the one or more images acquired by the image acquisition device during the first and the second acquisition periods.

2 . The system according to claim 1 , wherein the duration of each of the first, second and third acquisition periods is equal to 20 ns.

3 . The system according to claim 2 , wherein the durations of the first, second and third acquisition periods are identical to each other.

4 . The system according to claim 1 , wherein the duration of one pulse of the train of light pulses emitted by the pulsed light source is equal to the duration of the first acquisition period.

5 . The system according to claim 1 , further comprising a control unit configured for synchronizing a start of the train of light pulses emitted by the pulsed light source with an opening of the first shutter at a start of the first acquisition period.

6 . The system according to claim 5 , wherein the control unit is configured for controlling the opening and a closing of the first shutter.

7 . The system according to claim 1 , wherein the processing unit is configured to select a region of interest on a face of the occupant to enable the at least one physiological parameter to be determined.

8 . The system according to claim 1 , wherein the image sensor is configured for producing a depth map of a face of the occupant based on the one or more images acquired by the image acquisition device.

9 . A method for determining the physiological state of the occupant of the motor vehicle by the photoplethysmography, the method making use of the system according to claim 1 , wherein the method comprises:
emitting the train of light pulses towards the occupant using the pulsed light source and, simultaneously, opening the first shutter to allow the reflected light to pass towards the image sensor, wherein the reflected light comprises the ambient light component due to the ambient illumination and the emitted light component due to the first light pulse emitted by the pulsed light source; inactivating the pulsed light source and closing the first shutter at an end of the first acquisition period; opening the second shutter to allow the reflected light to pass towards the image sensor during the second acquisition period, the reflected during the second acquisition period light comprising the ambient light component due to the ambient illumination and the emitted light component due to the first light pulse emitted by the pulsed light source; closing the second shutter at an end of the second acquisition period; opening the third shutter to allow the reflected light to pass towards the image sensor during the third acquisition period, the reflected light during the third acquisition period comprising the ambient light component due to the ambient illumination; closing the third shutter at an end of the third acquisition period; subtracting, using the processing unit, the ambient light component due to the ambient illumination, contained in the reflected light received by the image sensor during the third acquisition period, from the reflected light received by the image sensor during the first and the second acquisition periods to isolate the emitted light component due to the first light pulse emitted by the pulsed light source in the one or more images acquired by the image acquisition device during the first and the second acquisition periods; determining, using the processing unit, the at least one physiological parameter of the occupant by the photoplethysmography based on the one or more images acquired by the image acquisition device during the first and the second acquisition periods; and determining, using the processing unit, the physiological state of the occupant by the photoplethysmography based on the at least one physiological parameter.

10 . The system according to claim 1 ,
wherein the first shutter is opened at a start of the first acquisition period and closed at an end of the first acquisition period, wherein the second shutter is opened at a start of the second acquisition period and closed at an end of the second acquisition period, and wherein the third shutter is opened at a start of the third acquisition period and closed at an end of the third acquisition period.

Assignees

• Valeo Comfort & Driving Assistance

Inventors

• Ringelstein Nicolas
• Autran Frederic

Classifications

• A61B5/6893

  Cars · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title

• A61B5/0816

  Measuring devices for examining respiratory frequency (measuring frequency of electric signals G01R23/00) · CPC title

• A61B5/02433

  for infrared radiation · CPC title

• A61B5/0064

  Body surface scanning · CPC title