Occupant monitoring systems and methods

Patent metadata

Field	Value
Publication number	US-9533687-B2
Application number	US-201414586124-A
Country	US
Kind code	B2
Filing date	Dec 30, 2014
Priority date	Dec 30, 2014
Publication date	Jan 3, 2017
Grant date	Jan 3, 2017

Abstract

Various implementations relate to an operator monitoring system (OMS). Certain implementations include an OMS coupled to a rotatable portion of a steering wheel assembly of a vehicle. For example, the OMS may include an imaging unit, such as a camera, that is coupled to a central hub portion of the steering wheel assembly. The imaging unit has a field of view directed toward one or more occupants in the vehicle and is configured to capture an image signal corresponding to an imaging area in the field of view. The imaging area can be configured to encapsulate an expected position of one or more vehicle occupants. The OMS also includes one or more processing units in electrical communication with the imaging unit that receives and processes the image signal from the imaging unit to determine an occupant state and, in some implementations, provide feedback based on the determined occupant state.

First claim

What is claimed is:

1. An occupant monitoring system (OMS) for monitoring at least one occupant in a vehicle, the vehicle having a steering wheel assembly configured to rotate relative to a steering column, the OMS comprising:
an imaging unit configured to be coupled to a steering wheel assembly, the imaging unit having a field of view inside of the vehicle and being configured to capture an image signal corresponding to an imaging area in the vehicle, the imaging area being within the field of view,
a steering angle sensor, and
a processing unit, the processing unit including a processor and a memory operably coupled to the processor, the memory having computer-executable instructions stored thereon that, when executed by the processor, cause the processor to:
receive an electrical signal from the steering angle sensor and the image signal from the imaging unit;
process the electrical signal to determine the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly; and
adjust the image signal captured of the imaging area to correct for the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly,

wherein the imaging area encapsulates an expected position of the occupant in the vehicle, and
wherein the imaging unit is configured to rotate with a central portion of the steering wheel assembly of the vehicle.

2. The OMS of claim 1 , wherein the imaging unit is coupled to the central portion of the steering wheel assembly.

3. The OMS of claim 2 , wherein the steering wheel assembly includes a rim and a hub, the central portion including the hub.

4. The OMS of claim 3 , wherein the hub includes a housing, and the imaging unit is disposed within the housing.

5. The OMS of claim 4 , wherein the housing is coupled adjacent to a backcover of the hub.

6. The OMS of claim 5 , wherein the housing is coupled adjacent to the backcover via a mounting bracket and the system further comprises at least one light source disposed adjacent the imaging unit in the housing, and wherein at least a portion of the heat generated by one or more of the light source or the imaging unit is transferred from the housing to the hub.

7. The OMS of claim 4 , wherein the housing is integrally formed with a backcover of the hub.

8. The OMS of claim 1 , wherein the computer-executable instructions further cause the processor to:
adjust the imaging unit to correct for the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly.

9. The OMS of claim 1 , wherein the OMS comprises a single modular unit configured to be coupled to the steering wheel assembly.

10. The OMS of claim 1 , wherein the imaging unit includes a camera.

11. The OMS of claim 1 , further including a light source configured to illuminate the imaging area.

12. The OMS of claim 11 , wherein the light source comprises an infrared light source.

13. The OMS of claim 11 , wherein the light source comprises at least one light emitting diode.

14. The OMS of claim 11 , wherein the light source comprises a light bar, the light bar comprising one or more light emitting diodes.

15. The OMS of claim 14 , wherein the light bar comprises at least a first section of one or more light emitting diodes and a second section of one or more light emitting diodes, wherein the first section is configured to illuminate visible light in response to the OMS being in one of an operational mode or a non-operational mode, and the second section is configured to illuminate infrared light in the direction of the field of view of the imaging unit.

16. The OMS of claim 1 , wherein the computer-executable instructions further cause the processor to:
process the adjusted image signal to identify an analysis region;
analyze the analysis region to determine an occupant information parameter;
analyze the occupant information parameter to determine an occupant state; and
output a signal based on the determined occupant state.

17. The OMS of claim 16 , wherein identifying the analysis region comprises determining the position and/or orientation of the occupant's head and/or eyes.

18. The OMS of claim 16 , wherein analyzing the analysis region comprises determining deviation in the position and/or orientation of the occupant's head and/or eyes from a predetermined position.

19. The OMS of claim 16 , wherein the analyzing the occupant information parameter to determine the occupant state comprises determining that the position and/or orientation of the occupant's head and/or eyes are deviated from a predetermined position for at least a predetermined amount of time.

20. The occupant monitoring system of claim 1 , further comprising a disabling unit configured to temporarily disable the occupant monitoring system when a driver signal is received and the vehicle is stationary.

21. The occupant monitoring system of claim 20 , wherein the driver signal is output upon rotation of the steering wheel assembly of the vehicle by at least a predetermined amount and/or for a predetermined amount of time.

22. The occupant monitoring system of claim 21 , wherein the driver signal ceases to be output when the steering wheel assembly is returned to a substantially central position for at least a predetermined amount of time.

23. A occupant monitoring system (OMS) for monitoring an occupant in a vehicle comprising:
a steering wheel assembly configured to be rotatably coupled to a steering column of the vehicle, the steering wheel assembly including a rim surrounding a centrally located hub;
an imaging unit coupled to the steering wheel assembly, the imaging unit having a field of view and being configured to capture an image of an imaging area within the field of view;
wherein the imaging area encapsulates an expected position of the occupant,
wherein the imaging unit is configured to be coupled to and rotate with a central portion of the steering wheel assembly of the vehicle, and
wherein the hub includes a housing directly coupled to a backcover of the hub, and the imaging unit is disposed within the housing.

24. The OMS of claim 23 , further comprising a steering angle sensor.

25. The OMS of claim 24 , further comprising a processing unit, the processing unit including a processor and a memory operably coupled to the processor, the memory having computer-executable instructions stored thereon that, when executed by the processor, cause the processor to:
receive an electrical signal from the steering angle sensor;
process the electrical signal to determine the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly; and
adjust an image signal corresponding to the image captured of the imaging area by the imaging unit to correct for the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly.

26. A method of monitoring an occupant in a vehicle using an occupant monitoring system, the method comprising:
coupling an occupant monitoring system (OMS) to a rotatable portion of a steering wheel assembly of the vehicle such that the OMS rotates with the rotatable portion, the OMS including an imaging unit configured to capture an image signal corresponding to an imaging area in the vehicle, the imaging area being wit

Assignees

• Tk Holdings Inc
• Tk Holdings Inc

Inventors

• Lisseman Jason Carl
• Cech Len
• Gardner Valerie

Classifications

• B60W2710/20

  Steering systems · CPC title

• B60W2510/20

  Steering systems · CPC title

• B60R2011/001

  Vehicle control means, e.g. steering-wheel or column · CPC title

• F21S45/47

  Passive cooling, e.g. using fins, thermal conductive elements or openings · CPC title

• B60R11/04

  Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle · CPC title