Vehicular driver monitoring system with camera view optimization

Patent metadata

Field	Value
Publication number	US-11930264-B2
Application number	US-202217663462-A
Country	US
Kind code	B2
Filing date	May 16, 2022
Priority date	May 18, 2021
Publication date	Mar 12, 2024
Grant date	Mar 12, 2024

Abstract

A vehicular driver monitoring system includes a camera disposed at an interior rearview mirror assembly of a vehicle equipped with the vehicular driver monitoring system, an electronic control unit (ECU) with an image processor for processing image data captured by the camera. The camera includes an imaging array sensor and a lens and the camera is adjustable by at least one of (i) adjusting a position of the imaging array sensor relative to the lens and (ii) adjusting a position of the lens relative to the imaging array sensor. The system, responsive to processing at the ECU of image data captured by the camera, monitors a body portion of a driver of the vehicle and adjusts the camera to adjust the position of where the monitored body portion of the driver is imaged at the imaging array sensor.

First claim

The invention claimed is:

1. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:
a camera disposed at an interior rearview mirror assembly of a vehicle equipped with the vehicular driver monitoring system, the camera viewing interior of the vehicle and capturing image data;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the camera;
wherein the camera comprises an imaging array sensor and a lens;
wherein the camera is adjustable by at least one selected from the group consisting of (i) adjusting a position of the imaging array sensor relative to the lens and (ii) adjusting a position of the lens relative to the imaging array sensor;
wherein the vehicular driver monitoring system, responsive to processing at the ECU of image data captured by the camera, monitors a body portion of a driver of the vehicle; and
wherein the vehicular driver monitoring system, responsive to determining a change in a position of the body portion of the driver relative to a field of view of the camera, adjusts the camera to adjust the position of where the monitored body portion of the driver is imaged at the imaging array sensor, and wherein the camera is adjusted by shifting an optical axis of the lens relative to the imaging array sensor.

2. The vehicular driver monitoring system of claim 1 , wherein the camera is adjusted by adjusting the position of the imaging array sensor relative to the lens.

3. The vehicular driver monitoring system of claim 1 , wherein the camera is adjusted by adjusting the position of the lens relative to the imaging array sensor.

4. The vehicular driver monitoring system of claim 1 , wherein the camera is adjusted by shifting the optical axis of the lens relative to the imaging array sensor so that a center axis of the lens is not at a center region of the imaging array sensor.

5. The vehicular driver monitoring system of claim 4 , wherein the camera is adjusted to increase resolution of an area of interest of the driver of the vehicle.

6. The vehicular driver monitoring system of claim 5 , wherein the area of interest comprises the eyes of the driver.

7. The vehicular driver monitoring system of claim 6 , wherein the vehicular driver monitoring system, via processing at the ECU of image data captured by the camera, determines driver attentiveness.

8. The vehicular driver monitoring system of claim 5 , wherein the area of interest comprises the hands of the driver.

9. The vehicular driver monitoring system of claim 5 , wherein a beam direction of one or more illumination sources is adjusted to illuminate the area of interest.

10. The vehicular driver monitoring system of claim 1 , wherein the vehicular driver monitoring system, via processing at the ECU of image data captured by the camera, determines driver attentiveness.

11. The vehicular driver monitoring system of claim 1 , wherein the vehicular driver monitoring system, responsive to receiving an indication that a scene within the field of view of the camera has changed, adjusts the camera to accommodate the change in the scene within the field of view of the camera.

12. The vehicular driver monitoring system of claim 11 , wherein the indication comprises at least one selected from the group consisting of (i) a vehicle door opening, (ii) a vehicle door closing and (iii) a vehicle seat adjustment.

13. The vehicular driver monitoring system of claim 1 , wherein the interior rearview mirror assembly comprises a mirror head that is adjustable relative to a mounting portion via at least one pivot joint, and wherein the mounting portion is attached at an interior portion of the vehicle.

14. The vehicular driver monitoring system of claim 13 , wherein the camera is disposed at the mounting portion of the interior rearview mirror assembly.

15. The vehicular driver monitoring system of claim 13 , wherein the camera is disposed at the mirror head and moves in tandem with the mirror head when the mirror head is adjusted relative to the mounting portion to set a rearward view of the driver of the vehicle.

16. The vehicular driver monitoring system of claim 15 , wherein the vehicular driver monitoring system, responsive to receiving an indication that is indicative of adjustment of the mirror head relative to the mounting portion, adjusts the camera.

17. The vehicular driver monitoring system of claim 15 , wherein the ECU is disposed in the mirror head.

18. The vehicular driver monitoring system of claim 1 , comprising at least one actuator that is operable to adjust the camera.

19. The vehicular driver monitoring system of claim 18 , wherein the at least one actuator comprises a plurality of actuators.

20. The vehicular driver monitoring system of claim 19 , wherein the plurality of actuators adjust the camera by adjusting the position of the imaging array sensor or the lens along three independent axes.

21. The vehicular driver monitoring system of claim 18 , wherein the at least one actuator is operable to adjust a beam direction of one or more illumination sources toward the driver.

22. The vehicular driver monitoring system of claim 18 , wherein, responsive to processing at the ECU of image data captured by the camera, a beam direction of one or more illumination sources is adjusted to illuminate the monitored body portion of the driver of the vehicle.

23. A vehicular driver monitoring system, the vehicular driver monitoring system comprising:
a camera disposed at an interior rearview mirror assembly of a vehicle equipped with the vehicular driver monitoring system, the camera viewing interior of the vehicle and capturing image data;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the camera;
wherein the camera comprises an imaging array sensor and a lens;
wherein the camera comprises an actuator;
wherein the actuator adjusts the camera by at least one selected from the group consisting of (i) adjusting a position of the imaging array sensor relative to the lens and (ii) adjusting a position of the lens relative to the imaging array sensor;
wherein the actuator adjusts the camera by shifting an optical axis of the lens relative to the imaging array sensor so that a center axis of the lens is not at a center region of the imaging array sensor;
wherein the vehicular driver monitoring system, responsive to processing at the ECU of image data captured by the camera, monitors a body portion of a driver of the vehicle; and
wherein the vehicular driver monitoring system, responsive to determining a change in a position of the body portion of the driver relative to a field of view of the camera, adjusts the camera to adjust the position of where the monitored body portion of the driver is imaged at the imaging array sensor.

24. The vehicular driver monitoring system of claim 23 wherein the camera is adjusted to increase resolution of an area of interest of the driver of the vehicle.

25. The vehicular driver monitoring system of claim 24 , wherein the area of interest comprises the eyes of the driver.

26. The vehicular driver monitoring system of claim 24 , wherein the area of interest comprises the hands o

Assignees

• Magna Electronics Inc

Inventors

• Conger Jonathan D
• Byrne Steven V

Classifications

• H04N23/58 Primary

  Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors · CPC title

• B60R1/12

  Mirror assemblies combined with other articles, e.g. clocks · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06V20/597

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title