Vehicle cabin monitoring system

Patent metadata

Field	Value
Publication number	US-11155226-B2
Application number	US-201815999128-A
Country	US
Kind code	B2
Filing date	Aug 17, 2018
Priority date	Aug 17, 2018
Publication date	Oct 26, 2021
Grant date	Oct 26, 2021

Abstract

A system and method for calibrating a vision system includes a selective wavelength interactive material located within the cabin of the vehicle and a control system in communication with the camera. The material is arranged as a pattern having pattern elements configured to reflect or absorb infrared light from an infrared light source. The control system is configured compare a captured image from the vision system that shows the pattern elements and calibrate the vision system based on a comparison of the captured image. Additionally or alternatively, the selective wavelength interactive material is disposed on a surface of a safety belt and the control system is configured to determine that an occupant seated in a seat is wearing a safety belt associated with the seat when the captured images show that the selective wavelength interactive material on the surface of the safety belt extending across the occupant seated.

First claim

The invention claimed is:

1. A system for calibrating a camera mounted to a vehicle, the system comprising:
the camera configured so as to have a field of view of at least a portion of a cabin of the vehicle, the camera configured to capture one or more images of the field of view of at least the portion of the cabin of the vehicle;
a selective wavelength interactive material located within the cabin of the vehicle and within the field of view, the selective wavelength interactive material shaped as a pattern having pattern elements dimensionally located from one another in a known arrangement;
a processor in communication with the camera, the processor being configured to receive the one or more images, the one or more images showing reflective or absorbing portions of the pattern having pattern elements; and
wherein the processor is configured to perform a comparison of a captured arrangement of the pattern having pattern elements from the one or more images to the known arrangement and calibrate the camera based on the comparison of the captured arrangement to the known arrangement;
wherein the selective wavelength interactive material is located on a fixed surface within the cabin of the vehicle;
wherein the pattern elements of the pattern are separated from one another by a known distance; and
wherein calibrating the camera includes determining a position of the camera in relation to the fixed surface within the cabin of the vehicle based on a difference between the known distance and a distance between the pattern elements of the pattern of the selective wavelength interactive material from the one or more images captured by the camera.

2. The system of claim 1 , wherein the fixed surface is a pillar of the vehicle.

3. The system of claim 1 , wherein the processor is further configured to:
determine a distance between the pattern elements of the pattern from the one or more images captured by the camera;
compare the known distance to the distance between the pattern elements of the pattern from the one or more images captured by the camera; and
calibrate the camera based on a difference between the known distance and the distance between the pattern elements of the pattern from the one or more images captured by the camera.

4. The system of claim 1 , wherein the selective wavelength interactive material is located on a movable surface within the cabin of the vehicle.

5. The system of claim 4 , wherein the processor is further configured to:
determine a distance between the pattern elements of the pattern from the one or more images captured by the camera;
compare the known distance to the distance between the pattern elements of the pattern from the one or more images captured by the camera; and
determine a location of the movable surface relative to the camera based on a difference between the known distance and the distance between the pattern elements of the pattern from the one or more images captured by the camera.

6. The system of claim 5 , wherein the movable surface is a seat or headrest of the seat located within the cabin of the vehicle.

7. The system of claim 1 , wherein the camera includes at least one infrared camera.

8. The system of claim 1 , wherein the selective wavelength interactive material is a reflective or absorbing material configured to reflect or absorb light.

9. A system determining when an occupant seated in a seat is wearing a safety belt associated with the seat, the system comprising:
a camera mounted and configured to have a field of view of the occupant seated in the seat, the camera configured to capture one or more images of the field of view of the occupant seated in the seat;
a first amount of selective wavelength interactive material disposed on a surface of the safety belt, the first amount of selective wavelength interactive material configured to reflect or absorb infrared light from an infrared light source;
a processor in communication with the camera, the processor being configured to receive the one or more images, the one or more images showing reflective or absorbing portions of the first amount of selective wavelength interactive material on the surface of the safety belt;
wherein the processor is configured to determine that the occupant seated in the seat is wearing a safety belt associated with the seat when the one or more images show reflective or absorbing portions of the first amount of the selective wavelength interactive material on the surface of the safety belt extending across the occupant seated in the seat;
a second amount of the selective wavelength interactive material located on a surface and shaped as a pattern having pattern elements dimensionally located from one another in a known arrangement;
wherein the second amount of the selective wavelength interactive material is located on a fixed surface;
wherein the pattern elements of the pattern of the second amount of the selective wavelength interactive material are separated from one another by a known distance; and
wherein the processor is further configured to:
determine a distance between the pattern elements of the pattern of the second amount of the selective wavelength interactive material from the one or more images captured by the camera;
compare the known distance to the distance between the pattern elements of the pattern of the second amount of the selective wavelength interactive material from the one or more images captured by the camera; and
determine a position of the camera in relation to the fixed surface based on a difference between the known distance and the distance between the pattern elements of the pattern of the second amount of the selective wavelength interactive material from the one or more images captured by the camera.

10. The system of claim 9 , wherein the processor is configured to determine that the occupant is seated in the seat when the one or more images show a head of the occupant or head and shoulders of the occupant located in a position adjacent to the seat.

11. The system of claim 9 , wherein the processor is configured to determine that the occupant seated in the seat is wearing a safety belt associated with the seat when the one or more images show reflective or absorbing portions of the first amount of the selective wavelength interactive material on the surface of the safety belt extending between a shoulder of the occupant and a webbing guide of the safety belt.

12. The system of claim 9 , wherein the first amount of selective wavelength interactive material is shaped as a pattern having pattern elements, the pattern elements are dimensionally located from one another in a known arrangement.

13. The system of claim 12 , wherein the processor is further configured to determine that the occupant seated in the seat is wearing a safety belt associated with the seat when the one or more images show the pattern of the first amount of the selective wavelength interactive material on the surface of the safety belt extending across the occupant seated in the seat.

14. The system of claim 9 , wherein the fixed surface is a pillar located within a cabin of a vehicle.

15. The system of claim 9 , wherein the second amount of selective wavelength interactive material is located on a movable surface within a cabin of a vehicle.

16. The system of claim 15 , wherein the processor is further configured to:
determine a distance between the pattern elements of the pattern of the second amount of the selective wavelength interactive material from the one or more images captured by the camera;
compare the known distance to t

Assignees

• Veoneer Us Inc

Inventors

• Herbert Thomas
• Judge Frank
• Karolak Paul
• Buettner Christof

Classifications

• B60R21/01538 Primary

  for image processing, e.g. cameras or sensor arrays · CPC title

• G06T7/80 Primary

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title

• G06V10/143

  Sensing or illuminating at different wavelengths · CPC title

• G06V20/59

  inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions · CPC title