Time based seatbelt routing detection via in-cabin sensors

Patent metadata

Field	Value
Publication number	US-11148636-B2
Application number	US-201916679659-A
Country	US
Kind code	B2
Filing date	Nov 11, 2019
Priority date	Nov 11, 2019
Publication date	Oct 19, 2021
Grant date	Oct 19, 2021

Abstract

A system for detecting seatbelt routing includes: a state module configured to, based on a series of images over a period of time from a camera of a vehicle facing a seat, determine and output a routing state of a seatbelt of the seat; and a remediation module configured to, based on the routing state of the seatbelt of the seat, selectively perform at least one remedial action.

First claim

What is claimed is:

1. A system for detecting seatbelt routing, comprising:
a state module configured to, based on a series of images over a period of time from a camera of a vehicle facing a seat, determine and output a routing state of a seatbelt of the seat,
wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the seatbelt being routed under an arm of an occupant of the seat in response to a determination that:
a shoulder portion of the seatbelt was located on a shoulder of the occupant in a first image captured at a first time by the camera;
the shoulder portion was located across the arm of the occupant in a second image captured at a second time by the camera, wherein the second time is after the first time; and
the shoulder portion was located under the arm of the occupant in a third image captured at a third time by the camera, wherein the third time is after the second time; and

a remediation module configured to, based on the routing state of the seatbelt of the seat, selectively perform at least one remedial action.

2. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of proper routing of the seatbelt after seat belt buckling in response to a determination that, based on at least one of the images from the camera captured within a predetermined period before buckling of the seatbelt, the shoulder portion of the seatbelt was located in front of the occupant while the occupant was sitting on the seat.

3. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of a lap portion of the seatbelt being improperly routed behind the occupant of the seat in response to a determination that, based on at least one of the images from the camera:
the occupant entered the seat after buckling of the seatbelt; and
the shoulder portion of the seatbelt transitions to being located in front of the occupant after the occupant entered the seat.

4. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of both a lap portion and the shoulder portion of the seatbelt being improperly routed behind the occupant of the seat in response to a determination that, based on at least one of the images from the camera:
the occupant entered the seat after buckling of the seatbelt; and
the shoulder portion of the seatbelt is not located in front of the occupant after the occupant entered the seat.

5. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the seat being not occupied by the occupant in response to a determination that, based on at least one of the images from the camera:
no occupant was present in the seat during buckling of the seatbelt and no occupant entered the seat after buckling of the seatbelt.

6. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of a lap portion of the seatbelt being improperly routed behind the occupant of the seat in response to a determination that, based on at least one of the images from the camera:
the occupant entered the seat during buckling of the seatbelt; and
the shoulder portion of the seatbelt transitions from being behind the occupant during buckling to being located in front of the occupant after buckling.

7. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the seatbelt being routed under the arm of the occupant of the seat in response to a determination that, based on at least one of the images from the camera:
the occupant was seated on the seat during buckling of the seatbelt; and
a trajectory of the seatbelt within a predetermined period before the buckling was under the arm of the occupant.

8. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the seatbelt being routed across the arm of the occupant of the seat in response to a determination that, based on at least one of the images from the camera:
the occupant was seated on the seat during buckling of the seatbelt; and
a trajectory of the seatbelt within a predetermined period before the buckling was across the arm of the occupant.

9. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the seatbelt being routed on a wrong side of a head of the occupant of the seat in response to a determination that, based on at least one of the images from the camera:
the occupant was seated on the seat during buckling of the seatbelt; and
a trajectory of the seatbelt within a predetermined period before the buckling was on a side of the head the occupant closest to a buckle of the seat.

10. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the shoulder portion of the seatbelt being routed behind the occupant of the seat in response to a determination that, based on at least one of the images from the camera:
the occupant was seated on the seat during buckling of the seatbelt; and
the shoulder portion of the seatbelt is not visible on a torso of the occupant after the buckling.

11. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the seatbelt being routed on a wrong side of a head of the occupant of the seat in response to a determination that:
the shoulder portion of the seatbelt was located on a shoulder of the occupant in a fourth image captured at a fourth time by the camera;
the shoulder portion was located over the head of the occupant in a fifth image captured at a fifth time by the camera, wherein the fifth time is after the fourth time; and
the shoulder portion was located on the wrong side of the head of the occupant and across a torso of the occupant in a sixth image captured at a sixth time by the camera, wherein the sixth time is after the fifth time.

12. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the shoulder portion of the seatbelt being routed behind the occupant of the seat in response to a determination that:
the shoulder portion of the seatbelt was located on a shoulder of the occupant in a fourth image captured at a fourth time by the camera;
the shoulder portion was located over a head of the occupant in a fifth image captured at a fifth time by the camera, wherein the fifth time is after the fourth time; and
the shoulder portion was not located on a torso of the occupant in a sixth image captured at a sixth time by the camera, wherein the sixth time is after the fifth time.

13. The system of claim 1 wherein the state module is configured to set the routing state of the seatbelt to a state indicative of the seatbelt being routed across the arm of the occupant of the seat in response to a determination that:
the shoulder portion of the seatbelt was located on a shoulder of the occupant in a fourth image captured at a fourth time by the camera; and
the shoulder portion was located across the arm of the occupant in a fifth image captured at a fifth time by the camera, wherein the fifth time is after the fourth time.

14. The system of claim 1 wherein the state module is configured to maintain the routing state the seatbelt in response to

Assignees

• Gm Global Tech Operations Llc

Inventors

• Thomas Scott D
• Baltaxe Michael
• Nistel Kobi
• Mergui Ruben

Classifications

• G06V20/593

  Recognising seat occupancy · CPC title

• G06V20/59

  inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions · CPC title

• G06T2207/30268

  Vehicle interior · CPC title

• B60W2050/143

  Alarm means · CPC title

• B60R2022/4866

  Displaying or indicating arrangements thereof · CPC title