Method and apparatus for monitoring a rear passenger seating area of a vehicle

Patent metadata

Field	Value
Publication number	US-9446770-B2
Application number	US-201514608776-A
Country	US
Kind code	B2
Filing date	Jan 29, 2015
Priority date	Jan 29, 2015
Publication date	Sep 20, 2016
Grant date	Sep 20, 2016

Abstract

A vehicle including a passenger compartment having a rear seating area is described. A method for monitoring the rear seating area of the passenger compartment includes monitoring a vehicle operating state comprising one of a key-on state and a key-off state and monitoring the rear seating area. A presence or absence of a passenger in the rear seating area is detected based upon the monitoring, and a control routine is executed based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area.

First claim

The invention claimed is:

1. A method for monitoring a rear seating area of a passenger compartment of a vehicle, the method comprising:
monitoring, by an on-vehicle controller, a vehicle operating state comprising one of a key-on state and a key-off state;
monitoring the rear seating area to detect presence or absence of a passenger in the rear seating area, including monitoring input signals associated with a plurality of sensing devices and monitoring actuator commands from control elements associated with the rear seating area, and executing a sensor fusion routine to evaluate the input signals and the actuator commands; and
executing a control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area, including executing an audio signal processing routine to detect the presence or absence of a passenger in the rear seating area, including:
dynamically capturing audio signals employing the front and rear microphones;
determining differences in times of arrival of the audio signals between the front and rear microphones;
determining differences in magnitudes of power of the audio signals between the front and rear microphones; and
evaluating the differences in times of arrival of the audio signals and the differences in magnitudes of power of the audio signals to determine the presence of a passenger in the rear seating area.

2. The method of claim 1 , wherein monitoring input signals associated with a plurality of sensing devices comprises monitoring input signals from at least one of a rear door latch sensor, a rear seat belt/buckle sensor, a rear seat occupant sensor, front and rear microphones and a rear seat camera.

3. The method of claim 1 , wherein monitoring the rear seating area further comprises monitoring actuator commands from control elements associated with the rear seating area.

4. The method of claim 3 , wherein monitoring actuator commands from control elements associated with the rear seating area comprises monitoring actuator commands from at least one of a rear door window control switch, a rear seat position control, a rear seat HVAC control and a rear seat infotainment system and controls.

5. The method of claim 1 , wherein executing the sensor fusion routine to evaluate the input signals and the actuator commands comprises employing logic operators to evaluate the input signals and the actuator commands.

6. The method of claim 1 , further comprising dynamically executing a frequency spectrum analysis of the audio signals captured by the front and rear microphones to detect audible sounds associated with human speech and a magnitude of power associated therewith.

7. The method of claim 1 , wherein executing a control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area comprises executing a rear seat-specific active noise cancellation routine only when a passenger is determined to be present in the rear seating area and the vehicle is in the key-on state.

8. A method for monitoring a rear seating area of a passenger compartment of a vehicle, the method comprising:
monitoring, by an on-vehicle controller, a vehicle operating state comprising one of a key-on state and a key-off state;
monitoring the rear seating area to detect presence or absence of a passenger in the rear seating area and
executing a control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area
wherein executing the control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area comprises executing an passenger distress detection routine when a passenger is present in the rear seating area and the vehicle is in the key-off state.

9. The method of claim 8 , wherein executing a passenger distress detection routine comprises:
collecting, via an in-vehicle microphone, in-vehicle sounds;
executing a speech recognition routine including a frequency spectrum analysis of the in-vehicle sounds;
determining formants using the frequency spectrum analysis;
evaluating formants of the monitored audible data to determine whether they correspond to speech indicating passenger distress; and
executing appropriate action when the formants correspond to speech indicating passenger distress.

10. The method of claim 9 , wherein executing appropriate action when the formants correspond to speech indicating passenger distress comprises one of commanding opening one or more of the vehicle windows, adjusting ambient temperature in the passenger compartment by starting the vehicle and activating the HVAC system, and employing an on-board extra-vehicle communications system and associated GPS to notify emergency personnel of the vehicle location.

11. A method for monitoring a rear seating area of a vehicle passenger compartment that includes an extra-vehicle communications system and a rear seat-specific active noise cancellation device, the method comprising:
monitoring a vehicle operating state comprising one of a key-on state and a key-off state;
monitoring the rear seating area to detect a presence of a passenger in the rear seating area;
executing a control routine including operating one of the extra-vehicle communications system and the rear seat-specific active noise cancellation device based upon the vehicle operating state when presence of a passenger is detected in the rear seating area; and
executing a distress detection routine when a passenger is present in the rear seating area and the vehicle is in the key-off state, the distress detection routine including:
collecting, via an in-vehicle microphone, in-vehicle sounds,
executing a speech recognition routine including a frequency spectrum analysis of the in-vehicle sounds,
determining formants using the frequency spectrum analysis,
evaluating formants of the monitored audible data to determine whether they correspond to speech indicating distress, and
executing appropriate action when the formants correspond to speech indicating distress;
wherein executing appropriate action when the formants correspond to speech indicating distress includes operating the extra-vehicle communications system.

12. The method of claim 11 , further comprising dynamically executing a frequency spectrum analysis of the audio signals captured by the front and rear microphones to detect audible sounds associated with human speech and a magnitude of power associated therewith.

13. The method of claim 11 , wherein monitoring the rear seating area to detect a presence of a passenger in the rear seating area comprises:
monitoring input signals associated with a plurality of sensing devices and monitoring actuator commands from control elements associated with the rear seating area, including executing an audio signal processing routine to detect presence or absence of a passenger in the rear seating area, including:
dynamically capturing audio signals employing the front and rear microphones,
determining differences in times of arrival of the audio signals between the front and rear microphones,
determining differences in magnitudes of power of the audio signals between the front and rear microphones, and
evaluating the differences in times of arrival of the audio signals and the differences in magnitudes of power of the audio signals to determine the presence of a passenger in the rear seating area; and
executing a sensor fusion routine to evaluate the input signals and the actuator commands.

Assignees

• Gm Global Tech Operations Llc

Inventors

• Valeri Frank C
• Reilly Scott M
• Tzirkel-Hancock Eli
• Talwar Gaurav
• Holdren John L
• Zhao Xufang

Classifications

• G10L17/26

  Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices · CPC title

• G01H3/00

  Measuring {characteristics of} vibrations by using a detector in a fluid (G01H7/00, G01H9/00, G01H11/00 take precedence) · CPC title

• G10L25/63

  for estimating an emotional state · CPC title

• B60W2420/54

  Audio sensitive means, e.g. ultrasound · CPC title

• B60R16/0373 Primary

  Voice control (in general G10L) · CPC title