3D time of flight active reflecting sensing systems and methods

Patent metadata

Field	Value
Publication number	US-11447085-B2
Application number	US-202016983542-A
Country	US
Kind code	B2
Filing date	Aug 3, 2020
Priority date	Dec 7, 2016
Publication date	Sep 20, 2022
Grant date	Sep 20, 2022

Abstract

The system and method provide for identification of dynamic objects in an enclosed space and the presence of a component in a primary location. The system uses an active electro-optical 3D sensor, such as a three-dimensional time of flight camera, to identify the presence or absence of a reflected pulse, to determine, for example, proper placement of a seat belt, or a change in characteristics of a reflected pulse to determine a change in location, and thus possible movement, of a living creature in a vehicle, for example.

First claim

The invention claimed is:

1. A system for classifying objects within an identified volume of space, comprising:
an electro-optical sensor in communication with a processor and computerized memory storing computer-implemented software thereon;
a reflective surface capable of reflecting an optical signal back to the electro-optical sensor;
wherein the reflective surface is at least partially within a first line of sight originating from the electro-optical sensor;
wherein the reflective surface is positioned relative to the identified volume of space such that a second line of sight originating from the reflective surface encompasses at least a portion of the identified volume of space;
an indirect reflective surface defining a third line of sight, wherein the indirect reflective surface is within the second line of sight originating at the reflective surface but is not within the first line of sight originating from the electro-optical sensor, and wherein the third line of sight originating from the indirect reflective surface includes at least a portion of the identified volume that is not in the first line of sight originating with the active electro-optical sensor;
wherein the optical signal reflected from the reflective surface back to the electro-optical sensor comprises image data gathered by the reflective surface via the second line of sight into the identified volume;
wherein if characteristics of the optical signal as reflected by the reflective surface at a first time differ from later characteristics of the optical signal as reflected by the reflective surface at a second time, the sensor uses the software to identify movement data in any possible mechanical degree of freedom for the objects within the identified volume, wherein the software is configured to use the movement data to categorize the object as static, semi-static, or dynamic.

2. A system according to claim 1 , wherein the electro-optical sensor comprises an array of optically sensitive pixels receiving the optical signal and transmitting respective image data signals to the processor for analysis by the software.

3. A system according to claim 1 , wherein the first line of sight includes the image data gathered by the reflective surface such that an effective field of view for the electro-optical sensor comprises the first line of sight and at least a portion of the second line of sight.

4. A system according to claim 1 , further comprising computer controlled alarm functions stored in the memory and in communication with the processor, wherein the alarm functions are configured to activate an alarm in accordance with predetermined rules established in the software for categories of objects identified by the software with the movement data.

5. The system of claim 1 , wherein the identified volume is not within the first line of sight or the second line of sight.

6. The system of claim 1 , wherein the electro-optical sensor is a three-dimensional (3D) time of flight camera.

7. The system of claim 6 , wherein the three-dimensional (3D) time of flight camera operates at infrared frequencies.

8. A system for classifying objects within an identified volume of space in a vehicle, comprising:
an electro-optical sensor positioned inside the vehicle with a first line of sight facing toward a rear of the vehicle, the electro-optical sensor in communication with a processor and computerized memory storing computer-implemented imaging software thereon;
a component in the vehicle comprising a surface sending an optical signal to the electro-optical sensor;
wherein the surface is within the first line of sight originating from the electro-optical sensor;
wherein the surface is positioned relative to the identified volume of space such that a second line of sight originating from the surface encompasses at least a portion of the identified volume of space;
an indirect reflective surface defining a third line of sight, wherein the indirect reflective surface is within the second line of sight originating at the surface but is not within the first line of sight originating from the electro-optical sensor, and wherein the third line of sight originating from the indirect reflective surface includes at least a portion of the identified volume that is not in the first line of sight originating with the active electro-optical sensor;
wherein the optical signal reflected from the surface back to the electro-optical sensor comprises image data gathered by the surface via the second line of sight into the identified volume;
wherein if characteristics of the optical signal as reflected by the reflective surface at a first time differ from later characteristics of the optical signal as reflected by the reflective surface at a second time, the sensor identifies movement data corresponding to the objects within the identified volume via the software.

9. The system of claim 8 , further comprising:
a second electro-optical sensor positioned inside the vehicle with a different line of sight facing toward a front of the vehicle, the second electro-optical sensor in communication with a respective processor and respective computerized memory storing respective computer-implemented imaging software thereon; and
additional components within the vehicle within the different line of sight, the additional components having respective surfaces sending respective optical signals back to the second electro-optical sensor.

10. The system of claim 9 , wherein the surface is entirely within the first line of sight of the electro-optical sensor.

11. The system of claim 9 , wherein the surface comprises a non-uniform reflectivity configured to send the optical signal back to the electro-optical sensor.

12. The system of claim 9 , wherein if characteristics of the optical signal as reflected by the surface at a first time differ from later characteristics of the optical signal as reflected by the surface at a second time, the sensor uses the software to identify movement data corresponding to the objects within the identified volume, wherein the software is configured to use the movement data to categorize the object as static, semi-static, or dynamic.

13. A system for classifying objects within an identified volume of space in a vehicle, comprising:
an electro-optical sensor positioned inside the vehicle with a first line of sight, the electro-optical sensor in communication with a processor and computerized memory storing computer-implemented imaging software thereon;
a component in the vehicle comprising a reflective surface transmitting an optical signal to the electro-optical sensor;
wherein the reflective surface is within the first line of sight originating from the electro-optical sensor;
wherein the reflective surface is positioned relative to the identified volume of space such that a second line of sight originating from the reflective surface encompasses at least a portion of the identified volume of space;
an indirect reflective surface defining a third line of sight, wherein the indirect reflective surface is within the second line of sight originating at the reflective surface but is not within the first line of sight originating from the electro-optical sensor, and wherein the third line of sight originating from the indirect reflective surface includes at least a portion of the identified volume that is not in the first line of sight originating with the active electro-optical sensor;
wherein the optical signal reflected from the reflective surface back to the electro-optical sensor comprises image data gathered by the reflective surface via the second line of sight into the identified volume, and t

Assignees

• Joyson Safety Systems Acquisition Llc

Inventors

• Naghizadeh Hamid
• Cech Leonard

Classifications

• G01S17/26

  wherein the transmitted pulses use a frequency-modulated or phase-modulated carrier wave, e.g. for pulse compression of received signals · CPC title

• B60R21/01538

  for image processing, e.g. cameras or sensor arrays · CPC title

• B60R2022/4816

  for sensing locking of buckle · CPC title

• G01S7/4808

  Evaluating distance, position or velocity data · CPC title

• G01S7/4865

  Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak (peak detection in noise, signal conditioning G01S7/487) · CPC title