3D time of flight active reflecting sensing systems and methods

Patent metadata

Field	Value
Publication number	US-10730465-B2
Application number	US-201715834664-A
Country	US
Kind code	B2
Filing date	Dec 7, 2017
Priority date	Dec 7, 2016
Publication date	Aug 4, 2020
Grant date	Aug 4, 2020

Abstract

The system and method provide for identification of dynamic objects in an enclosed space and the presence of a component in a primary location. The system uses an active electro-optical 3D sensor, such as a three-dimensional time of flight camera, to identify the presence or absence of a reflected pulse, to determine, for example, proper placement of a seat belt, or a change in characteristics of a reflected pulse to determine a change in location, and thus possible movement, of a living creature in a vehicle, for example.

First claim

What is claimed is:

1. A system for classifying objects within a space, comprising:
an electro-optical sensor in communication with a processor and computerized memory storing computer-implemented software thereon;
a surface of non-uniform reflectivity reflecting a plurality of optical signals back to the electro-optical sensor over a time period, wherein the optical signals comprise image data that is non-uniform in the spatial domain over the time period;
wherein the surface of non-uniform reflectivity is entirely within a first line of sight originating from the electro-optical sensor;
wherein the surface is positioned relative to an identified volume of space such that a second line of sight originating from the surface encompasses at least a portion of the identified volume of space;
wherein the optical signals reflected from the surface back to the electro-optical sensor comprise image data transmitted by an entirety of the surface via the second line of sight into the identified volume;
wherein the electro-optical sensor identifies movement data corresponding to the objects within the identified volume on a pixel by pixel basis via the software.

2. A system according to claim 1 , wherein the electro-optical sensor comprises an array of optically sensitive pixels receiving the optical signal and transmitting respective image data signals to the processor for analysis by the software.

3. A system according to claim 1 , wherein the software is configured to use the movement data to categorize the object as static, semi-static, or dynamic.

4. A system according to claim 1 , wherein the first line of sight includes the image data gathered by the surface such that an effective field of view for the electro-optical sensor comprises the first line of sight and at least a portion of the second line of sight.

5. A system according to claim 1 , further comprising computer-controlled alarm functions stored in the memory and in communication with the processor, wherein the alarm functions are configured to activate an alarm in accordance with predetermined rules established in the software for categories of objects identified by the software with the movement data.

6. The system of claim 1 , further comprising an indirect reflective surface defining a third line of sight, wherein the indirect reflective surface is within the second line of sight originating at the surface of non-uniform reflectivity but is not within the first line of sight originating from the electro-optical sensor, and wherein the third line of sight originating from the indirect reflective surface includes at least a portion of the identified volume that is not in the first line of sight originating with the active electro-optical sensor.

7. The system of claim 6 , wherein the identified volume is not within the first line of sight or the second line of sight.

8. A system for detecting proper positioning of a movable, component in a vehicle cabin comprising:
an electro-optical three-dimensional (3D) image sensor; and
a surface of non-uniform reflectivity attached to the movable component and reflecting a wavelength of light corresponding to a wavelength operating range for the electro-optical three-dimensional (3D) image sensor, wherein the surface of non-uniform reflectivity is attached to the moveable component such that, if the moveable component is in a primary position, the surface reflects first image data into a first line of sight originating at the electro-optical three-dimensional (3D) image sensor; and
wherein the sensor is configured to generate movement data on a pixel by pixel basis and from spatially non-uniform images comprising pixel data representing at least a portion of the component and the surface of non-uniform reflectivity;
wherein the sensor generates the movement data from differences in the characteristics of reflected light from the surface of non-uniform reflectivity to the electro-optical three-dimensional (3D) image sensor, wherein the movement data is of a sufficient resolution to identify the differences on a pixel by pixel basis.

9. A system according to claim 8 , further comprising a processor and computerized memory storing computer-implemented software that is in data communication with the electro-optical three-dimensional (3D) sensor, wherein the software utilizes the movement data retrieved from the sensor during a time period to trigger at least one alarm regarding the primary position of the component.

10. A system according to claim 9 , wherein the component is a semi-static structure within a vehicle, and the surface reflects image data into the first line of sight for reception by the electro-optical (3D) sensor, wherein the software accesses position data corresponding to allowed degrees of freedom within which the component is allowed to operate without triggering the alarm, and wherein the software utilizes the position data and the image data in a decision to trigger the alarm.

11. A system according to claim 10 , wherein if the component is in a different position, the surface reflects second image data into the first line of sight, and differences between the first image data and the second image data are used by the sensor to calculate the movement data.

12. The system of claim 8 , wherein the wavelength of light is in the visible spectrum.

13. A method of detecting an object within an enclosed space with a three-dimensional (3D) time of flight camera, comprising:
using a surface of non-uniform reflectivity, reflecting a plurality of optical signals back to the 3D time of flight camera over a time period, wherein the optical signals comprise image data that is non-uniform in the spatial domain over the time period;
wherein the surface of non-uniform reflectivity is entirely within a first line of sight originating from the 3D time of flight camera;
transmitting a coded pulse of light from the three-dimensional (3D) time of flight camera into the enclosed space;
detecting a code from the coded pulse of light;
after detecting the code, detecting presence or absence of a returned pulse of light reflected to the three-dimensional (3D) time of flight camera; and
measuring changes in characteristics of the returned pulse of light to determine changes in objects within the enclosed space.

14. The method of claim 13 , wherein presence of the returned pulse of light indicates a component within the enclosed space is in a primary position, and absence of the returned pulse indicates displacement of the component.

15. The method of claim 13 , wherein if characteristics of light returned to the three-dimensional (3D) time of flight camera at a first time differ from characteristics of light returned to the three-dimensional (3D) time of flight camera at a second time, the sensor indicates that either a semi-static or a dynamic object is present in the enclosed space.

16. The method of claim 13 , wherein at least one surface reflects image data from the objects to the three dimensional (3D) time of flight camera, and the image data characterizes either a depth of at least one of the objects or an intensity of an optical signal reflected from the surface.

17. The method of claim 16 , wherein the object is a vehicle component, and further comprising triggering an alarm within a vehicle based on either the depth or the intensity.

18. The method of claim 13 , wherein each of the objects comprises a respective surface that reflects the pulse of light from a first portion of the surface and absorbs the light into a second portion of the surface.

Assignees

• Joyson Safety Systems Acquisition Llc

Inventors

• Naghizadeh Hamid
• Cech Leonard

Classifications

• G06V20/593 Primary

  Recognising seat occupancy · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

• G08B21/24

  Reminder alarms, e.g. anti-loss alarms · CPC title

• G06T2207/30268

  Vehicle interior · CPC title