System and method for optical sensing, visualization, and detection in turbid water using multi-dimensional integral imaging

Patent metadata

Field	Value
Publication number	US-11200691-B2
Application number	US-202016887843-A
Country	US
Kind code	B2
Filing date	May 29, 2020
Priority date	May 31, 2019
Publication date	Dec 14, 2021
Grant date	Dec 14, 2021

Abstract

Systems and methods for optical sensing, visualization and detection in media (e.g., turbid media; turbid water; fog; non-turbid media). A light source and an image sensor are positioned in turbid media or external to the turbid media with the light source within a field of view of the image sensor array. Temporal optical signals are transmitted through the turbid media via the light source and multiple perspective video sequence frames are acquired via the image sensor array of light propagating through the turbid media. A three-dimensional image is reconstructed from each frame and the reconstructed three-dimensional images are combined to form a three-dimensional video sequence. The transmitted optical signals are detected from the three-dimensional video sequence by applying a multi-dimensional signal detection scheme.

First claim

What is claimed is:

1. A method for optical sensing and detection, the method comprising:
positioning a light source and an image sensor array in turbid media or external to turbid media, the light source within a field of view of the image sensor array;
transmitting, by the light source, temporal optical signals through the turbid media;
acquiring, by the image sensor array, multiple perspective video sequence frames of light propagating through the turbid media;
reconstructing a three-dimensional image from each frame;
combining the reconstructed three-dimensional images to form a three-dimensional video sequence; and
detecting the transmitted optical signals from the three-dimensional video sequence by applying a multi-dimensional signal detection scheme.

2. The method of claim 1 , wherein the transmitted temporal optical signals are codes designed for communication.

3. The method of claim 1 , wherein the multi-dimensional signal detection scheme is a four-dimensional correlation filter.

4. The method of claim 1 , wherein the image sensor array includes a one dimensional array of cameras.

5. The method of claim 1 , wherein the image sensor array includes a randomly distributed array of cameras.

6. The method of claim 1 , wherein the light source is a single wavelength light source.

7. The method of claim 1 , wherein the image sensor array is a one dimensional line array having sensors.

8. The method of claim 1 , wherein the image sensor array includes multiple spectral band sensors.

9. The method of claim 1 , wherein the turbid media is turbid water or fog.

10. The method of claim 1 , wherein the light source is a LED light source.

11. The method of claim 1 , wherein the image sensor array is a camera array having CMOS sensors.

12. The method of claim 1 , wherein the optical signals sent through the turbid media are coded by pseudo-random sequences.

13. The method of claim 1 , wherein the three-dimensional video sequence is a four-dimensional data volume having spatial and time domains.

14. The method of claim 1 , wherein the transmitted optical signals are time modulated light signals.

15. The method of claim 1 , wherein the image sensor array includes one or more cameras.

16. The method of claim 1 , wherein the image sensor array includes one or more camera arrays.

17. The method of claim 1 , wherein a dominant wavelength of the light source is adapted for optimum penetration through turbid media.

18. The method of claim 1 , wherein after acquiring multiple perspective two-dimensional video sequence frames of light propagating through the turbid media via the image sensor array, scattering removal by active polarization descattering is applied in order to remove scattered photons.

19. The method of claim 1 , wherein the light source is a polarized light source.

20. The method of claim 1 , wherein a linear polarizer is positioned in front of the image sensor array.

21. The method of claim 1 , wherein a linear polarizer is positioned in front of the light source.

22. The method of claim 1 , wherein the reconstruction and detection steps are performed locally.

23. The method of claim 1 , wherein the reconstruction and detection steps are performed remotely.

24. The method of claim 1 , wherein the image sensor array is a camera sensor array that is positioned so that the light source is partially or completely in the field of view of the camera sensor array.

25. The method of claim 1 , wherein a dominant wavelength of the light source is adapted for optimum penetration through water.

26. The method of claim 1 , wherein the light source is positioned out of the turbid media, and the image sensor array is positioned in the turbid media.

27. The method of claim 1 , wherein the image sensor array is positioned out of the turbid media, and the light source is positioned in the turbid media.

28. The method of claim 1 , wherein the light source can move relative to the turbid media, and the image sensor array is stationary relative to the turbid media.

29. The method of claim 1 , wherein the image sensor array can move relative to the turbid media, and the light source is stationary relative to the turbid media.

30. The method of claim 1 , wherein the light source is within a field of view of a subset of cameras of the image sensor array.

31. The method of claim 1 , wherein the light source and the image sensor array are positioned external to the turbid media.

32. The method of claim 1 , wherein the light source and the image sensor array are positioned at arbitrary distances from one another in the turbid media or external to the turbid media.

33. A method for optical sensing and detection, the method comprising:
positioning a light source and an image sensor array in non-turbid media or external to non-turbid media, the light source within a field of view of the image sensor array;
transmitting temporal optical signals through the non-turbid media via the light source;
acquiring multiple perspective video sequence frames of light propagating through the non-turbid media via the image sensor array;
reconstructing a three-dimensional image from each frame;
combining the reconstructed three-dimensional images to form a three-dimensional video sequence; and
detecting the transmitted optical signals from the three-dimensional video sequence by applying a multi-dimensional signal detection scheme.

Assignees

• Univ Connecticut

Inventors

• Javidi Bahram
• Komatsu Satoru
• Markman Adam

Classifications

• G06V10/145

  Illumination specially adapted for pattern recognition, e.g. using gratings · CPC title

• G06V20/00

  Scenes; Scene-specific elements (control of digital cameras H04N23/60) · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title

• G06T7/557 Primary

  from light fields, e.g. from plenoptic cameras · CPC title

• G06V20/48

  Matching video sequences · CPC title