Visible light communication system with pixel alignment for high data rate

Patent metadata

Field	Value
Publication number	US-10348404-B1
Application number	US-201815975033-A
Country	US
Kind code	B1
Filing date	May 9, 2018
Priority date	May 9, 2018
Publication date	Jul 9, 2019
Grant date	Jul 9, 2019

Abstract

A visible light communication system has a two-dimensional array of sources and an image sensor with a pixel grid defining a pixel direction (which in some embodiments is a rolling shutter direction). Modulation of the light flashes the sources to define a series of one-dimensional patterns encoding the data to be transmitted. The patterns extend in a direction that projects onto the imager orthogonal to the pixel direction. In the case of a rolling shutter, the pattern is orthogonal to the rolling shutter direction, which allows the encoding of multiple bits per line of the image frame. In other cases, the orthogonal direction obtains the maximum resolving power available from the image sensor.

First claim

What is claimed is:

1. A light communication system comprising:
a transmitter modulating an array of light sources to encode data, wherein the array of light sources is comprised of a plurality of LEDs in a two-dimensional grid;
a receiver with a two-dimensional array of pixels defining rows and columns imaging the sources to receive the data using a rolling shutter in a predetermined direction;
wherein the transmitter initially emits a serial data signal;
wherein the transmitter and receiver exchange performance characteristics after the receiver detects modulation of the sources by the serial data signal;
wherein the receiver and transmitter establish a return channel to exchange performance characteristics to determine whether the receiver can resolve a parallel data signal encoded by sub-blocks of the LEDs in the array of light sources: and
wherein, if the receiver can resolve the parallel data signal, the transmitter further modulates the light sources to encode bits of the data in adjacent sub-blocks of the LEDs aligned in a one-dimensional pattern extending orthogonal to the predetermined direction as received by the receiver.

2. The system of claim 1 wherein the array of pixels is comprised of a CMOS image sensor.

3. The system of claim 1 wherein the performance characteristics from the receiver to the transmitter are sent by the return channel using light communication.

4. The system of claim 1 wherein the performance characteristics from the receiver to the transmitter are sent by the return channel using RF communication.

5. The system of claim 1 wherein performance characteristics are selected from a group comprising number of light sources, arrangement of light sources, number of receiver pixels, arrangement of receiver pixels, nominal exposure time for a pixel row of the receiver, apparent size of a sub-block of a modulated group of light sources as detected by the receiver, relative orientations of the transmitter and receiver, identification of the predetermined rolling shutter direction, and relative movement between the transmitter and receiver.

6. The system of claim 1 wherein at least some of the sub-blocks include a plurality of adjacent light sources to encode a respective bit of the data.

7. The system of claim 1 wherein the transmitter adjusts the alignment of the one-dimensional pattern according to an identification of the predetermined rolling shutter direction.

8. A method of transmitting data using visible light communication (VLC), comprising:
a VLC transmitter emitting a serial data signal from a two-dimensional LED array;
a VLC receiver detecting the serial data signal by monitoring images collected by an image sensor having a two-dimensional pixel array;
the VLC receiver establishing a return channel for communicating with the VLC transmitter;
the VLC receiver and the VLC transmitter exchanging performance characteristics to determine whether the VLC transmitter can emit parallel data bits from respective LED blocks within the LED array which can be resolved by the VLC receiver;
the VLC transmitter modulating the respective LED blocks to encode parallel bits of the data in a one-dimensional pattern extending along a pixel direction of the image sensor.

9. The method of claim 8 wherein the image sensor is comprised of a CMOS image sensor with a rolling shutter, and wherein the pixel direction along which the one-dimensional pattern extends is orthogonal to a direction of the rolling shutter.

10. The method of claim 9 wherein a period for modulating the respective LED blocks is less than an exposure time of a row of pixels for the rolling shutter.

11. The method of claim 8 further comprising the steps of:
reading out an image from the image sensor from a sub-windowing region substantially restricted to receiving light from the LED array; and
decoding the one-dimensional pattern to recover the parallel bits.

12. The method of claim 8 wherein the performance characteristics include a geometry of the serial data, and wherein the LED blocks that are modulated to encode parallel bits of the data in a one-dimensional pattern are adjusted in order to compensate for a distortion exhibited by the geometry.

13. The method of claim 8 wherein the image sensor is comprised of a charge-coupled device (CCD).

14. The method of claim 8 wherein the image sensor is configured to read out images using a global shutter.

Assignees

• Ford Global Tech Llc

Inventors

• Herman David M
• Inskeep Grant

Classifications

• H04N25/75

  Circuitry for providing, modifying or processing image signals from the pixel array · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04B10/0793

  Network aspects, e.g. central monitoring of transmission parameters · CPC title

• H04B10/67

  Optical arrangements in the receiver · CPC title