System and method of efficient illuminator-sensor synchronization to capture images

Patent metadata

Field	Value
Publication number	US-10949647-B2
Application number	US-201715808868-A
Country	US
Kind code	B2
Filing date	Nov 9, 2017
Priority date	Nov 10, 2016
Publication date	Mar 16, 2021
Grant date	Mar 16, 2021

Abstract

A method, system, and article of efficient illuminator and camera sensor synchronization to capture images comprises generating a sequence of frames each associated with a captured image and comprising operating an electronic shutter using vertical-blanks (vblanks) occurring between the last reset of a previous frame and a first read of a current frame consecutively after the previous frame of the sequence of frames. The generating also comprises receiving, by at least one camera sensor, from at least one infra-red-related illuminator and limited to a time within or equal to the vblanks so that the illuminator is turned on and off at the same vblank, and sensing the received light at the camera sensor to convert the light into image data to form the frames in the sequence of frames.

First claim

What is claimed is:

1. A method of illuminator-sensor synchronization to capture images, comprising
generating a sequence of frames each associated with a captured image and comprising:
operating an electronic shutter using vertical-blanks (vblanks) occurring between the last reset of a previous frame and a first read of a current frame consecutively after the previous frame of the sequence of frames;
receiving, by at least one camera sensor, from at least one infra-red-related illuminator and limited to a time within or equal to the vblanks so that the illuminator is turned on and off at the same vblank; and
sensing the received light at the camera sensor to convert the light into image data to form the frames in the sequence of frames,

wherein the illuminator generates the light as infra-red light from at least one vertical-cavity surface emitting laser (VCSEL),
wherein a latency is inserted both between the last reset of the previous frame and the time the illuminator is turned on and the time the illuminator is turned off and the first read of the current frame.

2. The method of claim 1 wherein the vblanks are extended to start about at the end of the last reset of the previous frame and end at about the start of the first read of the current frame.

3. The method of claim 1 wherein the vblanks extend about 17 ms for frames processed at about 30 frames-per-second using at least one vertical-cavity surface emitting laser (VCSEL) as a light source of the illuminator.

4. The method of claim 1 comprising:
receiving light from the illuminator every other vblank to provide light to form every other frame in the sequence of frames; and
performing frame subtraction comprising subtracting a dark frame from an adjacent lit frame to reduce ambient light.

5. The method of claim 1 wherein light received from the illuminator provides the same amount of light for each of the rows in a frame.

6. The method of claim 1 comprising receiving light from the illuminator for a duration that matches the duration of a vblank, and repeated for individual vblanks.

7. The method of claim 1 comprising receiving light from the illuminator for a duration that is less than the duration of a vblank, and repeated for individual vblanks.

8. The method of claim 7 comprising providing a sync signal indicating timing of vblanks to be used to sync the vblanks with the illumination of the illuminator.

9. A method of illuminator-sensor synchronization to capture images, comprising:
emitting light from at least one infra-red-related illuminator to have the light collected to form a sequence of frames with each frame forming an image; and
timing the light to emit from the illuminator within vertical-blanks (vblanks) occurring between a last reset of a previous frame to a first read of a current frame happening consecutively after the previous frame so that the illuminator is turned on and off at the same continuous vblank,
wherein the illuminator generates the light from at least one vertical-cavity surface emitting laser (VCSEL),
wherein a latency is inserted both between the last reset of the previous frame and the time the illuminator is turned on and the time the illuminator is turned off and the first read of the current frame.

10. The method of claim 9 comprising providing the power of the illuminator in pulses; and setting the duty cycle so that pulses provide one or more high peak current pulses during an individual vblank.

11. The method of claim 10 comprising sequencing the pulses so that individual vblanks receive light from the illuminator in one high peak pulse.

12. The method of claim 10 wherein a pulse width is about 17 ms to match a duration of the vblank and by using at least one vertical-cavity surface emitting laser (VCSEL) as a light source of the illuminator.

13. The method of claim 9 comprising performing frame subtraction to reduce ambient light comprising turning on the illuminator every other vblank to provide light to form every other frame in the sequence of frames.

14. A system for capturing images, comprising:
at least one IR or NIR illuminator to emit light;
at least one image capture device to capture a frame sequence and having at least one sensor to collect light from the illuminator by using an electronic shutter using vertical-blanks (vblanks) occurring between the last reset of a previous frame and a first read of a current frame consecutively after the previous frame of the sequence of frames;
at least one processor communicatively coupled to the at least one illuminator;
at least one memory communicatively coupled to at least one processor; and
an illuminator-sensor sync unit operated by the processor and to operate by setting the illuminator to emit light at a time within or equal to the vblanks so that the illuminator is turned on and off at the time of the same vblank, and
wherein the at least one camera sensor receives the light within the vblanks and senses the received light to convert the light into image data to form the frames in the frame sequence,
wherein the illuminator comprises at least one vertical-cavity surface emitting laser (VCSEL) to provide the light as infra-red light,
wherein a latency is inserted both between the last reset of the previous frame and the time the illuminator is turned on and the time the illuminator is turned off and the first read of the current frame.

15. The system of claim 14 comprising the illuminator being set to turn on every other frame in the sequence of frames to perform frame subtraction to reduce ambient light.

16. The system of claim 14 comprising a camera control to receive a sync signal from the at least one image capture device and provide sync parameters based on the sync signal.

17. The system of claim 16 wherein the illuminator-sensor sync unit uses the sync parameters to control the illuminator.

18. The system of claim 14 wherein the vblanks are extended to start about at the end of the last reset of the previous frame and end at about the start of the first read of the current frame.

19. The system of claim 14 wherein the illuminator is powered to provide light in pulses, and has a duty cycle set so that pulses provide one or more high peak current pulses during an individual vblank.

20. The system of claim 14 wherein the illuminator is arranged so that light is received in the same duration for each of the rows.

21. An article having a non-transitory computer readable media comprising a plurality of instructions that in response to being executed on one or more processors, cause the processor(s) to operate by:
generating a sequence of frames each associated with a captured image and comprising:
operating an electronic shutter using vertical-blanks (vblanks) occurring between the last reset of a previous frame and a first read of a current frame consecutively after the previous frame of the sequence of frames;
receiving, by at least one camera sensor, light from at least one infra-red-related illuminator and limited to a time within or equal to the vblanks so that the illuminator is turned on and off at the same vblank; and
sensing the received light at the camera sensor to convert the light into image data to form the frames in the sequence of frames,

wherein the illuminator comprises a vertical cavity surface emitting laser (VCSEL) based light source;
wherein a latency is inserted both between the last reset of the previous frame and the time the illuminator is turned on and the time the illum

Assignees

• Intel Corp

Inventors

• Hicks Richmond
• Ahmed Khaled
• Zhang Haibo

Classifications

• G06V10/60 Primary

  relating to illumination properties, e.g. using a reflectance or lighting model · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V10/145

  Illumination specially adapted for pattern recognition, e.g. using gratings · CPC title

• H04N23/20

  for generating image signals from infrared radiation only · CPC title

• G06V40/166

  using acquisition arrangements · CPC title