Intensity image acquisition from dynamic vision sensors

Patent metadata

Field	Value
Publication number	US-10348994-B2
Application number	US-201715480972-A
Country	US
Kind code	B2
Filing date	Apr 6, 2017
Priority date	Apr 6, 2017
Publication date	Jul 9, 2019
Grant date	Jul 9, 2019

Abstract

A method for acquiring intensity images through a dynamic vision sensor is provided, the method including resetting an inner state of each of a plurality of pixels in the dynamic vision sensor to a predetermined value; receiving from at least one of the plurality of pixels an event signal based on a change in its inner state indicative of a difference in amount of light incident upon the at least one of the plurality of pixels versus that corresponding to the predetermined value; and integrating over a time period the received event signal for the at least one of the plurality of pixels to determine the intensity of light incident upon the at least one of the plurality of pixels.

First claim

What is claimed is:

1. A method for acquiring intensity images through a dynamic vision sensor, the method comprising:
resetting an inner state of each of a plurality of pixels in the dynamic vision sensor to a predetermined value, wherein the predetermined value is indicative of an amount of light incident upon each of the plurality of pixels;
receiving from at least one of the plurality of pixels an event signal based on a change in its inner state indicative of a difference in amount of light incident upon the at least one of the plurality of pixels versus that corresponding to the predetermined value; and
integrating over a time period the received event signal for the at least one of the plurality of pixels to determine an intensity of light incident upon the at least one of the plurality of pixels.

2. The method of claim 1 wherein the at least one of the plurality of pixels comprises a photodiode.

3. The method of claim 2 wherein the inner state is indicative of a current through the photodiode.

4. The method of claim 1 wherein the event signal is indicative of a change in the inner state reaching a threshold.

5. The method of claim 4 wherein the threshold is based on a logarithmic scale.

6. The method of claim 1 wherein the predetermined value is indicative of no light incident upon each of the plurality of pixels.

7. The method of claim 1 wherein the predetermined value is indicative of an averaged amount of light incident upon each of the plurality of pixels.

8. The method of claim 1 wherein the predetermined value is indicative of a threshold amount of light incident upon each of the plurality of pixels.

9. The method of claim 1 wherein the event signal is received in close temporal proximity to the resetting.

10. The method of claim 1 wherein the predetermined value for the plurality of pixels is different than a second predetermined value for a second plurality of pixels in the dynamic vision sensor.

11. The method of claim 1 wherein the integration time period for the event signal corresponding to the at least one of the plurality of pixels is different than a second integration time period corresponding to at least one of a second plurality of pixels in the dynamic vision sensor.

12. The method of claim 1 , further comprising using the same event signal to detect and output luminance change events as well as image intensities for the at least one of the plurality of pixels in the dynamic vision sensor.

13. An image acquisition device comprising:
a dynamic vision sensor (DVS) having a plurality of pixels, each pixel having an inner state indicative of light intensity upon that pixel and an event output indicative of a threshold change in its inner state;
a timing unit connected to the plurality of pixels through a reset circuit, the reset circuit configured to reset the inner states of each of the plurality of pixels upon a signal from the timing unit; and
an integration unit connected in signal communication with the DVS, and further connected to the timing unit through a synchronization circuit, the integration unit configured to form pixel intensity data by integrating events for each of the plurality of pixels, and provide integrated pixel data as intensity image outputs.

14. The device of claim 13 , further comprising an output splitter connected to the plurality of pixels through an events circuit, and connected to the timing unit through the synchronization circuit, the output splitter configured to separate events output by the plurality of pixels from events output by other pixels.

15. The device of claim 14 , further comprising an events unit connected to the splitter through a regular events circuit, the events unit configured to receive events from the other pixels and provide them as event-based outputs.

16. The device of claim 15 wherein the events unit is configured for event signal processing and packetization.

17. The device of claim 15 , further comprising an interface unit connected to the integration unit and connected to the events unit.

18. The device of claim 17 wherein the interface unit comprises two output channels.

19. The device of claim 18 wherein a first output channel is configured for providing integrated image intensity data.

20. The device of claim 18 wherein a second output channel is configured for providing event-based data.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Zamir Lior
• Levy Nathan Henri

Classifications

• H04N25/533 Primary

  by using differing integration times for different sensor regions · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N25/77

  Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components · CPC title

• H04N5/3535

  Electricity · mapped topic

• H04N5/378 Primary

  Electricity · mapped topic