Apparatus and methods for polychronous encoding and multiplexing in neuronal prosthetic devices

Patent metadata

Field	Value
Publication number	US-9311593-B2
Application number	US-201113117048-A
Country	US
Kind code	B2
Filing date	May 26, 2011
Priority date	Mar 26, 2010
Publication date	Apr 12, 2016
Grant date	Apr 12, 2016

Abstract

Apparatus and methods for encoding sensory input information into patterns of pulses and message multiplexing. In one implementation, the patterns of pulses are polychronous (time-locked by not necessary synchronous), and a retinal prosthetic encodes the input signal into the polychronous patterns for delivery via stimulating electrodes. Different polychronous patterns simultaneously encode different sensory signals; (such as different features of the image), thus providing for message multiplexing. Increasing data transmission capacity allows for a reduction in the number of electrodes required for data transmission. In one implementation, an adaptive feedback mechanism is employed to facilitate encoder operation. In another aspect, a computer vision system is described.

First claim

What is claimed:

1. An apparatus configured to transmit a signal to a vertebrate nervous system, the apparatus comprising:
a processor configured to receive an input signal representative of at least a portion of a visual frame;
an encoder configured to encode the input signal into a plurality of pulses; and
a plurality of stimulating electrodes;
wherein:
at least a subset of the plurality of pulses is configured in a polychronous pattern comprising at least two non-synchronous pulses;
information related to the at least the portion of the visual frame is encoded by the processor into the polychronous pattern;
the polychronous pattern is characterized by a group delay that is common to all pulses within the plurality of pulses, the group delay being determined by a spatiotemporal filter applied to the input signal; and
wherein the polychronous pattern is adapted for transmission via the plurality of stimulating electrodes operably coupled to the vertebrate nervous system.

2. The apparatus of claim 1 , wherein the apparatus comprises at least a portion of a retinal prosthetic device.

3. The apparatus of claim 2 , wherein individual ones of the plurality of stimulating electrodes are configured for operable coupling to a receptor of the vertebrate nervous system, the receptor comprising one or more of a retinal ganglion cell and a retinal bipolar cell.

4. The apparatus of claim 2 , wherein the encoder is configurable to be adaptively adjusted based at least in part on a feedback signal provided by a host of the prosthetic device.

5. The apparatus of claim 4 , wherein:
the encoding of the input signal into the plurality of pulses is characterized by at least one parameter; and
the encoder adaptive adjustment is configured to modify the at least one parameter.

6. A sensory input encoding apparatus, comprising:
a processing apparatus configured to receive and encode a sensory input into a plurality of pulses, the sensory input comprising information indicative of an object characteristic, and the processing apparatus is further configured to encode at least a portion of the plurality of pulses in a first polychronous pattern comprising at least two non-synchronous pulses;
wherein the first polychronous pattern is characterized by a group delay that is common to all pulses within the plurality of pulses, the group delay configured based at least in part on the sensory input;
wherein the sensory input comprises a visual input signal; and
wherein the group delay is based at least in part on an output generated by a spatiotemporal filter using the sensory input.

7. The apparatus of claim 6 , wherein the sensory input comprises a frame of pixels.

8. The apparatus of claim 6 , wherein the first polychronous pattern is generated responsive to a trigger selected from the group consisting of: (i) a temporal event; (ii) a receipt of the sensory input; (iii) an appearance of an object in the sensory input; and (iv) a timer event.

9. The apparatus of claim 6 , wherein the first polychronous pattern is adapted for transmission via a plurality of transmission channels.

10. The apparatus of claim 9 , wherein: at least a subset of the plurality of transmission channels is associated with a channel delay configured to effect a coincident arrival of the at least two non-synchronous pulses at a decoder.

11. The apparatus of claim 10 , wherein the channel delay is configured based at least in part on the first polychronous pattern.

12. The apparatus of claim 11 , wherein the coincident arrival of the at least two non-synchronous pulses at the decoder is configured to indicate presence of the object characteristic in the sensory input.

13. The apparatus of claim 12 , wherein:
the sensory input comprises a plurality of pixels; and
the coincident arrival of the at least two non-synchronous pulses at the decoder is configured to indicate a presence of the object characteristic within the plurality of pixels.

14. A sensory input encoding apparatus, comprising:
a processing apparatus configured to receive and encode a sensory input into a plurality of pulses,
the sensory input comprising information indicative of an object characteristic; and
and the processing apparatus being further configured to encode at least a portion of the plurality of pulses in a first polychronous pattern comprising at least two non-synchronous pulses;
wherein the first polychronous pattern is characterized by a group delay that is common to all pulses within the plurality of pulses, the group delay configured based at least in part on the sensory input;
wherein the first polychronous pattern is adapted for transmission via a plurality of transmission channels; and
wherein at least a subset of the plurality of transmission channels is associated with a channel delay configured to effect a coincident arrival of the at least two non-synchronous pulses at a decoder.

15. The apparatus of claim 14 , wherein the channel delay is configured based at least in part on the first polychronous pattern.

16. The apparatus of claim 15 , wherein:
the group delay is configured with reference to an event; and
the coincident arrival of the at least two non-synchronous pulses at the decoder is configured to indicate a presence of the object within the sensory input.

17. The apparatus of claim 16 , wherein the event is selected from the group consisting of: (i) a temporal event; (ii) a receipt of the sensory input; (iii) an appearance of an object in the sensory input; and (iv) a timer event.

18. The apparatus of claim 14 , wherein the decoder comprises a coincidence detector configured to receive the at least two non-synchronous pulses and to decode the object characteristic responsive to the reception of the at least two non-synchronous pulses.

19. A sensory input encoding apparatus, comprising:
a processing apparatus configured to receive and encode a sensory input into a plurality of pulses,
the sensory input comprising information indicative of an object characteristic; and
and the processing apparatus being further configured to encode at least a portion of the plurality of pulses in a first polychronous pattern comprising at least two non-synchronous pulses;
wherein the first polychronous pattern is characterized by a group delay that is common to all pulses within the plurality of pulses, the group delay configured based at least in part on the sensory input;
wherein the first polychronous pattern is adapted for transmission via individual ones of a plurality of transmission channels; and
wherein at least a subset of the plurality of the transmission channels is configurable based on a second polychronous pattern generated prior to the first polychronous pattern.

20. The apparatus of claim 19 , wherein the configuration of the subset of the plurality of the transmission channels based on the second polychronous pattern comprises a configuration of a channel delay of the subset of the plurality of the transmission channels.

21. The apparatus of claim 20 , wherein the configuration of the channel delay is configured to effectuate a coincident arrival of the at least two non-synchronous pulses at a decoder.

22. The apparatus of claim 21 , wherein the group delay is configured with reference to an event selected from the group consisting of: (i) a temporal event; (ii) a receipt of the sensory input; (iii) an appearance of an object in the sensory input; and (iv) a timer event.

23. The appa

Assignees

• Izhikevich Eugene M
• Brain Corp

Inventors

• Izhikevich Eugene M

Classifications

• G06F19/3406

  Physics · mapped topic

• G06N3/049 Primary

  Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs · CPC title

• G06F19/36

  Physics · mapped topic

• G16H20/30

  relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising · CPC title

• G16H40/63

  for local operation · CPC title