Apparatus and methods for optical neural network

Patent metadata

Field	Value
Publication number	US-11334107-B2
Application number	US-202016986383-A
Country	US
Kind code	B2
Filing date	Aug 6, 2020
Priority date	Jun 2, 2016
Publication date	May 17, 2022
Grant date	May 17, 2022

Abstract

An optical neural network is constructed based on photonic integrated circuits to perform neuromorphic computing. In the optical neural network, matrix multiplication is implemented using one or more optical interference units, which can apply an arbitrary weighting matrix multiplication to an array of input optical signals. Nonlinear activation is realized by an optical nonlinearity unit, which can be based on nonlinear optical effects, such as saturable absorption. These calculations are implemented optically, thereby resulting in high calculation speeds and low power consumption in the optical neural network.

First claim

The invention claimed is:

1. An apparatus for implementing an artificial neural network, the apparatus comprising:
one or more input waveguides to receive a first array of optical signals;
an optical interference unit, in optical communication with the one or more input waveguides, to perform a linear transformation of the first array of optical signals into a second array of optical signals;
a nonlinearity unit, in communication with the optical interference unit, to perform a nonlinear transformation on the second array of optical signals so as to generate a third array of signals;
a detector array to detect at least a first portion of the third array of signals and generate an array of electrical signals in response to detecting the first portion of the third array of signals; and
a switch to controllably couple a second portion of the third array of signals back into the optical interference unit via at least one of the one or more input waveguides.

2. The apparatus of claim 1 , further comprising a light source in optical communication with the one or more input waveguides.

3. The apparatus of claim 2 , further comprising feedback circuitry to transmit the array of electrical signals to the light source, and wherein the light source is configured to emit a fourth array of optical signals based on the array of electrical signals.

4. The apparatus of claim 3 , wherein at least one of the one or more input waveguides are positioned to receive the fourth array of optical signals and direct them to the optical interference unit.

5. The apparatus of claim 1 , further comprising one or more output waveguides, in optical communication with the optical interference unit, to guide the second array of optical signals, wherein at least one of the one or more input waveguides is in optical communication with each of the output waveguides via the optical interference unit.

6. The apparatus of claim 1 , wherein the optical interference unit comprises:
a plurality of interconnected Mach-Zehnder interferometers (MZIs), each MZI in the plurality of interconnected MZIs comprising:
a first phase shifter configured to change a splitting ratio of the MZI; and
a second phase shifter configured to shift a phase of one output of the MZI.

7. The apparatus of claim 6 , wherein the plurality of interconnected MZIs is configured to perform the linear transformation of the first array of optical signals via singular value decomposition (SVD).

8. The apparatus of claim 6 , wherein the plurality of interconnected MZIs comprises:
a first set of MZIs to perform a unitary transformation of the first array of optical signals to generate a first array of transformed optical signals; and
a second set of MZIs in optical communication with the first set of MZIs, each MZI in the second array of MZIs receiving a respective transformed optical signal from the first array of transformed optical signals and transmitting a first output to the nonlinearity unit, wherein a second output of each MZI in the second array of MZIs is optically blocked so as to change a total intensity of the first array of transformed optical signals and perform a non-unitary diagonal matrix multiplication of the first array of transformed optical signals.

9. The apparatus of claim 1 , wherein the optical interference unit comprises:
a plurality of interconnected MZIs to perform a unitary transformation of the first array of optical signals; and
an array of optical attenuators or amplifiers, in optical communication with the plurality of MZIs, to change an intensity of the first array of optical signals after the plurality of MZIs.

10. The apparatus of claim 1 , wherein the optical interference unit comprises a network of photonic crystals.

11. The apparatus of claim 10 , further comprising a phase change material coated on at least one photonic crystal in the network of photonic crystals.

12. The apparatus of claim 1 , wherein the optical interference unit comprises a two-dimensional (2D) array of ring resonators.

13. The apparatus of claim 1 , wherein the first array of optical signals includes a first number of optical signals, the second array of the optical signals includes a second number of optical signals, and the first number is different than the second number.

14. The apparatus of claim 1 , wherein the third array of signals is a third array of optical signals, and wherein the nonlinearity unit is an optical nonlinearity unit, in optical communication with the optical interference unit, to perform the nonlinear transformation on the second array of optical signals so as to generate the third array of optical signals.

15. The apparatus of claim 14 , wherein the detector array is in optical communication with the optical nonlinearity unit.

16. The apparatus of claim 15 , further comprising:
control circuitry, operably coupled to the optical interference unit, the optical nonlinearity unit, and the detector array, to adjust a setting of at least one of the optical interference unit or the optical nonlinearity unit based at least in part on the first portion of the third array of optical signals detected by the detector array.

17. The apparatus of claim 1 , wherein the nonlinearity unit implements the nonlinear transformation in the electronic domain by measuring optical intensities of the second array of optical signals with a photodetector array and electronically applying the nonlinear transformation to the measured optical intensities to generate the third array of signals.

18. The apparatus of claim 1 , wherein the second array of optical signals can be represented as Z i =|E i | 2 , where E i is the electric field of i th optical signal in the second array of optical signals and the nonlinear transformation applies a nonlinear function f to the second array of optical signals to yield the third array of signals f(Z i ).

19. The apparatus of claim 1 , wherein the optical interference unit and the nonlinearity unit form one hidden layer in a sequence of hidden layers of the artificial neural network.

20. A method for artificial neural network computation, the method comprising:
receiving a first array of optical signals with one or more input waveguides;
interfering the first array of optical signals, using an optical interference unit in optical communication with the one or more input waveguides, to linearly transform the first array of optical signals into a second array of optical signals;
nonlinearly transforming the second array of optical signals using a nonlinearity unit, in communication with the optical interference unit, so as to generate a third array of signals; and
detecting at least a first portion of the third array of signals to generate an array of electrical signals; and
coupling a second portion of the third array of signals back into the optical interference unit via at least one of the one or more input waveguides.

21. The method of claim 20 , further comprising providing a fourth array of optical signals to at least one of the one or more input waveguides based on the array of electrical signals to direct the fourth array of optical signals to the optical interference unit.

22. The method of claim 20 , further comprising guiding the second array of signals using one or more output waveguides, wherein at least one of the one or more input waveguides is in optical communication with each of the output waveguides via the optical interference unit.

23. The method of claim 2

Assignees

• Massachusetts Inst Technology

Inventors

• Carolan Jacques Johannes
• PRABHU Mihika
• Skirlo Scott A
• Shen Yichen
• Soljacic Marin
• Englund Dirk
• Harris Nicholas Christopher

Classifications

• G06N3/08

  Learning methods · CPC title

• G06N3/0442

  characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] · CPC title

• G06N3/09

  Supervised learning · CPC title

• G06N3/0499

  Feedforward networks · CPC title

• G02F2202/32

  Photonic crystals · CPC title