Noise and bound management for RPU array

Patent metadata

Field	Value
Publication number	US-10360283-B2
Application number	US-201715838992-A
Country	US
Kind code	B2
Filing date	Dec 12, 2017
Priority date	Apr 5, 2017
Publication date	Jul 23, 2019
Grant date	Jul 23, 2019

Abstract

A method, computer program product, and circuit are provided for noise and bound management for a Resistive Processing Unit (RPU) array having an op-amp. The method includes reducing the noise in an output signal from the RPU array by using a largest value, in a sigma vector having a plurality of values, as a representation for a window for an input signal to the RPU array. The input signal to the RPU array is formed from the plurality of values. The method further includes sensing saturation at an output of the op-amp. The method also includes managing the bound to eliminate the saturation by reducing the plurality of values from which the input signal to the RPU is formed.

First claim

What is claimed is:

1. A computer program product for noise and bound management for a Resistive Processing Unit (RPU) array having an op-amp, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:
reducing the noise in an output signal from the RPU array by using a largest value, in a sigma vector having a plurality of values, as a representation for a window for an input signal to the RPU array, the input signal to the RPU array being formed from the plurality of values;
sensing saturation at an output of the op-amp; and
managing the bound to eliminate the saturation by reducing the plurality of values from which the input signal to the RPU is formed.

2. The computer program product of claim 1 , wherein the RPU array is configured to perform an analog vector-matrix multiplication.

3. The computer program product of claim 1 , wherein the reducing step further comprises scaling remaining ones of the plurality of values with respect to the largest value.

4. The computer program product of claim 1 , wherein the managing step reduces the plurality of values in one or more additional forward passes by the RPU array.

5. The computer program product of claim 1 , wherein the reducing step further comprises:
dividing the sigma vector by the largest value to obtain a quotient and using the quotient as the input signal to the RPU array; and
multiplying the output signal from the RPU array by the largest value to obtain a product.

6. The computer program product of claim 5 , wherein the quotient forms a conditioned input signal to the RPU array, and the product forms a conditioned output signal from the RPU array.

7. The computer program product of claim 5 , wherein the RPU array is configured to perform an analog vector-matrix multiplication using the quotient as an input signal and the product as the output signal.

8. The computer program product of claim 1 , wherein the sigma vector is comprised in a digital signal having a plurality of digital values, and the input to the RPU unit comprises a plurality of analog signal pulse width values each of which represents a respective one of the plurality of digital values.

9. The computer program product of claim 1 , wherein the managing step is performed iteratively until a number of clipped outputs from the op-amp is below a threshold.

10. A circuit for noise and bound management for a Resistive Processing Unit (RPU) array having an op-amp, the circuit comprising:
a processor configured to:
reduce the noise in an output signal from the RPU array by using a largest value, in a sigma vector having a plurality of values, as a representation for a window for an input signal to the RPU array, the input signal to the RPU array being formed from the plurality of values;
sense saturation at an output of the op-amp; and
manage the bound to eliminate the saturation by reducing the plurality of values from which the input signal to the RPU is formed.

11. The circuit of claim 10 , wherein circuit is comprised in an entity selected from the group consisting of a Non-Linear Function (NLF) and an Application Specific Integrated Circuit (ASIC).

Assignees

• IBM

Inventors

• Gokmen Tayfun
• Onen Oguzhan Murat

Classifications

• G06N3/065

  Analogue means · CPC title

• G06F7/5443

  Sum of products (for applications thereof, see the relevant places, e.g. G06F17/10, H03H17/00) · CPC title

• G06F7/535

  Dividing only · CPC title

• G06F2207/4828

  Negative resistance devices, e.g. tunnel diodes, gunn effect devices · CPC title

• G06F2207/4824

  Neural networks · CPC title