Multiply-accumulate operation device, multiply-accumulate operation circuit, multiply-accumulate operation system, and multiply-accumulate operation method

Patent metadata

Field	Value
Publication number	US-12008338-B2
Application number	US-201917258328-A
Country	US
Kind code	B2
Filing date	Jul 4, 2019
Priority date	Jul 13, 2018
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

A multiply-accumulate operation device, circuit and method are disclosed. In on example, a multiply-accumulate operation device includes input lines, multiplication units, an accumulation unit, a charging unit, and an output unit. Pulse signals having pulse widths corresponding to input values are input to the input lines. The multiplication units generate, based on the pulse signals, charges corresponding to multiplication values obtained by multiplying the input values by weight values. The accumulation unit accumulates a sum of the charges corresponding to the multiplication values. The charging unit charges the accumulation unit at a charging speed associated with its accumulation state. The output unit outputs a multiply-accumulate signal representing a sum of the multiplication values by executing threshold determination using a threshold value associated with the accumulation state of the accumulation unit on a voltage held by the accumulation unit after the charging by the charging unit is started.

First claim

The invention claimed is:

1. A multiply-accumulate operation device that executes a multiply-accumulate operation with an analog circuit, comprising:
a plurality of input lines, pulse signals having pulse widths corresponding to input values being input to the plurality of input lines;
a plurality of multiplication units that generates, on a basis of the pulse signals input to each of the plurality of input lines, charges corresponding to multiplication values obtained by multiplying the input values by weight values;
an accumulation unit that accumulates a sum of the charges corresponding to the multiplication values generated by each of the plurality of multiplication units;
a charging unit that charges, at a charging speed associated with an accumulation state of the accumulation unit, the accumulation unit in which the sum of the charges corresponding to the multiplication values have been accumulated; and
an output unit that outputs a multiply-accumulate signal representing a sum of the multiplication values by executing threshold determination using a threshold value associated with the accumulation state of the accumulation unit on a voltage held by the accumulation unit after the charging by the charging unit is started, wherein
the charging speed and the threshold value are set on a basis of an effective maximum value and an effective minimum value of the sum of the charges corresponding to the multiplication values, and
the effective maximum value and the effective minimum value are obtained from an estimation result of the sum of the charges corresponding to the multiplication values accumulated by the accumulation unit.

2. The multiply-accumulate operation device according to claim 1 , wherein
the pulse signals are respectively input to each of the plurality of input lines within an input period having a predetermined length,
the charging unit starts the charging after the input period is ended, and
the output unit outputs the multiply-accumulate signal on a basis of timing at which the voltage held by the accumulation unit increases or decreases over the threshold value within an output period having a predetermined length.

3. The multiply-accumulate operation device according to claim 2 , wherein
a length of the output period is equal to a length of the input period.

4. The multiply-accumulate operation device according to claim 2 , wherein
the charging unit starts the charging at end timing of the input period, and the output period is started at start timing of the charging by the charging unit.

5. The multiply-accumulate operation device according to claim 2 , wherein
the pulse signals respectively have a pulse width corresponding to a period from timing corresponding to the input value in the input period to end timing of the input period.

6. The multiply-accumulate operation device according to claim 1 , wherein
the charging speed and the threshold value are set so that a range from the effective maximum value to the effective minimum value is a range in which the multiply-accumulate signal can be output in the output period.

7. The multiply-accumulate operation device according to claim 1 , wherein
the timing at which the voltage held by the accumulation unit increases or decreases over the threshold value is used as calculation timing for calculating the multiply-accumulate signal, and
the charging speed and the threshold value are set so that the calculation timing corresponding to the effective maximum value is timing immediately after start timing of the output period and the calculation timing corresponding to the effective minimum value is timing immediately before end timing of the output period.

8. The multiply-accumulate operation device according to claim 1 , wherein
the charging speed and the threshold value are set on a basis of a length of the output period.

9. The multiply-accumulate operation device according to claim 1 , wherein
the effective maximum value and the effective minimum value are respectively a theoretical maximum value and a theoretical minimum value obtained from a theoretical value of the sum of the charges corresponding to the multiplication values accumulated by the accumulation unit.

10. The multiply-accumulate operation device according to claim 1 , wherein
the plurality of multiplication units includes a positive weight multiplication unit that generates positive weight charges corresponding to a multiplication value obtained by multiplying a respective one of the input values by a positive weight value, and a negative weight multiplication unit that generates negative weight charges corresponding to a multiplication value obtained by multiplying the respective one of the input values by a negative weight value,
the accumulation unit includes a positive charge accumulation unit that accumulates a sum of the positive weight charges generated by the positive weight multiplication unit, and a negative charge accumulation unit that accumulates a sum of the negative weight charges generated by the negative weight multiplication unit,
the charging unit charges the positive charge accumulation unit and the negative charge accumulation unit at the same charging speed, and the output unit outputs performs the executing of the threshold determination using the same threshold value on the positive charge accumulation unit and the negative charge accumulation unit.

11. The multiply-accumulate operation device according to claim 10 , further comprising:
a positive charge output line; and a negative charge output line, wherein
the plurality of multiplication units is provided corresponding to the plurality of input lines,
the positive weight multiplication unit includes a resistor that defines the positive weight value and has non-linear characteristics, the resistor being connected between the corresponding input line of the plurality of input lines and the positive charge output line, and outputs positive weight charges corresponding to the multiplication value to the positive charge output line, and
the negative weight multiplication unit includes a resistor that defines the negative weight value and has non-linear characteristics, the resistor being connected between the corresponding input line of the plurality of input lines and the negative charge output line, and outputs negative weight charges corresponding to the multiplication value to the negative charge output line.

12. The multiply-accumulate operation device according to claim 1 , wherein
the accumulation unit accumulates charges corresponding to a difference between a total amount of positive weight charges corresponding to a respective one of the multiplication values obtained by multiplying a respective one of the input values by a positive weight value and a total amount of negative weight charges corresponding to the respective one of the multiplication values obtained by multiplying the respective one of the input values by a negative weight value.

13. The multiply-accumulate operation device according to claim 12 , wherein
the positive weight charges and the negative weight charges are charges with the same sign as each other, and
the accumulation unit accumulates a sum of the positive weight charges and discharge a sum of the negative weight charges.

14. The multiply-accumulate operation device according to claim 1 , further comprising one or more output lines, wherein
the plurality of multiplication units is provided corresponding to the plurality of input lines, and
each of the plurality of multiplication units includes a resistor that defines a corresponding one of the weight va

Assignees

• Sony Group Corp

Inventors

• Morie Takashi
• Yamaguchi Masatoshi
• Iwamoto Goki
• TAMUKOH Hakaru

Classifications

• H03K19/0806

  using charge transfer devices (DTC, CCD) · CPC title

• H03K19/01728

  in synchronous circuits, i.e. by using clock signals · CPC title

• G06N3/063

  using electronic means · CPC title

• G06F7/523

  Multiplying only · CPC title

• G06N3/048

  Activation functions · CPC title