Selectively changing arithmetic data types used in arithmetic execution of deep learning applications based on expressible ratio and fluctuation value comparisons to threshold values

Patent metadata

Field	Value
Publication number	US-11182156-B2
Application number	US-202016744240-A
Country	US
Kind code	B2
Filing date	Jan 16, 2020
Priority date	Feb 26, 2019
Publication date	Nov 23, 2021
Grant date	Nov 23, 2021

Abstract

An information processing apparatus includes: a memory; and a processor coupled to the memory and configured to: perform an arithmetic operation using an arithmetic operation target; repeat the arithmetic operation by using a calculated arithmetic operation result; obtain a ratio of, in a first number of elements which are included in the arithmetic operation result, a second number of elements in an expressible range as a predetermined-bit fixed point; and perform the arithmetic operation by using the predetermined-bit fixed point based on the ratio.

First claim

What is claimed is:

1. An information processing apparatus comprising:
a memory; and
a processor coupled to the memory and configured to:
perform an iteration operation, which repeats an arithmetic operation a predetermined times using sequentially a calculated arithmetic operation result obtained by the arithmetic operation using an arithmetic operation target, a plurality of times;
obtain, for each iteration operation, a ratio of a first number of first elements in an expressible range as a predetermined-bit fixed point among second elements included in each calculated arithmetic operation result of each arithmetic operation of the predetermined times with respect to a second number of the second elements;
store, in the memory, the ratio in association with the corresponding arithmetic operation and the corresponding iteration operation; and
perform the arithmetic operation by using the predetermined-bit fixed point based on the ratio stored in the memory.

2. The information processing apparatus according to claim 1 , wherein the processor is configured to:
determine a decimal point position based on the second number: and
obtain the ratio of the first number as the predetermined-bit fixed point with the decimal point position.

3. The information processing apparatus according to claim 1 , wherein the processor is configured to:
perform the arithmetic operation by using the predetermined-bit fixed point in a case where the ratio is larger than a predetermined ratio threshold.

4. The information processing apparatus according to claim 1 , wherein the processor is configured to:
obtain the ratio each time when calculating the arithmetic operation result; and
perform the arithmetic operation by using the predetermined-bit fixed point based on a change in the ratio between a latest ratio and a predetermined-times previous ratio.

5. The information processing apparatus according to claim 1 , wherein the processor is configured to:
perform the arithmetic operation by using a first predetermined-bit fixed point or a second predetermined-bit fixed point based on the ratio.

6. The information processing apparatus according to claim 1 , wherein the processor is configured to:
perform the arithmetic operation by using a floating point based on the ratio.

7. A control method comprising:
performing, by an information processing apparatus, an iteration operation, which repeats an arithmetic operation a predetermined times using sequentially a calculated arithmetic operation result obtained by the arithmetic operation using an arithmetic operation target, a plurality of times;
obtaining, for each iteration operation, a ratio of a first number of first elements in an expressible range as a predetermined-bit fixed point among second elements included in each calculated arithmetic operation result of each arithmetic operation of the predetermined times with respect to a second number of the second elements;
storing, in a memory, the ratio in association with the corresponding arithmetic operation and the corresponding iteration operation; and
making the information processing apparatus perform the arithmetic operation by using the predetermined-bit fixed point based on the calculated ratio stored in the memory.

8. A non-transitory computer-readable recording medium having stored therein a control program for causing a computer to execute a process comprising:
performing an iteration operation, which repeats an arithmetic operation a predetermined times using sequentially a calculated arithmetic operation result obtained by the arithmetic operation using an arithmetic operation target plurality of times;
obtaining, for each iteration operation, a ratio of a first number of first elements in an expressible range as a predetermined-bit fixed point among second elements included in each calculated arithmetic operation result of each arithmetic operation of the predetermined times with respect to a second number of the second elements;
storing, in a memory, the ratio in association with the corresponding arithmetic operation and the corresponding iteration operation; and
performing the arithmetic operation by using the predetermined-bit fixed point based on the calculated ratio stored in the memory.

Assignees

• Fujitsu Ltd

Inventors

• Nukariya Atsushi
• Doteguchi Masahiro

Classifications

• G06N3/045

  Combinations of networks · CPC title

• Y02D10/00

  Energy efficient computing, e.g. low power processors, power management or thermal management · CPC title

• G06F9/3001 Primary

  Arithmetic instructions · CPC title

• G06N3/08 Primary

  Learning methods · CPC title

• G06F9/30189

  according to execution mode, e.g. mode flag · CPC title