Method and apparatus for controlling internal memory bandwidth, processor, and computing device

Patent metadata

Field	Value
Publication number	US-12360690-B2
Application number	US-202418612459-A
Country	US
Kind code	B2
Filing date	Mar 21, 2024
Priority date	Sep 30, 2021
Publication date	Jul 15, 2025
Grant date	Jul 15, 2025

Abstract

A method for controlling an internal memory bandwidth includes after obtaining a bandwidth required by a to-be-accessed internal memory medium, a processor in a system obtains an occupancy rate of an internal memory bandwidth of the to-be-accessed internal memory medium. If determining, based on the occupancy rate of the internal memory bandwidth, that the to-be-accessed internal memory medium cannot satisfy a bandwidth requirement, the processor adjusts, under an indication of a bandwidth adjustment policy, the occupancy rate of the internal memory bandwidth based on a factor that affects the occupancy rate of the internal memory bandwidth of the to-be-accessed internal memory medium, and the processor uses a first bandwidth that satisfies the bandwidth requirement in an adjusted remaining bandwidth of the to-be-accessed internal memory medium.

First claim

What is claimed is:

1. A method, comprising:
obtaining a bandwidth requirement of a to-be-accessed internal memory medium, wherein the bandwidth requirement is a bandwidth required by a first processor to access the to-be-accessed internal memory medium;
obtaining an occupancy rate of an internal memory bandwidth of the to-be-accessed internal memory medium;
determining, based on the occupancy rate, that the to-be-accessed internal memory medium does not satisfy the bandwidth requirement;
adjusting, according to a bandwidth adjustment policy, the occupancy rate to obtain an adjusted remaining bandwidth, wherein the bandwidth adjustment policy indicates to adjust, based on a factor that affects the occupancy rate, the internal memory bandwidth; and
using a first bandwidth that satisfies the bandwidth requirement and that is in the adjusted remaining bandwidth.

2. The method of claim 1 , wherein the factor comprises at least one of a user-oriented application or a system-oriented application that is run by the first processor.

3. The method of claim 2 , wherein adjusting the occupancy rate comprises controlling the factor to occupy the internal memory bandwidth to obtain the adjusted remaining bandwidth, and wherein the adjusted remaining bandwidth is greater than a remaining bandwidth before adjustment.

4. The method of claim 3 , wherein controlling the factor comprises:
determining, based on the remaining bandwidth and a bandwidth threshold, a limited available bandwidth of the to-be-accessed internal memory medium; and
controlling, based on the limited available bandwidth, the factor to access the to-be-accessed internal memory medium to obtain the adjusted remaining bandwidth.

5. The method of claim 4 , further comprising obtaining, based on a total bandwidth of the to-be-accessed internal memory medium and an adjustment factor, the bandwidth threshold.

6. The method of claim 1 , wherein using the first bandwidth comprises accessing, based on the first bandwidth, an internal memory space allocated at a preset internal memory allocation granularity in the to-be-accessed internal memory medium, and wherein the preset internal memory allocation granularity is greater than a page size of the internal memory medium.

7. An apparatus, comprising:
a hybrid internal memory system comprising a plurality of different types of internal memory media; and
one or more processors coupled to the hybrid internal memory system and configured to:
obtain a bandwidth requirement of a to-be-accessed internal memory medium, wherein the bandwidth requirement is a bandwidth required to access the to-be-accessed internal memory medium, and wherein the to-be-access internal memory medium is one of the internal memory media;
obtain an occupancy rate of an internal memory bandwidth of the to-be-accessed internal memory medium;
determine, based on the occupancy rate, that the to-be-accessed internal memory medium does not satisfy the bandwidth requirement;
adjust, according to a bandwidth adjustment policy, the occupancy rate to obtain an adjusted remaining bandwidth, wherein the bandwidth adjustment policy indicates to adjust, based on a factor that affects the occupancy rate, the to-be-accessed internal memory medium; and
use a first bandwidth that satisfies the bandwidth requirement and is in the adjusted remaining bandwidth.

8. The apparatus of claim 7 , wherein the factor comprises at least one of a user-oriented application or a system-oriented application.

9. The apparatus of claim 8 , wherein the one or more processors are further configured to control the factor to occupy the internal memory bandwidth to obtain the adjusted remaining bandwidth, and wherein the adjusted remaining bandwidth is greater than a remaining bandwidth before adjustment.

10. The apparatus of claim 9 , wherein the one or more processors are further configured to:
determine, based on the remaining bandwidth and a bandwidth threshold, a limited available bandwidth of the to-be-accessed internal memory medium; and
control, based on the limited available bandwidth, the factor to access the to-be-accessed internal memory medium to obtain the adjusted remaining bandwidth.

11. The apparatus of claim 10 , wherein the one or more processors are further configured to obtain, based on a total bandwidth of the to-be-accessed internal memory medium and an adjustment factor, the bandwidth threshold.

12. The apparatus of claim 7 , wherein the one or more processors are further configured to access, based on the first bandwidth, an internal memory space allocated at a preset internal memory allocation granularity in the to-be-accessed internal memory medium, and wherein the preset internal memory allocation granularity is greater than a page size of the internal memory medium.

13. The apparatus of claim 7 , wherein the plurality of different types of internal memory media comprises a first internal memory medium and a second internal memory medium, wherein a first access speed of the first internal memory medium is greater than a second access speed of the second internal memory medium, and wherein the to-be-accessed internal memory medium is the first internal memory medium or the second internal memory medium.

14. The apparatus of claim 13 , wherein the first internal memory medium is a dynamic random-access memory (DRAM), wherein the second internal memory medium is a storage-class memory (SCM), and wherein the SCM comprises at least one of a phase-change memory (PCM), a magnetoresistive random-access memory (MRAM), a resistive random-access memory (RRAM), a ferroelectric random-access memory (FRAM), a fast NAND, or a nano random-access memory (NRAM).

15. A computer program product comprising instructions stored on a non-transitory computer-readable medium that, when execute by one or more processors, cause an apparatus to:
obtain a bandwidth requirement of a to-be-accessed internal memory medium, wherein the bandwidth requirement is a bandwidth required by a first processor to access the to-be-accessed internal memory medium;
obtain an occupancy rate of an internal memory bandwidth of the to-be-accessed internal memory medium;
determine, based on the occupancy rate, that the to-be-accessed internal memory medium does not satisfy the bandwidth requirement;
adjust, according to a bandwidth adjustment policy, the occupancy rate to obtain an adjusted remaining bandwidth, wherein the bandwidth adjustment policy indicates to adjust, based on a factor that affects the occupancy rate, the internal memory bandwidth; and
use a first bandwidth that satisfies the bandwidth requirement and is in the adjusted remaining bandwidth.

16. The computer program product of claim 15 , wherein the factor comprises at least one of a user-oriented application or a system-oriented application that is run by the first processor.

17. The computer program product of claim 16 , wherein the one or more processors are further configured to execute the instructions to control the factor to occupy the internal memory bandwidth to obtain the adjusted remaining bandwidth, and wherein the adjusted remaining bandwidth is greater than a remaining bandwidth before adjustment.

18. The computer program product of claim 17 , wherein the one or more processors are further configured to execute the instructions to:
determine, based on the remaining bandwidth and a bandwidth threshold, a limited available bandwidth of the to-be-accessed internal memory medium; and
control, based on the limited available bandwidth, the factor to access the to

Assignees

• Huawei Tech Co Ltd

Inventors

• Chen Huan
• Zhu Xiaoping

Classifications

• G06F3/0683

  Plurality of storage devices · CPC title

• G06F3/0604

  Improving or facilitating administration, e.g. storage management · CPC title

• G06F12/126

  with special data handling, e.g. priority of data or instructions, handling errors or pinning · CPC title

• G06F2212/601

  Reconfiguration of cache memory · CPC title

• G06F12/08

  in hierarchically structured memory systems, e.g. virtual memory systems · CPC title