Data caching

Patent metadata

Field	Value
Publication number	US-10884928-B2
Application number	US-201916379303-A
Country	US
Kind code	B2
Filing date	Apr 9, 2019
Priority date	Apr 29, 2015
Publication date	Jan 5, 2021
Grant date	Jan 5, 2021

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for caching data not frequently accessed. One of the methods includes receiving a request for data from a component of a device, determining that the data satisfies an infrequency condition, in response to determining that the data satisfies the infrequency condition: determining a target cache level which defines a cache level within a cache level hierarchy of a particular cache at which to store infrequently accessed data, the target cache level being lower than a highest cache level in the cache level hierarchy, requesting and receiving the data from a memory that is not a cache of the device, and storing the data in a level of the particular cache that is at or below the target cache level in the cache level hierarchy, and providing the data to the component.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving a request for data from a component of a device;
determining that the request for the data comprises a request for a nested page table;
in response to determining that the request for the data comprises a request for a nested page table:
determining whether the data is a particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level;
in response to determining that the data is the particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level:
determining the target cache level which defines a cache level within a cache level hierarchy of a particular cache at which to store data that is of the particular type of data, the target cache level being lower than a highest cache level in the cache level hierarchy;
requesting and receiving the data from a memory that is not a cache of the device; and
storing the data in a level of the particular cache that is at or below the target cache level in the cache level hierarchy; and

providing the data to the component.

2. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a processor of a device; and
providing the data to the component comprises providing the data to the processor.

3. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory controller of a device; and
providing the data to the component comprises providing the data to the memory controller.

4. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory management unit of a device; and
providing the data to the component comprises providing the data to the memory management unit.

5. The method of claim 1 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a input/output unit of a device; and
providing the data to the component comprises providing the data to the input/output unit.

6. The method of claim 1 , wherein determining the target cache level comprises automatically determining the target cache level using a cache miss rate for the particular cache.

7. The method of claim 6 , wherein automatically determining the target cache level using the cache miss rate for the particular cache comprises:
determining that the cache miss rate for the particular cache does not satisfy a threshold miss rate; and
changing the target cache level to a lower cache level in the cache level hierarchy in response to determining that the cache miss rate for the particular cache does not satisfy the threshold miss rate.

8. The method of claim 6 , wherein automatically determining the target cache level using the cache miss rate for the particular cache comprises:
determining that the cache miss rate for the particular cache satisfies a threshold miss rate; and
changing the target cache level to a lower cache level in the cache level hierarchy in response to determining that the cache miss rate for the particular cache satisfies the threshold miss rate.

9. A non-transitory computer readable storage medium storing instructions, which are executable by a data processing apparatus and, upon such execution, cause the data processing apparatus to perform operations comprising:
receiving a request for data from a component of a device;
determining that the request for the data comprises a request for a nested page table;
in response to determining that the request for the data comprises a request for a nested page table:
determining whether the data is a particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level;
in response to determining that the data is the particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level:
determining the target cache level which defines a cache level within a cache level hierarchy of a particular cache at which to store data that is of the particular type of data, the target cache level being lower than a highest cache level in the cache level hierarchy;
requesting and receiving the data from a memory that is not a cache of the device; and
storing the data in a level of the particular cache that is at or below the target cache level in the cache level hierarchy; and

providing the data to the component.

10. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a processor of a device; and
providing the data to the component comprises providing the data to the processor.

11. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory controller of a device; and
providing the data to the component comprises providing the data to the memory controller.

12. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a memory management unit of a device; and
providing the data to the component comprises providing the data to the memory management unit.

13. The non-transitory computer readable storage medium of claim 9 , wherein:
receiving the request for data from the component of the device comprises receiving the request for the data from a input/output unit of a device; and
providing the data to the component comprises providing the data to the input/output unit.

14. The non-transitory computer readable storage medium of claim 9 , wherein determining the target cache level comprises automatically determining the target cache level using a cache miss rate for the particular cache.

15. The non-transitory computer readable storage medium of claim 14 , wherein automatically determining the target cache level using the cache miss rate for the particular cache comprises:
determining that the cache miss rate for the particular cache does not satisfy a threshold miss rate; and
changing the target cache level to a lower cache level in the cache level hierarchy in response to determining that the cache miss rate for the particular cache does not satisfy the threshold miss rate.

16. A system, comprising:
a data processing apparatus; and
a non-transitory computer readable storage medium storing instructions, which are executable by a data processing apparatus and, upon such execution, cause the data processing apparatus to perform operations comprising:
receiving a request for data from a component of a device;
determining that the request for the data comprises a request for a nested page table;
in response to determining that the request for the data comprises a request for a nested page table:
determining whether the data is a particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level;
in response to determining that the data is the particular type of data and that the data should only be stored in a cache at a level no higher than a target cache level:
determining the target cache level which define

Assignees

• Google Llc

Inventors

• Yoo Richard
• Cheng Liqun
• Serebrin Benjamin C
• Ranganathan Parthasarathy
• Govindaraju Rama Krishna

Classifications

• G06F12/0897 Primary

  with two or more cache hierarchy levels (with multilevel cache hierarchies G06F12/0811) · CPC title

• G06F12/0871 Primary

  Allocation or management of cache space · CPC title

• G06F12/0811 Primary

  with multilevel cache hierarchies · CPC title

• G06F2212/283

  Plural cache memories · CPC title

• G06F9/4401

  Bootstrapping (security arrangements therefor G06F21/57) · CPC title