Secure Exclaves

Patent metadata

Field	Value
Publication number	US-2025094565-A1
Application number	US-202418790895-A
Country	US
Kind code	A1
Filing date	Jul 31, 2024
Priority date	Sep 20, 2023
Publication date	Mar 20, 2025
Grant date	—

Abstract

Techniques are disclosed relating to securing hardware accelerators used by a computing device. In some embodiments, a computing device includes user interface and user interface pipeline circuitry coupled to the user interface. The user interface pipeline circuitry is configured to process a set of data received from a first source to produce an output for the user interface of the computing device, receive, from a second source, an indication that a component of the computing device has been activated, and, prior to presenting the output via the user interface, insert, into the output, an indicator of the component being activated.

First claim

What is claimed is:

1 . A computing device, comprising:
user interface; and user interface pipeline circuitry coupled to the user interface and configured to:
process a set of data received from a first source to produce an output for the user interface of the computing device;
receive, from a second source, an indication that a component of the computing device has been activated; and
prior to presenting the output via the user interface, insert, into the output, an indicator of the component being activated.

2 . The computing device of claim 1 , wherein the component is a sensor configured to collect sensitive data about a user.

3 . The computing device of claim 1 , wherein the component is a camera configured to collect image data.

4 . The computing device of claim 1 , wherein the component is a microphone configure to capture audio data.

5 . The computing device of claim 1 , wherein the user interface is a display, and wherein the user interface pipeline circuitry is display pipeline circuitry configured to:
produce frames for the display of the computing device, wherein the display pipeline circuitry includes a blend pipeline stage configured to:
based on the received indication, insert pixel data as the indicator into a frame being rendered by the display pipeline circuitry.

6 . The computing device of claim 1 , wherein the user interface is a speaker, and wherein the user interface pipeline circuitry is an audio pipeline circuitry configured to:
produce an audio signal for the speaker of the computing device, wherein the audio pipeline circuitry includes a blend pipeline stage configured to:
based on the received indication, insert an audio indicator into the audio signal.

7 . The computing device of claim 1 , wherein the user interface is a haptic feedback engine, and wherein the user interface pipeline circuitry is haptic pipeline circuitry configured to:
produce a haptic feedback data for a haptic feedback engine, wherein the haptic pipeline circuitry includes a blend pipeline stage configured to:
based on the received indication, insert a particular haptic indicator into the haptic feedback data.

8 . The computing device of claim 1 , further comprising:
one or more processors; and memory having program instructions stored therein that are executable by the one or processors to:
provide, via a first untrusted process corresponding to the first source, the set of data to the user interface pipeline circuitry; and
provide, via a second trusted process corresponding to the second source, the indication to the user interface pipeline circuitry.

9 . The computing device of claim 1 , wherein the user interface pipeline circuitry includes:
a first direct memory access (DMA) engine configured to retrieve the set of data from a memory; and a second, different DMA engine configured to retrieve the indication from the memory.

10 . The computing device of claim 1 , wherein the user interface pipeline circuitry includes an extraction stage configured to:
extract data corresponding to where the indicator is inserted into the output to confirm that the indicator remains inserted into the output prior to the output being presented via the user interface.

11 . The computing device of claim 10 , further comprising:
one or more processors; and memory having program instructions stored therein that are executable by the one or processors to:
receive the extracted data corresponding to where the indicator is inserted into the output; and
analyze the received extracted data to determine whether the indicator remains inserted into the output.

12 . The computing device of claim 10 , further comprising:
sensor pipeline circuitry configured to:
process data received from the activated component; and
in response the indicator remaining inserted into the output, provide the processed data to a destination.

13 . The computing device of claim 12 , wherein the sensor pipeline circuitry includes:
a dead man's switch configured to:
periodically receiving confirmation that the indicator remains inserted into the output; and
in response to an omission of the confirmation, interrupting providing the processed data to the destination.

14 . The computing device of claim 12 , wherein the sensor pipeline circuitry implements an image sensor pipeline configured to process images received from a camera.

15 . The computing device of claim 12 , wherein the sensor pipeline circuitry implements an audio sensor pipeline configured to process an audio signal received from a microphone.

16 . A computing device, comprising:
a user interface; and user interface pipeline circuitry coupled to the user interface and configured to:
process a set of data to produce an output for the user interface of the computing device;
extract, from the output prior to presenting the output via the user interface, data corresponding to where an indicator is inserted into the output to indicate that a component of the computing device has been activated; and
provide the extracted data for analysis to determine whether the indicator remains inserted into the output.

17 . The computing device of claim 16 , further comprising:
one or more processors; and memory having program instructions stored therein that are executable by the one or processors to:
determine, from the provided extracted data, whether the indicator remains inserted into the output; and
in response to determining that the indicator does not remain inserted into the output, cause interruption of a task associated with the indicator.

18 . The computing device of claim 16 , further comprising:
a sensor; and sensor pipeline circuitry configured to:
process data received from the sensor; and
in response the indicator remaining inserted into the output, provide the processed data to a destination.

19 . The computing device of claim 16 , wherein the user interface pipeline circuitry includes:
a first direct memory access (DMA) engine configured to retrieve the set of data for processing; and a second, different DMA engine configured to provide the extracted data to a destination for analysis.

20 . A method, comprising:
processing, by user interface pipeline circuitry of a computing device, a set of data received from a source to produce an output for a user interface of the computing device; prior to presenting the output via the user interface:
inserting, by a first stage of the user interface pipeline circuitry into the output, an indicator of a component being activated; and
extracting, by a second stage of the user interface pipeline circuitry from the output, data corresponding to where the indicator is inserted to confirm that indicator remains inserted.

Assignees

• Apple Inc

Inventors

• Lisherness Peter A
• Menachem Assaf
• Metuki Assaf
• Biron Benjamin
• Capelis D J
• Khashiboun Husam
• Fortier Jacques

Classifications

• G06F21/74

  operating in dual or compartmented mode, i.e. at least one secure mode · CPC title

• G06F21/53 Primary

  by executing in a restricted environment, e.g. sandbox or secure virtual machine · CPC title

• G06F21/6218

  to a system of files or objects, e.g. local or distributed file system or database · CPC title

• G06F21/54

  by adding security routines or objects to programs · CPC title

• G06F2221/033

  Test or assess software · CPC title