Systems and methods for managing onlooker detection in heterogeneous computing platforms

Patent metadata

Field	Value
Publication number	US-12547720-B2
Application number	US-202318165373-A
Country	US
Kind code	B2
Filing date	Feb 7, 2023
Priority date	Feb 7, 2023
Publication date	Feb 10, 2026
Grant date	Feb 10, 2026

Abstract

Systems and methods for managing Onlooker Detection in heterogeneous computing platforms are described. In an illustrative, non-limiting embodiment, an IHS may include a heterogeneous computing platform and a memory coupled to the heterogeneous computing platform, where the memory includes a plurality of sets of firmware instructions, where each of the sets of firmware instructions, upon execution by a respective device among a plurality of devices of the heterogeneous computing platform, enables the respective device to provide a corresponding firmware service, and where at least one of the plurality of devices operates as an orchestrator configured to: receive context or telemetry data, and modify an Onlooker Detection setting of the IHS based, at least in part, upon the context or telemetry data.

First claim

The invention claimed is:

1 . An Information Handling System (IHS), comprising:
a heterogeneous computing platform comprising a display; and a memory coupled to the heterogeneous computing platform, wherein the memory comprises a plurality of sets of firmware instructions, wherein each of the sets of firmware instructions, upon execution by a respective device among a plurality of devices of the heterogeneous computing platform, enables the respective device to provide a corresponding firmware service, and wherein at least one of the plurality of devices operates as an orchestrator configured to:
receive context or telemetry data;
determine an IHS location based, at least in part, upon the context or telemetry data, wherein the IHS location is an untrusted location;
transmit the context or telemetry data to a remote service;
receive a command from the remote service to modify an Onlooker Detection setting of the IHS based, at least in part, upon the context or telemetry data, wherein the command is produced in response to the IHS being located in the untrusted location;
modify the Onlooker Detection setting based, at least in part, upon the command, wherein the modified Onlooker Detection setting comprises enabling a plurality of cameras configured to capture images or video usable to perform Onlooker Detection;
perform Onlooker Detection using the modified Onlooker Detection setting; and
trigger a responsive action based on a positive detection event produced from the perform step, wherein the triggered responsive action causes an adjustment to a video output of the display so as to mitigate or prevent an onlooker from viewing information presented on the display.

2 . The IHS of claim 1 , wherein the heterogeneous computing platform comprises at least one of: a System-On-Chip (SoC), a Field-Programmable Gate Array (FPGA), or an Application-Specific Integrated Circuit (ASIC).

3 . The IHS of claim 1 , wherein the orchestrator comprises at least one of: a sensing hub, an Embedded Controller (EC), or a Baseboard Management Controller (BMC).

4 . The IHS of claim 1 , wherein to receive the context or telemetry data, the orchestrator is further configured to receive a message from a firmware service executed by a selected one of the plurality of devices via an Application Programming Interface (API) without any involvement by any host Operating System (OS).

5 . The IHS of claim 4 , wherein the selected device comprises at least one of: a Video Processing Unit (VPU), an Image Signal Processor (ISP), an audio Digital Signal Processor (aDSP), an Embedded Controller (EC), a camera controller, a time-of-flight sensor, a presence detection sensor, a wireless controller, a network adapter, or a modem.

6 . The IHS of claim 1 , wherein the IHS location comprises at least one of: a network address, a network identification, or a Global Positioning System (GPS) location.

7 . The IHS of claim 1 , wherein Onlooker Detection is performed by at least one of: a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a high-performance AI device, a low-power AI device, a Video Processing Unit (VPU), an audio Digital Signal Processor (aDSP), an Image Signal Processor (ISP), a camera controller, or the orchestrator.

8 . A non-transitory computer readable medium having a plurality of sets of firmware instructions stored thereon, wherein each of the sets of firmware instructions is executable by a respective device among a plurality of devices of a heterogeneous computing platform to enable the respective device to provide a corresponding firmware service, and wherein a given one of the plurality of sets of firmware instructions, upon execution by a given device, cause the respective device to:
receive context or telemetry data, wherein the context or telemetry data comprises an indication that the heterogeneous computing platform is located in an untrusted location; transmit the context or telemetry data to a remote service; receive a command from the remote service to modify an Onlooker Detection setting of the heterogeneous computing platform based, at least in part, upon the context or telemetry data, wherein the command is produced in response to the heterogeneous computing platform being located in the untrusted location; in response to the command, modify the Onlooker Detection setting, wherein the modified Onlooker Detection setting comprises enabling a plurality of cameras configured to capture images or video usable to perform Onlooker Detection; perform Onlooker Detection using the modified Onlooker Detection setting; and trigger a responsive action based on a positive detection event produced from the perform step, wherein the triggered responsive action causes an adjustment to a video output of a display of the heterogeneous computing platform so as to mitigate or prevent an onlooker from viewing information presented on the display.

9 . The non-transitory computer readable medium of claim 8 , wherein the untrusted location comprises at least one of: a network address, a network identification, or a Global Positioning System (GPS) location.

10 . A method, comprising:
receiving, at a remote server from a heterogeneous computing platform, context or telemetry data collected by one or more of a plurality of devices integrated into the heterogeneous computing platform, wherein the context or telemetry data comprises an indication that the heterogeneous computing platform is located in an untrusted location; transmitting, from the remote server to an orchestrator among the plurality of devices, a command to modify an Onlooker Detection setting of the heterogeneous computing platform based, at least in part, upon the context or telemetry data, wherein the command is produced in response to the heterogeneous computing platform being located in the untrusted location; modifying, using the command, the Onlooker Detection setting, wherein the modifying comprises enabling a plurality of cameras to capture images or video usable for performing Onlooker Detection; performing Onlooker Detection using the modified Onlooker Detection setting; and triggering, based on a positive detection event produced from the performing step, a responsive action causing an adjustment to a video output of a display of the heterogeneous computing platform so as to mitigate or prevent an onlooker from viewing information presented on the display.

11 . The method of claim 10 , wherein the untrusted location comprises at least one of: a network address, a network identification, or a Global Positioning System (GPS) location.

Assignees

• Dell Products Lp

Inventors

• Swierk Todd Erick
• Hamlin Daniel L
• Kondapi Srikanth
• Iyer Hariprasad Janardana

Classifications

• G06F2221/2111

  Location-sensitive, e.g. geographical location, GPS · CPC title

• G06F21/57 Primary

  Certifying or maintaining trusted computer platforms, e.g. secure boots or power-downs, version controls, system software checks, secure updates or assessing vulnerabilities · CPC title