Contextual camera controls during a collaboration session in a heterogenous computing platform

Patent metadata

Field	Value
Publication number	US-12596428-B2
Application number	US-202217821817-A
Country	US
Kind code	B2
Filing date	Aug 24, 2022
Priority date	Aug 24, 2022
Publication date	Apr 7, 2026
Grant date	Apr 7, 2026

Abstract

Systems and methods for contextual camera controls during a collaboration session in a heterogenous computing platform are described. In an embodiment, an Information Handling System (IHS) may include: a heterogeneous computing platform comprising a plurality of devices and a memory coupled to the heterogeneous computing platform, where the memory comprises a plurality of sets of firmware instructions, where each set of firmware instructions, upon execution by a respective device, enables the respective device to provide a corresponding firmware service, and where at least one of the plurality of devices operates as an orchestrator configured to: determine a location of the IHS during a collaboration session, and in response to the determination, change a camera setting.

First claim

The invention claimed is:

1 . An Information Handling System (IHS), comprising:
a heterogeneous computing platform comprising a plurality of devices; and a memory coupled to the heterogeneous computing platform, wherein the memory comprises a plurality of sets of firmware instructions, wherein each set of firmware instructions, upon execution by a respective device, enables the respective device to provide a corresponding firmware service, and wherein at least one of the plurality of devices operates as an orchestrator configured to:
determine a location of the IHS during a collaboration session; and
in response to the determination, change a camera setting by sending a message or command to a firmware service provided by a camera via an Application Programming Interface (API) without any involvement by any host Operating System (OS), wherein the firmware service is configured to indicate the camera setting to the host OS, at least in part, as a Human Interface Device (HID) report, and wherein the camera setting comprises brightness of an entire image or video.

2 . The IHS of claim 1 , wherein the heterogeneous computing platform comprises: a System-On-Chip (SoC), a Field-Programmable Gate Array (FPGA), or an Application-Specific Integrated Circuit (ASIC).

3 . The IHS of claim 1 , wherein the orchestrator comprises a sensing hub.

4 . The IHS of claim 1 , wherein the orchestrator comprises an Embedded Controller (EC) or Baseboard Management Controller (BMC).

5 . The IHS of claim 1 , wherein the collaboration session comprises an audio or video conference.

6 . The IHS of claim 1 , wherein to determine the location, the orchestrator is configured to receive a message or an instruction from an OS agent or application that indicates a start of the collaboration session.

7 . The IHS of claim 1 , wherein to determine the location, the orchestrator is configured to receive a message from an OS agent or application to implement a policy received from an Information Technology Decision Maker (ITDM) or Original Equipment Manufacturer (OEM).

8 . The IHS of claim 7 , wherein the policy identifies at least one of: a rule that associates the location with the change to the camera setting, or a parameter usable to determine if the IHS is at the location.

9 . The IHS of claim 7 , wherein the policy identifies one of the plurality of devices to execute an Artificial Intelligence (AI) model selected based upon contextual information.

10 . The IHS of claim 9 , wherein the AI model comprises a background segmentation model.

11 . The IHS of claim 1 , wherein the sets of firmware instructions are delivered to the plurality of devices as one or more extension drivers within a firmware installation package prior to the collaboration session.

12 . A memory coupled to a heterogeneous computing platform, wherein the heterogeneous computing platform comprises a plurality of devices, wherein the memory is configured to receive a plurality of sets of firmware instructions, wherein each set of firmware instructions, upon execution by a respective device, enables the respective device to provide a corresponding firmware service without any involvement by any host Operating System (OS), and wherein at least one of the plurality of devices operates as an orchestrator configured to:
determine a location of the heterogeneous computing platform during a collaboration session; and in response to the determination and in accordance with the policy, change a camera setting by sending a message or command to a firmware service provided by a camera via an Application Programming Interface (API) without any involvement by any host OS, wherein the firmware service is configured to indicate the camera setting to the host OS, at least in part, as a Human Interface Device (HID) report, and wherein the camera setting comprises brightness of an entire image or video.

13 . The memory of claim 12 , wherein to determine the location of the heterogeneous computing platform, the orchestrator is configured to receive location data from one or more firmware services provided by one or more of the plurality of devices via another API, and wherein the location data comprises Global Positioning System (GPS) data or wireless network data.

14 . The memory of claim 12 , wherein the sets of firmware instructions are delivered to the plurality of devices as one or more extension drivers within a firmware installation package prior to the collaboration session.

15 . A method, comprising:
receiving a firmware installation package comprising extension drivers in a heterogeneous computing platform comprising a plurality of devices, wherein upon execution, each extension driver causes a respective device to provide a firmware service to other devices via an Application Programming Interface (API); and delivering an indication of a policy to an orchestrator among the plurality of devices, wherein the policy is usable by the orchestrator to change a camera setting, based, at least in part, upon a location of the heterogeneous computing platform, by sending a message or command to a firmware service provided by a camera via another API without any involvement by any host Operating System (OS), wherein the firmware service indicates the camera setting to the host OS, at least in part, as a Human Interface Device (HID) report, and wherein the camera setting comprises brightness of an entire image or video.

16 . The method of claim 15 , wherein location data corresponding to the location of the heterogeneous computing platform comprises Global Positioning System (GPS) data or wireless network data.

Assignees

• Dell Products L P

Inventors

• Hamlin Daniel L
• Kondapi Srikanth
• Swierk Todd Erick

Classifications

• G06F13/385 Primary

  for adaptation of a particular data processing system to different peripheral devices · CPC title

• G06F3/005 Primary

  Input arrangements through a video camera · CPC title