Thermal management for extended reality ecosystem

Patent metadata

Field	Value
Publication number	US-11886259-B2
Application number	US-202117499757-A
Country	US
Kind code	B2
Filing date	Oct 12, 2021
Priority date	Oct 12, 2021
Publication date	Jan 30, 2024
Grant date	Jan 30, 2024

Abstract

A method by a computing system associated with a set of disjoint devices that includes at least one wearable device includes receiving a request to perform a task. The method further includes determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices. The method further includes determining a plurality of workload assignments needed to be performed to accomplish the task. The method further includes distributing, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices. The method further includes performing the task by causing the one or more devices to execute the distributed plurality of work assignments.

First claim

What is claimed is:

1. A method comprising, by a computing system associated with a set of disjoint devices that includes at least one wearable device:
receiving a request to perform a task;
determining, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices, wherein determining the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between a predetermined thermal design power (TDP) limit and an estimation of a current power consumption for each device;
determining a plurality of workload assignments needed to be performed to accomplish the task;
distributing, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and
performing the task by causing the one or more devices to execute the distributed plurality of work assignments.

2. The method of claim 1 , wherein determining the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between the predetermined TDP limit and the current power consumption based at least in part on a head pose or an object pose associated with the at least one wearable device.

3. The method of claim 1 , wherein determining, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices comprises determining the thermal constraint differential at runtime.

4. The method of claim 1 , wherein, prior to determining the plurality of workload assignments needed to be performed to accomplish the task, the method further comprises:
determining one or more execution parameters associated with an application corresponding to the task to be performed; and
estimating, based on the one or more execution parameters associated with the application, a power consumption of the plurality of workload assignments.

5. The method of claim 4 , further comprising:
determining the plurality of workload assignments based on the thermal constraint differential and the estimation of the power consumption of the plurality of workload assignments.

6. The method of claim 5 , wherein a number of the plurality of workload assignments is greater than a number of the one or more devices of the set of disjoint devices.

7. The method of claim 1 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the method further comprising:
determining, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and
redistributing, based on the second thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices, wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

8. The method of claim 1 , wherein the one or more power or thermal constraints comprises a device processing speed, a device storage capacity, a device thermal rating, or a device power rating.

9. A computing system associated with a set of disjoint devices that includes at least one wearable device, one or more devices of the set of disjoint devices including:
one or more non-transitory computer-readable storage media including instructions; and
one or more processors coupled to the one or more non-transitory computer-readable storage media, the one or more processors configured to execute the instructions to:
receive a request to perform a task;
determine, based on sensor data associated with the set of disjoint devices, a thermal-constraint differential for each device of the set of disjoint devices, wherein determining the thermal-constraint differential for each device of the set of disjoint devices comprises determining a difference between a predetermined thermal design power (TDP) limit and an estimation of a current power consumption for each device;
determine a plurality of workload assignments needed to be performed to accomplish the task;
distribute, based on the thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to one or more devices of the set of disjoint devices to satisfy one or more power or thermal constraints associated with each device of the set of disjoint devices; and
perform the task by causing the one or more devices to execute the distributed plurality of work assignments.

10. The computing system of claim 9 , wherein the instructions to determine the thermal-constraint differential for each device of the set of disjoint devices further comprise instructions to determine a difference between the predetermined TDP limit and the current power consumption based at least in part on a head pose or an object pose associated with the at least one wearable device.

11. The computing system of claim 9 , wherein the instructions to determine, based on sensor data associated with the set of disjoint devices, the thermal-constraint differential for each device of the set of disjoint devices further comprises instructions to determine the thermal constraint differential at runtime.

12. The computing system of claim 9 , wherein, prior to determining the plurality of workload assignments needed to be performed to accomplish the task, the instructions further comprise instructions to:
determine one or more execution parameters associated with an application corresponding to the task to be performed; and
estimate, based on the one or more execution parameters associated with the application, a power consumption of the plurality of workload assignments.

13. The computing system of claim 12 , wherein the instructions further comprise instructions to:
determine the one or more rendering workload assignments to be performed by the set of disjoint devices based on the thermal constraint differential and the estimation of the power consumption of the rendering workload associated with rendering the frame.

14. The computing system of claim 13 , wherein a number of the plurality of workload assignments is greater than a number of the one or more devices of the set of disjoint devices.

15. The computing system of claim 9 , wherein the one or more devices of the set of disjoint devices comprises a first subset of the set of disjoint devices, the instructions further comprising instructions to:
determine, based on sensor data associated with the set of disjoint devices, a second thermal-constraint differential for each device of the set of disjoint devices; and
redistribute, based on the second thermal-constraint differentials of the set of disjoint devices, the plurality of workload assignments to a second subset of the set of disjoint devices, wherein one or more devices of the second subset of the set of disjoint devices is different from one or more devices of the first subset of the set of disjoint devices.

16. The computing system of claim 9 , wherein the one or more power or thermal constraints comprises a device processing speed, a device storage capacity, a device thermal rating, or a device power rating.

17. A non-transitory computer-readable medium comprising instructions th

Assignees

• Meta Platforms Tech Llc

Inventors

• Zandian Bardia
• Gorbatov Eugene
• Raghuvanshi Pankaj
• Yardi Shrirang Madhav

Classifications

• G06F1/206 Primary

  comprising thermal management · CPC title

• G06F1/163

  Wearable computers, e.g. on a belt · CPC title

• G06T15/005

  General purpose rendering architectures · CPC title

• G06F9/505 Primary

  considering the load · CPC title

• G06F9/4893

  taking into account power or heat criteria (power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206) · CPC title