Dual system on a chip eyewear

Patent metadata

Field	Value
Publication number	US-12372791-B2
Application number	US-202117501167-A
Country	US
Kind code	B2
Filing date	Oct 14, 2021
Priority date	Oct 14, 2021
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate displays, and it performs three-dimensional graphics and compositing. A second SoC operates first and second color cameras, first and second computer vision (CV) cameras, an operating system (OS), CV algorithms, and visual odometry (VIO), and it performs hand gesture tracking of the user and provides depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

First claim

What is claimed is:

1. Eyewear, comprising:
a frame having a first side and a second side;
a plurality of electronic components;
a first system on a chip (SoC) adjacent the first side of the frame, the first SoC coupled to a first set of the plurality of electronic components including three-dimensional (3D) graphics;
a singular second SoC adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components, wherein the first and second set of the plurality of electronic components are different, wherein the first SoC and the second SoC are connected via an interprocessor communication bus;
wherein the first set of the plurality of electronic components comprises a first display and a second display wherein the first SoC handles all output imaging via the displays; and
the second set of the plurality of electronic components comprises a memory, a first color camera and a second color camera, a first computer vision (CV) camera and a second CV camera, wherein the second SoC handles all input imaging from the first and second color cameras and from the first and second CV cameras, wherein the memory is not shared across the interprocessor communication bus.

2. The eyewear of claim 1 , wherein none of the electronic components in the first set of the plurality of electronic components are in the second set of the plurality of electronic components.

3. The eyewear of claim 1 , further comprising load balancing instructions for execution on the first and second SoCs, the load balancing instructions, when executed by the first and second SoCs, shift processing workload between the first and second SoCs.

4. The eyewear of claim 3 , further comprising:
a first temperature sensor adjacent the first SoC, the first temperature sensor generating a first temperature value;
a second temperature sensor adjacent the second SoC, the second temperature sensor generating a second temperature value;
wherein the load balancing instructions configure the first and second SoCs to shift the processing workload responsive the first and second temperature values.

5. The eyewear of claim 1 , wherein:
the first SoC is configured to render three-dimensional (3D) graphics and perform rendering functions.

6. The eyewear of claim 1 , wherein only the second SoC comprises an operating system (OS).

7. The eyewear of claim 1 , wherein the second SoC is configured to perform CV and virtual input output (VIO).

8. The eyewear of claim 1 , wherein the second SoC is configured to perform machine learning and video encoding, run application logic, and manage communications.

9. The eyewear of claim 1 , wherein the eyewear further comprises first display components adjacent the first side, second display components adjacent the second side, a passive thermal cooling capacity of approximately 2 to 3 Watts adjacent each of the first and second sides and wherein each of the first and second SoCs operates at approximately 1.5 Watts or less and each of the first and second display components operate at approximately 1 to 2 Watts.

10. A method for use of eyewear including a frame having a first side and a second side and a plurality of electronic components, the method comprising:
performing a first set of operations with a first system on a chip (SoC) positioned adjacent the first side of the frame, the first SoC coupled to and operating a first set of the plurality of electronic components including three-dimensional (3D) graphics;
performing a second set of operations with a singular second SoC positioned adjacent the second side of the frame, the second SoC coupled to and operating a second set of the plurality of electronic components, wherein the first and second set of the plurality of electronic components are different, wherein the first SoC and the second SoC are connected via an interprocessor communication bus;
wherein the first set of the plurality of electronic components comprises a first display and a second display wherein the first SoC handles all output imaging via the displays; and
the second set of the plurality of electronic components comprises a memory, a first color camera and a second color camera, a first computer vision (CV) camera, and a second CV camera, wherein the second SoC handles all input imaging from the first and second color cameras and from the first and second CV cameras, wherein the memory is not shared across the interprocessor communication bus.

11. The method of claim 10 , wherein none of the electronic components in the first set of the plurality of electronic components are in the second set of the plurality of electronic components.

12. The method of claim 10 , wherein:
the first SoC is configured to render three-dimensional (3D) graphics and perform rendering functions.

13. The method of claim 10 , wherein only the second SoC comprises an operating system (OS).

14. The method of claim 10 , wherein the second SoC is configured to perform CV and virtual input output (VIO).

15. The method of claim 10 , wherein the second SoC is configured to perform machine learning and video encoding, run application logic, and manage communications.

16. A non-transitory computer readable medium including instructions for operating an eyewear device including a frame having a first side and a second side and a plurality of electronic components, the instructions when executed by the eyewear device configures the eyewear device to:
perform a first set of operations with a first system on a chip (SoC) positioned adjacent the first side of the frame, the first SoC coupled to and operating a first set of the plurality of electronic components including three-dimensional (3D) graphics;
perform a second set of operations with a singular second SoC positioned adjacent the second side of the frame, the second SoC coupled to and operating a second set of the plurality of electronic components, wherein the first and second set of the plurality of electronic components are different wherein the first SoC and the second SoC are connected via an interprocessor communication bus;
operate the first set of the plurality of electronic components comprising a first display and a second display wherein the first SoC handles all output imaging via the displays; and
operate the second set of the plurality of electronic components comprising a memory, a first color camera, a second color camera, a first computer vision (CV) camera, a second CV camera, and perform CV, wherein the second SoC handles all input imaging from the first and second color cameras and from the first and second CV cameras, wherein the memory is not shared across the interprocessor communication bus.

17. The non-transitory computer readable medium of claim 16 , wherein the instructions when executed by the eyewear device further configures the eyewear device to:
operate the first set of the plurality of electronic components to render three-dimensional (3D) graphics and perform rendering functions.

Assignees

• Heger Jason
• Nilles Gerald
• Simons Patrick Timothy Mcsweeney
• Snap Inc

Inventors

• Heger Jason
• Nilles Gerald
• Simons Patrick Timothy Mcsweeney

Classifications

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B27/0172 Primary

  characterised by optical features · CPC title

• G06T15/005

  General purpose rendering architectures · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title