Dual system on a chip eyewear

Patent metadata

Field	Value
Publication number	US-11997249-B2
Application number	US-202117501654-A
Country	US
Kind code	B2
Filing date	Oct 14, 2021
Priority date	Oct 14, 2021
Publication date	May 28, 2024
Grant date	May 28, 2024

Abstract

Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

First claim

What is claimed is:

1. Eyewear, comprising:
a frame having a first side and a second side;
a plurality of electronic components;
a first system on a chip (SoC) adjacent the first side of the frame, the first SoC coupled to a first set of the plurality of electronic components; and
a second SoC adjacent the second side of the frame, wherein a second set of the plurality of electronic components is configured to be selectively coupled by a switch to each of the first SoC and the second SoC, wherein the first and second set of the plurality of electronic components are different, wherein when the switch is in at first position the first SoC is configured to control the first and second set of the plurality of electronic components, and when the switch is in a second position the second SoC is configured to control the second set of the plurality of electronic components and the first SoC is not configured to control the second set of the plurality of electronic components.

2. The eyewear of claim 1 , wherein none of the electronic components are coupled to the second SoC when the second set of the plurality of electronic components are coupled to the first SoC.

3. The eyewear of claim 1 , wherein the first SoC and the second SoC each have a processor, further comprising load balancing instructions for execution on the first and second SoCs, the load balancing instructions, when executed by the first and second SoCs, shift processing workload of the processors between the first and second SoCs.

4. The eyewear of claim 3 , further comprising:
a first temperature sensor adjacent the first SoC, the first temperature sensor generating a first temperature value;
a second temperature sensor adjacent the second SoC, the second temperature sensor generating a second temperature value;
wherein the load balancing instructions configure the first and second SoCs to shift the processing workload responsive the first and second temperature values.

5. The eyewear of claim 1 , wherein:
the first set of the plurality of electronic components comprises a first color camera and a second color camera; and
the second set of the plurality of electronic components comprises a first computer vision (CV) camera and a second CV camera.

6. The eyewear of claim 5 , wherein:
the first set of the plurality of electronic components further comprises a first display and a second display.

7. The eyewear of claim 5 , wherein the first SoC and the second SoC each comprise an operating system (OS).

8. The eyewear of claim 1 , wherein the first SoC is configured to render three-dimensional (3D) graphics, perform computer vision, machine learning, and video encoding, and the first SoC is configured to run application logic and perform rendering functions.

9. The eyewear of claim 1 , wherein the first and second SoCs are configured to perform computer vision (CV) and visual odometry (VIO).

10. The eyewear of claim 1 , wherein the eyewear further comprises first display components adjacent the first side, second display components adjacent the second side, a passive thermal cooling capacity of approximately 2 to 3 Watts adjacent each of the first and second sides and wherein each of the first and second SoCs operates at approximately 1.5 Watts or less and each of the first and second display components operate at approximately 1 to 2 Watts.

11. A method for use of eyewear including a frame having a first side and a second side and a plurality of electronic components, the method comprising:
performing a first set of operations with a first system on a chip (SoC) positioned adjacent the first side of the frame, the first SoC coupled to and operating a first set of the plurality of electronic components; and
selectively performing a second set of operations with a second SoC positioned adjacent the second side of the frame, wherein a second set of the plurality of electronic components is selectively coupled by a switch to each of the first SoC and the second SoC, wherein the first and second set of the plurality of electronic components are different, wherein when the switch is in a first position the first SoC controls the first and second set of the plurality of electronic components, and when the switch is in a second position the second SoC controls the second set of the plurality of electronic components and the first SoC does not control the second set of the plurality of electronic components.

12. The method of claim 11 , wherein none of the electronic components are coupled to the second SoC when the second set of the plurality of electronic components are coupled to the first SoC.

13. The method of claim 11 , wherein:
the first set of the plurality of electronic components comprises a first color camera and a second color camera; and
the second set of the plurality of electronic components comprises a first computer vision (CV) camera and a second CV camera.

14. The method of claim 13 , wherein:
the first set of the plurality of electronic components further comprises a first display and a second display.

15. The method of claim 13 , wherein the first SoC and the second SoC comprise an operating system (OS).

16. The method of claim 11 , wherein the first SoC renders three-dimensional (3D) graphics, performs computer vision, machine learning, and video encoding and the first SoC runs application logic and performs rendering functions.

17. The method of claim 11 , wherein the first and second SoCs perform computer vision (CV) and visual odometry (VIO).

18. A non-transitory computer readable medium including instructions for operating an eyewear device including a frame having a first side and a second side and a plurality of electronic components, the instructions when executed by the eyewear device configures the eyewear device to:
perform a first set of operations with a first system on a chip (SoC) positioned adjacent the first side of the frame, the first SoC coupled to and operating a first set of the plurality of electronic components; and
selectively perform a second set of operations with a second SoC positioned adjacent the second side of the frame, wherein a second set of the plurality of electronic components is selectively coupled by a switch to each of the first SoC and the second SoC, wherein the first and second set of the plurality of electronic components are different, wherein the first and second set of the plurality of electronic components are different, wherein when the switch is in a first position the first SoC controls the first and second set of the plurality of electronic components, and when the switch is in a second position the second SoC controls the second set of the plurality of electronic components and the first SoC does not control the second set of the plurality of electronic components.

19. The non-transitory computer readable medium of claim 18 , wherein the instructions when executed by the eyewear device further configures the eyewear device to:
operate the first set of the plurality of electronic components comprising a first color camera and a second color camera; and
operate the second set of the plurality of electronic components comprising a first computer vision (CV) camera and a second CV camera.

20. The non-transitory computer readable medium of claim 18 , wherein the instructions when executed by the eyewear device further configures the eyewear device to:
operate the first set of the plurality of electronic components further comprising a first display and a second display.

Assignees

• Heger Jason
• Nilles Gerald
• Ryuma Dmitry
• Simons Patrick Timothy Mcsweeney
• Wagner Daniel
• Snap Inc

Inventors

• Heger Jason
• Nilles Gerald
• Ryuma Dmitry
• Simons Patrick Timothy Mcsweeney
• Wagner Daniel

Classifications

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• H04N2213/001

  Constructional or mechanical details · CPC title

• H04N13/398

  Synchronisation thereof; Control thereof · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title