Dual system on a chip eyewear

Patent metadata

Field	Value
Publication number	US-12445591-B2
Application number	US-202117496189-A
Country	US
Kind code	B2
Filing date	Oct 7, 2021
Priority date	Oct 7, 2021
Publication date	Oct 14, 2025
Grant date	Oct 14, 2025

Abstract

Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

First claim

What is claimed is:

1. Eyewear, comprising:
a frame having a first side and a second side;
a plurality of electronic components;
a first system on a chip (SoC) adjacent the first side of the frame, the first SoC coupled to a first set of the plurality of electronic components; and
a second SoC adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components, wherein the second set of the plurality of electronic components comprises a first computer vision (CV) camera and a second CV camera each configured to generate images;
wherein the second SoC is configured as a sensor hub configured to perform all CV processing for the first and the second CV cameras, machine learning (ML), and processing video encoding; and
wherein the first SoC is configured to run application logic, audio and video rendering functions, and wireless communications where the images genera ted by the CV cameras of the second SoC are prevented from being sent by the wireless communications.

2. The eyewear of claim 1 , wherein none of the electronic components in the first set of the plurality of electronic components are in the second set of the plurality of electronic components.

3. The eyewear of claim 1 , wherein:
the second set of the plurality of electronic components further comprises a first display and a second display.

4. The eyewear of claim 1 , wherein only the first SoC comprises an operating system (OS).

5. A method for use of eyewear including a frame having a first side and a second side and a plurality of electronic components, the method comprising:
performing a first set of operations with a first system on a chip (SoC) positioned adjacent the first side of the frame, the first SoC coupled to and operating a first set of the plurality of electronic components; and
performing a second set of operations with a second SoC positioned adjacent the second side of the frame, the second SoC coupled to and operating a second set of the plurality of electronic components, wherein the second set of the plurality of electronic components comprises a first computer vision (CV) camera and a second CV camera each configured to generate images;
the second SoC operating as a sensor hub performing all CV processing for the first and the second CV cameras, machine learning (ML), and processing video encoding; and
the first SoC running application logic, audio and all video rendering functions, and wireless communications where the images generated by the CV cameras of the second SoC are prevented from being sent by the wireless communications.

6. The method of claim 5 , wherein none of the electronic components in the first set of the plurality of electronic components are in the second set of the plurality of electronic components.

7. The method of claim 5 , wherein:
the second set of the plurality of electronic components further comprises a first display and a second display.

8. The method of claim 5 , wherein only the first SoC comprises an operating system (OS).

9. A non-transitory computer readable medium including instructions for operating an eyewear device including a frame having a first side and a second side and a plurality of electronic components, the instructions when executed by the eyewear device configures the eyewear device to:
perform a first set of operations with a first system on a chip (SoC) positioned adjacent the first side of the frame, the first SoC coupled to and operating a first set of the plurality of electronic components; and
perform a second set of operations with a second SoC positioned adjacent the second side of the frame, the second SoC coupled to and operating a second set of the plurality of electronic components comprising a first computer vision (CV) camera and a second CV camera each configured to generate images;
operate the second SoC as a sensor hub by performing all CV processing for the first and the second CV cameras, machine learning (ML), and processing video encoding; and
operate the first SoC by running application logic, audio and all video rendering functions, and wireless communications where the images generated by the CV cameras of the second SoC are prevented from being sent by the wireless communications.

10. The non-transitory computer readable medium of claim 9 , wherein the instructions when executed by the eyewear device further configures the eyewear device to: operate the second set of the plurality of electronic components further comprising a first display and a second display.

Assignees

• Snap Inc

Inventors

• Heger Jason
• Nilles Gerald
• Ryuma Dmitry
• Simons Patrick Timothy Mcsweeney
• Wagner Daniel

Classifications

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G01K13/00

  Thermometers specially adapted for specific purposes · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title