Augmented reality personal assistant apparatus

Patent metadata

Field	Value
Publication number	US-9823737-B2
Application number	US-201414120835-A
Country	US
Kind code	B2
Filing date	Jul 1, 2014
Priority date	Apr 7, 2008
Publication date	Nov 21, 2017
Grant date	Nov 21, 2017

Abstract

Various embodiments of an intelligent augmented reality personal assistant apparatus integrated (or co-packaged) with an eye motion sensor, a microprocessor or an intelligent microprocessor and an intelligent rendering algorithm are disclosed. Such an augmented reality personal assistant apparatus can interpret/analyze/learn activities, communication or contextual information of a user and recommend relevant and useful information to the user.

First claim

We claim:

1. A subsystem, as an augmented reality personal assistant comprising:
(a) a first sensor, wherein the first sensor is an eye motion sensor;
(b) a camera sensor;
(c) a decoder;
(d) a display and a projector, wherein one or more pixels or three-dimensional (3-D) pixels of the display are integrated with a second sensor; and
wherein the first sensor is electrically coupled with the camera sensor,
wherein the camera sensor is electrically coupled with the decoder,
wherein the decoder is electrically coupled with the display or the projector,
wherein the first sensor is determining an item or a person that a user is looking at within the user's field of view,
wherein the decoder is converting the camera sensor's reading of the item or the person targeted by the first sensor in the user's field of view into a text or a picture image or a video image,
wherein the text or the picture image or the video image, converted by the decoder is either viewed on the display or projected by the projector on a surface,

(e) a first microprocessor, wherein the first microprocessor comprises memristors, wherein the first microprocessor further electrically couples with a first non-transitory local data storage media of the subsystem, as the augmented reality personal assistant storing a system operating algorithm,
wherein the memristors are arranged in two-dimension (2-D) or in three-dimension (3-D),
wherein the first microprocessor is electrically coupled with the first sensor, the camera sensor, the decoder, the display and the projector,

wherein the subsystem, as the augmented reality personal assistant and a portable Internet appliance are electrically or wirelessly coupled with a cloud based server or a cloud based data storage media,
wherein the portable internet appliance comprises: a second microprocessor or a neural microprocessor,
wherein the second microprocessor or the neural processor electrically couples with a second non-transitory local data storage media of the portable internet appliance storing an intelligent rendering algorithm.

2. The subsystem, as the augmented reality personal assistant according to claim 1 , further comprises: a contact lens or a contact lens integrated with a nanoscaled optical structure.

3. The subsystem, the augmented reality personal assistant according to claim 1 , further electrically or wirelessly couples with or comprises: a third sensor selected from the group consisting of: a gesture sensor and a touch sensor.

4. A subsystem, as an augmented reality personal assistant for social graph or personal analytics comprising:
(a) a first sensor, wherein the first sensor is an eye motion sensor;
(b) a camera sensor;
(c) a decoder;
(d) a display and a projector, wherein one or more pixels or three-dimensional (3-D) pixels of the display are integrated with a second sensor;
(e) a microphone;
(f) a location determination module;
(g) a first microprocessor;
(h) an electrical powering component; and
wherein the first sensor is electrically coupled with the camera sensor,
wherein the camera sensor is electrically coupled with the decoder,
wherein the decoder is electrically coupled with the display or the projector,
wherein the first sensor is determining an item or a person that a user is looking at within the user's field of view,
wherein the decoder is converting the camera sensor's reading of the item or the person targeted by the first sensor in the user's field of view into a text or a picture image or a video image,
wherein the text or the picture image or the video image, converted by the decoder is either viewed on the display or projected by the projector of on a surface,
wherein the first microprocessor is electrically coupled with the first sensor, the camera sensor, the decoder, the display, the projector, the microphone, the location determination module and the electrical powering component,
wherein the first microprocessor further comprises memristors, wherein the first microprocessor further electrically couples with a first non-transitory local data storage media of the subsystem, as the augmented reality personal assistant storing a system operating algorithm,
wherein the memristors are arranged in two-dimension (2-D) or in three-dimension (3-D),
wherein the first microprocessor further electrically couples with or comprises: a set of computer implementable instructions to interpret or analyze or learn activities or contextual information of the user,
wherein the said set of computer implementable instructions is stored in the first non-transitory local data storage media of the subsystem, as the augmented reality personal assistant or in a cloud based data storage media or a cloud based server,
wherein the first microprocessor further electrically couples with or comprises: a set of computer implementable instructions to interpret or analyze or learn a location of the user,
wherein the said set of computer implementable instructions is stored in the first non-transitory local data storage media of the subsystem, as the augmented reality personal assistant or in the cloud based data storage media or the cloud based server,

wherein the subsystem, as the augmented reality personal assistant and a portable internet appliance are electrically or wirelessly coupled with the cloud based data storage media or the cloud based server,
wherein the portable internet appliance comprises: a second microprocessor or a neural microprocessor,
wherein the second microprocessor or the neural processor electrically couples with a second non-transitory local data storage media of the portable internet appliance storing an intelligent rendering algorithm.

5. The subsystem, as the augmented reality personal assistant according to claim 4 , further comprises: a contact lens or a contact lens integrated with a nanoscaled optical structure.

6. The subsystem, as the augmented reality personal assistant according to claim 4 , further electrically or wirelessly couples with or comprises: a third sensor selected from the group consisting of: a gesture sensor and a touch sensor.

7. The subsystem, as the augmented reality personal assistant according to claim 4 , further comprises: a component selected from the group consisting of: a radio frequency identification device (RFID) and a near field communication (NFC) transceiver.

8. The subsystem, as the augmented reality personal assistant according to claim 4 , further comprises: a transceiver module selected from the group consisting of: a radio transceiver, a millimeter wave transceiver and a terahertz band transceiver.

9. The subsystem, as the augmented reality personal assistant according to claim 4 , further comprises: coupling with an algorithm selected from the group consisting of: a face recognition algorithm, a gesture recognition algorithm, a sound recognition algorithm, a voice recognition algorithm and a voice-to-text conversion algorithm stored in the first non-transitory local data storage media of the subsystem, as the augmented reality personal assistant or in the cloud based data storage media or the cloud based server.

10. The subsystem, as the augmented reality personal assistant according to claim 4 , further comprises: coupling with a pattern recognition algorithm or a data mining algorithm stored in the first non-transitory local data storage media of the subsystem, as the augmented reality personal assistant or in the cloud based data storage media or the cloud based server.

11. The subsystem, as the augmented reality personal assistant according to claim 4 , further comprises: coupling with a predictive algorithm stored in the first non-transitory local data

Assignees

• Mazed Mohammad A
• Mazed Sayeeda

Inventors

• Mazed Mohammad A
• Mazed Sayeeda

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G16C99/00

  Subject matter not provided for in other groups of this subclass · CPC title

• G10L15/00

  Speech recognition (G10L17/00 takes precedence) · CPC title

• G09G2380/02

  Flexible displays · CPC title

• G09G3/001

  using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP) · CPC title