Sight information collection in head worn computing

Patent metadata

Field	Value
Publication number	US-11227294-B2
Application number	US-201414244417-A
Country	US
Kind code	B2
Filing date	Apr 3, 2014
Priority date	Apr 3, 2014
Publication date	Jan 18, 2022
Grant date	Jan 18, 2022

Abstract

Aspects of the present invention relate to methods and systems for collecting an using eye heading and sight heading information in head worn computing.

First claim

We claim:

1. A method, comprising:
determining a first geo-spatial location corresponding to a first location in proximity to a physical object;
determining a first viewing information for a first user of a plurality of wearable head device users, and a second viewing information for a second user of the plurality of wearable head device users, wherein:
the first viewing information is determined using an initial GPS location of the first user's wearable head device at a first time, an orientation of the first user's wearable head device, and an image of a first eye of the first user, the image captured by the first user's wearable head device, and
the second viewing information is determined using an initial GPS location of the second user's wearable head device at a second time, an orientation of the second user's wearable head device, and an image of a first eye of the second user, the image captured by the second user's wearable head device;

determining an alignment of the first user with the first geo-spatial location based on the initial GPS location of the first user's wearable head device;
determining, based on the first viewing information and the alignment of the first user with the first geo-spatial location, whether the first user is viewing the physical object;
in accordance with a determination that the first user is viewing the physical object, determining, at a third time, a subsequent GPS location of the first user's wearable head device;
generating a first personal profile for the first user, the first personal profile identifying a relationship between the physical object and a movement of the first user, the movement determined using the initial GPS location and the subsequent GPS location of the first user's wearable head device;
determining an alignment of the second user with the first geo-spatial location based on the initial GPS location of the second user's wearable head device;
determining, based on the second viewing information and the alignment of the second user with the first geo-spatial location, whether the second user is viewing the physical object;
in accordance with a determination that the second user is viewing the physical object, determining, at a fourth time, a subsequent GPS location of the second user's wearable head device;
generating a second personal profile for the second user, the second personal profile identifying a relationship between the physical object and a movement of the second user, the movement determined using the initial GPS location and the final GPS location of the second user's wearable head device; and
developing a crowd profile associated with the physical object based on the first personal profile and the second personal profile,
wherein the crowd profile identifies a viewing preference of the plurality of wearable head device users.

2. The method of claim 1 , wherein the crowd profile further identifies a relationship between the physical object and a characteristic of the plurality of users.

3. The method of claim 2 , wherein the crowd profile further identifies a relationship between the physical object and an average length of time for which the plurality of users view the physical object.

4. The method of claim 1 wherein the image of the first eye of the first user includes a reflection of a content being displayed via the first user's wearable head device, and wherein the image of the first eye of the second user includes a reflection of a content being displayed via the second user's wearable head device.

5. The method of claim 4 , wherein the content being displayed via the first user's wearable head device includes the object, and wherein the content being displayed via the second user's wearable head device includes the object.

6. The method of claim 1 , further comprising:
capturing an image of a second eye of the first user, wherein the image of the first eye of the first user and the image of the second eye of the first user are collected via a first camera disposed in line with an optical path internal to content display optics of the first user's wearable head device; and
capturing an image of a second eye of the second user, wherein the image of the first eye of the second user and the image of the second eye of the second user are collected via a second camera disposed in line with an optical path internal to content display optics of the second user's wearable head device.

7. The method of claim 6 , wherein the image of the first eye of the first user and the image of the second eye of the first user are used to determine an amount of convergence of the first eye of the first user and the second eye of the first user and to determine a focal plane of the first user, and wherein the image of the first eye of the second user and the image of the second eye of the second user are used to determine an amount of convergence of the first eye of the second user and the second eye of the second user and to determine a focal plane of the second user.

8. A non-transitory computer-readable medium storing instructions, which when executed by one or more processors cause the one or more processors to perform a method comprising:
determining a first geo-spatial location corresponding to a first location in proximity to a physical object;
determining a first viewing information for a first user of a plurality of wearable head device users, and a second viewing information for a second user of the plurality of wearable head device users, wherein:
the first viewing information is determined using an initial GPS location of the first user's wearable head device at a first time, an orientation of the first user's wearable head device, and an image of a first eye of the first user, the image captured by the first user's wearable head device, and
the second viewing information is determined using an initial GPS location of the second user's wearable head device at a second time, an orientation of the second user's wearable head device, and an image of a first eye of the second user, the image captured by the second user's wearable head device;
determining an alignment of the first user with the first geo-spatial location based on the initial GPS location of the first user's wearable head device;
determining, based on the first viewing information and the alignment of the first user with the first geo-spatial location, whether the first user is viewing the physical object;
in accordance with a determination that the first user is viewing the physical object, determining, at a third time, a subsequent GPS location of the first user's wearable head device;
generating a first personal profile for the first user, the first personal profile identifying a relationship between the physical object and a movement of the first user, the movement determined using the initial GPS location and the subsequent GPS location of the first user's wearable head device;
determining an alignment of the second user with the first geo-spatial location based on the initial GPS location of the second user's wearable head device;
determining, based on the first viewing information and the alignment of the second user with the first geo-spatial location, whether the second user is viewing the physical object;
in accordance with a determination that the second user is viewing the physical object, determining, at a fourth time, a subsequent GPS location of the second user's wearable head device;
generating a second personal profile for the second user, the second personal profile identifying a relationship between the physical object and a movement of the second user, the movement determined using the initial GPS location and the final GPS location of the second user's wearable head device; and
dev

Assignees

• Mentor Acquisition One Llc

Inventors

• Nortrup Edward H
• Border John N

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G06F3/03547

  Touch pads, in which fingers can move on a surface · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F9/453

  Help systems · CPC title