External user interface for head worn computing

Patent metadata

Field	Value
Publication number	US-9939934-B2
Application number	US-201414158198-A
Country	US
Kind code	B2
Filing date	Jan 17, 2014
Priority date	Jan 17, 2014
Publication date	Apr 10, 2018
Grant date	Apr 10, 2018

Abstract

Aspects of the present invention relate to external user interfaces used in connection with head worn computers (HWC). Embodiments relate to an external user interface that has a physical form intended to be hand held. The hand held user interface may be in the form similar to that of a writing instrument, such as a pen. In embodiments, the hand held user interface includes technologies relating to writing surface tip pressure monitoring, lens configurations setting a predetermined imaging distance, user interface software mode selection, quick software application launching, and other interface technologies.

First claim

We claim:

1. A method, comprising:
capturing an image from a writing surface end of a hand-held device;
determining, based at least in part on the image, that the writing surface end of the hand-held device is on a writing surface;
monitoring forces exerted on a writing surface end of the hand-held device over a period of time;
identifying a discrete force event during the period of time based on the monitored forces, the discrete force event including a sudden and substantial increase in force;
causing a graphic user interface element to appear in a display of a head-worn computer in the event that the discrete force event substantially matches a predetermined force signature;
wherein the hand-held device includes an inertial movement unit (IMU) to determine motion of the hand-held device, and
wherein the motion is used in coordination with an image of a writing surface to determine a stroke pattern.

2. The method of claim 1 , wherein the motion is used to predict a gesture, wherein the gesture is used to control an aspect of a graphical user interface.

3. The method of claim 1 , wherein the motion causes a selection of a user interface mode.

4. The method of claim 1 , wherein the force is identified using a piezo-electric device.

5. The method of claim 1 , wherein the hand-held device is in communication with a head-worn computer (HWC).

6. The method of claim 1 , wherein the user interface process is a selection of an item.

7. The method of claim 1 , wherein the user interface process produces a menu associated with a right-side click.

8. The method of claim 1 , wherein the user interface process produces a result associated with a double click.

9. A hand-held user interface device for a head-worn computer, comprising:
a force monitor adapted to measure forces exerted on a writing surface end of a hand-held device over a period of time;
a camera adapted to capture an image from the writing surface end of the hand-held device; and
a processor adapted to determine that the writing surface end of the hand-held device is on a writing surface based, at least in part, on the image, the processor further adapted to identify a discrete force event during the period of time based on the measured forces, the discrete force event including a sudden and substantial increase in force,
wherein the processor is adapted to communicate with the head-worn computer to cause a graphical user interface element to appear in a display of the head-worn computer in the event the discrete force event exceeds a predetermined threshold; and
wherein the hand-held device includes an inertial movement unit (IMU) to determine motion of the hand-held device, and wherein the motion is used in coordination with an image of a writing surface to determine a stroke pattern.

Assignees

• Osterhout Design Group Inc
• Osterhout Group Inc

Inventors

• Osterhout Ralph F
• Border John N
• Nortrup Edward H

Classifications

• G04G21/025

  for measuring physiological data · CPC title

• G04G21/00

  Input or output devices integrated in time-pieces · CPC title

• G04G17/083

  Watches distributed over several housings · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title