Head-mountable apparatus and system

Patent metadata

Field	Value
Publication number	US-10078366-B2
Application number	US-201414896746-A
Country	US
Kind code	B2
Filing date	Jun 11, 2014
Priority date	Jun 11, 2013
Publication date	Sep 18, 2018
Grant date	Sep 18, 2018

Abstract

A head mountable display (HMD) is provided that has a head motion detection function and one or more operations that depend upon detected head motion. Detected head motion is stored as motion data in memory. The way in which detected head motion is applied to a current operation depends upon the stored motion data. In one embodiment, the HMD includes a gaze detector configured to detect eye orientation of a user of the user so as to detect image regions at which the user is looking, and a detector configured to detect item data indicative of items represented by the detected image regions.

First claim

The invention claimed is:

1. A head mountable display (HMD), comprising:
a frame adapted to hold the HMD on a user's head; and
one or more display devices coupled to the frame;
wherein the HMD is configured to perform a head motion detection function and one or more HMD operations which depend upon detected head motion and to store a first head motion associated with use by the user in memory as first motion data,
wherein the HMD comprises control circuitry to retrieve previously stored motion data from the memory and to apply retrieved first motion data from a previous HMD activity so that a way in which a second, current, detected head motion is applied to a current one of the one or more operations depends upon the stored and retrieved first motion data.

2. An HMD according to claim 1 , in which the first motion data comprises data dependent upon the first head motion of the user of the HMD aggregated with motion data for other users.

3. An HMD according to claim 1 , wherein the HMD is configured to apply a scaling between an available range of head motion for a particular user and a range of head motion required by a particular one of the one or more HMD operations.

4. An HMD according to claim 1 , in which a given one of the one or more HMD operations is arranged to require less head motion during an initial period of use than during a later period of use of the given HMD operation.

5. An HMD according to claim 1 , in which, when head motion unconnected with displayed stimuli is detected, the HMD is configured to disregard head motion over a threshold speed or acceleration.

6. An HMD according to claim 5 , in which the HMD is configured to render user interface controls in a larger format in response to a detection of head motion unconnected with displayed stimuli.

7. An HMD according to claim 1 , in which, when no head motion greater than a predetermined range of motion is detected, the HMD is configured to detect eye motion of the user and to use the detected eye motion to control the HMD in place of detected head motion.

8. An HMD according to claim 1 , further comprising:
a gaze detector configured to detect eye orientation of a user of the user so as to detect image regions at which the user is looking; and
a detector configured to detect item data indicative of items represented by the detected image regions.

9. A system, comprising:
a set of two or more head mountable displays (HMDs), each HMD comprising:
a frame adapted to hold the HMD on a user's head; and
one or more display devices coupled to the frame;
wherein the HMD is configured to perform a head motion detection function and one or more HMD operations that depend upon detected head motion and to store a first head motion associated with use by the user in memory as first motion data,
wherein the HMD comprises control circuitry to retrieve previously stored motion data from the memory and to apply retrieved first motion data from a previous HMD activity so that a way in which a second, current, detected head motion is applied to a current one of the one or more operations depends upon the stored and retrieved first motion data, each HMD comprising:
a gaze detector configured to detect eye orientation of a user of the user so as to detect image regions at which the user is looking; and
a detector configured to detect item data indicative of items represented by the detected image regions; and

a data processor operatively coupled to each HMD of the set, the data processor being configured to amalgamate the item data from the set of HMDs.

10. A system, comprising:
a set of two or more head mountable displays (HMDs), each HMD comprising:
a frame adapted to hold the HMD on a user's head; and
one or more display devices coupled to the frame;
wherein the HMD is configured to perform a head motion detection function and one or more HMD operations that depend upon detected head motion and to store a first head motion associated with use by the user in memory as first motion data,
wherein the HMD comprises control circuitry to retrieve previously stored motion data from the memory and to apply retrieved first motion data from a previous HMD activity so that a way in which a second, current, detected head motion is applied to a current one of the one or more operations depends upon the stored and retrieved first motion data, wherein the first motion data comprises data dependent upon the first head motion of a user of the HMD aggregated with motion data for other users; and

a data processor operatively coupled to each HMD of the set, the data processor being configured to amalgamate motion data from the set of HMDs and to supply the amalgamated motion data to one or more of the HMDs of the set.

11. A system, comprising:
an HMD including:
a frame adapted to hold the HMD on a user's head; and
one or more display devices coupled to the frame;
wherein the HMD is configured to perform a head motion detection function and one or more HMD operations which depend upon detected head motion and to store a first head motion associated with use by the user in memory as first motion data,
wherein the HMD comprises control circuitry to retrieve previously stored motion data from the memory and to apply retrieved first motion data from a previous HMD activity so that a way in which a second, current, detected head motion is applied to a current one of the one or more operations depends upon the stored and retrieved first motion data; and

one or more of a base device and an intermediate device operatively coupled to the HMD.

12. A method of operation of a head mountable display (HMD) having a head motion detection function and one or more operations which depend upon detected head motion, the method comprising:
storing a first detected head motion associated with use by a user as first motion data in memory;
retrieving previously stored first motion data from the memory; and
applying, by one or more processing devices, a second, current, detected head motion to a current operation in dependence upon the stored and retrieved first motion data.

13. A non-transitory machine-readable storage medium having instructions stored thereon, the instructions, when executed by one or more processing devices, cause the one or more processing devices to perform a method of operating a head mountable display (HMD) having a head motion detection function and one or more operations that depend upon detected head motion, the method comprising:
storing a first detected head motion associated with use by a user as first motion data in memory;
retrieving previously stored first motion data from the memory; and
applying a second, current, detected head motion to a current operation in dependence upon the stored and retrieved first motion data.

14. A system according to claim 9 , in which the first motion data comprises data dependent upon the first head motion of the user of the HMD aggregated with motion data for other users.

15. A system according to claim 10 , in which the first motion data comprises data dependent upon the first head motion of the user of the HMD aggregated with motion data for other users.

16. A system according to claim 11 , in which the first motion data comprises data dependent upon the first head motion of the user of the HMD aggregated with motion data for other users.

17. A method according to claim 12 , in which the first motion data comprises data dependent upon the first detected head motion of the user of the HMD aggregated with motion data for other users.

18. A no

Assignees

• Sony Interactive Entertainment Europe Ltd

Inventors

• Ashforth Jeremy David
• Benson Simon Mark
• Hall Simon John
• Myatt Darren

Classifications

• A61B3/032

  Devices for presenting test symbols or characters, e.g. test chart projectors (A61B3/036 takes precedence) · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G02B27/017

  Head mounted · CPC title