Posture measuring device, posture measuring method, image processing device, image processing method, and image display system

Patent metadata

Field	Value
Publication number	US-10185389-B2
Application number	US-201415025679-A
Country	US
Kind code	B2
Filing date	Sep 19, 2014
Priority date	Dec 25, 2013
Publication date	Jan 22, 2019
Grant date	Jan 22, 2019

Abstract

An image display system 100 includes an attachment position error measuring function which measures deviation between reference axes of a head action tracking device 200 (x, y, z) and reference axes of the user (x w , y w , z w ), i.e., an attachment position error of the head action tracking device 200 , and an attachment position error absorbing function which corrects, based on the attachment position error, posture information about a posture of the head of the user detected by the head action tracking device 200 . An image drawing device 300 therefore renders, based on precise posture information, an image accurately following a motion of the head of the user.

First claim

The invention claimed is:

1. A posture measuring device, comprising:
a tracking unit configured to:
detect posture information of a user; and
measure a first gravity vector based on the detected posture information of the user, wherein the detected posture information indicates that a posture of the user is in a stationary state;

an attachment position error measuring unit configured to:
determine a first reference axis of the user based on the measured first gravity vector; and
measure a deviation of a second reference axis of the tracking unit from the determined first reference axis of the user;

an attachment position error absorbing unit configured to correct the detected posture information based on the measured deviation; and
a transmission unit configured to transmit the corrected posture information to an external device.

2. The posture measuring device according to claim 1 ,
wherein the posture measuring device is mountable on a head of the user, and
wherein the tracking unit is further configured to detect a posture of the head.

3. The posture measuring device according to claim 2 ,
wherein the tracking unit is further configured to measure a plurality of gravity vectors that corresponds to a plurality of postures of the head of the user,
wherein the plurality of gravity vectors includes the first gravity vector, and
wherein the attachment position error measuring unit is further configured to measure an error based on the measured plurality of gravity vectors.

4. The posture measuring device according to claim 3 ,
wherein the attachment position error measuring unit is further configured to:
determine a first plurality of reference axes of the user with respect to a second plurality of reference axes x, y, z of the tracking unit,
wherein the second plurality of reference axes includes the second reference axis of the tracking unit;

determine a y w axis of the first plurality of reference axes of the user with respect to the second plurality of reference axes of the tracking unit based on a gravity vector G G of the plurality of gravity vectors,
wherein the gravity vector G G is measured based on the user that faces front in a horizontal direction with respect to the user,
wherein the first reference axis corresponds to the y w axis, and
wherein the first gravity vector corresponds to the gravity vector G G ;

determine a z w axis of the first plurality of reference axes of the user with respect to the second plurality of reference axes of the tracking unit based on one of a gravity vector G F of the plurality of gravity vectors or a gravity vector G SF of the plurality of gravity vectors,
wherein the gravity vector G F is measured based on the user that faces directly above in a vertical direction with respect to the user, and
wherein the gravity vector G SF is measured based on the user that faces obliquely above with respect to the vertical direction;

determine an x w axis of the first plurality of reference axes of the user based on outer product calculation of the y w axis and the z w axis; and
calculate a transformation matrix M based on a relationship between the second plurality of reference axes x, y, and z of the tracking unit and the first plurality of reference axes x w , y w , and z w of the user,

wherein the attachment position error absorbing unit is further configured to correct the detected posture information by multiplication of a rotation matrix M R and the transformation matrix M, and
wherein the rotation matrix M R indicates the detected posture information.

5. The posture measuring device according to claim 4 ,
wherein the attachment position error measuring unit is further configured to:
measure the gravity vector G G based on a reception of a first message for the user to face the front in the horizontal direction with respect to the user; and
measure one of the gravity vector G F based on a reception of a second message for the user to face directly above or the gravity vector G SF based on a reception of a third message for the user to face obliquely above, and

wherein the first message, the second message, and the third message are one of displayed on a display device or a voice output from the display device.

6. The posture measuring device according to claim 1 ,
wherein the posture measuring device is mountable on a head of the user, and
wherein the external device renders an image that follows a motion of the head.

7. A posture measuring method, comprising:
detecting, by a tracking unit, posture information of a user;
measuring, by the tracking unit, a gravity vector based on the detected posture information of the user, wherein the detected posture information indicates that a posture of the user is in a stationary state;
determining, by an attachment position error measuring unit, a first reference axis of the user based on the measured gravity vector;
measuring, by the attachment position error measuring unit, a deviation of a second reference axis of the tracking unit from the determined first reference axis of the user;
correcting, by an attachment position error absorbing unit, the detected posture information based on the measured deviation; and
transmitting, by a transmission unit, the corrected posture information to an external device.

8. An image processing device, comprising:
a reception unit configured to receive posture information of a head of a user from a tracking unit,
wherein the tracking unit is mountable on the head of the user, and
wherein the tracking unit:
detects the posture information; and
measures a first gravity vector based on the detected posture information of the user,
wherein the detected posture information indicates that a posture of the user is in a stationary state;

an attachment position error measuring unit configured to:
determine a first reference axis of the user based on the measured first gravity vector; and
measure a deviation of a second reference axis of the tracking unit from the determined first reference axis of the user;

an attachment position error absorbing unit configured to correct the received posture information based on the measured deviation;
an image drawing processing unit configured to process an image based on the corrected posture information; and
a transmission unit configured to transmit the processed image to a display device.

9. The image processing device according to claim 8 , wherein the image drawing processing unit is further configured to render, based on the posture information, an image that follows a motion of the head of the user.

10. The image processing device according to claim 8 , wherein:
the reception unit is further configured to receive a plurality of gravity vectors from the tracking unit,
wherein the plurality of gravity vectors corresponds to a plurality of postures of the user, and
wherein the plurality of gravity vectors includes the first gravity vector; and

the attachment position error measuring unit is further configured to measure the deviation based on the received plurality of gravity vectors.

11. The image processing device according to claim 10 ,
wherein the attachment position error measuring unit is further configured to:
determine a first plurality of reference axes of the user with respect to a second plurality of reference axes x, y, z of the tracking unit,
wherein the second plurality of reference axes includes the second reference axis of the tracking unit;

determine a y w axis of the first plurality of reference axes of the user with respect to the second plurality of reference axes of the tracking unit based on a gravity vector G

Assignees

• Sony Corp

Inventors

• Hirota Yoichi
• Takahashi Naomasa
• Hayashi Tetsuya

Classifications

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• G01C21/165

  combined with non-inertial navigation instruments · CPC title

• G02B27/017

  Head mounted · CPC title

• G09G3/001

  using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP) · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title