Information processing apparatus, information processing method, and program

Patent metadata

Field	Value
Publication number	US-12169906-B2
Application number	US-202218568110-A
Country	US
Kind code	B2
Filing date	Jan 28, 2022
Priority date	Jun 29, 2021
Publication date	Dec 17, 2024
Grant date	Dec 17, 2024

Abstract

An information processing apparatus includes a position processing unit, a correction unit, and a display control unit. The position processing unit estimates a head position of a user and estimates a position of a predetermined part of a body of the user based on the estimated head position. The correction unit corrects the position of the predetermined part estimated by the position processing unit based on the head position and an angle of inclination of a head of the user. The display control unit executes processing of displaying an image operated by the user to be overlapped with a space visually recognized by the user based on the position corrected by the correction unit.

First claim

The invention claimed is:

1. An information processing apparatus comprising:
a position processing unit that estimates a head position of a user and estimates a position of a predetermined part of a body of the user based on the estimated head position;
a correction unit that corrects the position of the predetermined part estimated by the position processing unit based on the head position and an angle of inclination of a head of the user; and
a display control unit that executes processing of displaying an image operated by the user to be overlapped with a space visually recognized by the user based on the position corrected by the correction unit.

2. The information processing apparatus according to claim 1 ,
wherein the correction unit corrects the position of the predetermined part in a vertical direction based on a reference height.

3. The information processing apparatus according to claim 1 ,
wherein the correction unit corrects the position of the predetermined part in a front-back direction of the user in a case where the angle of the inclination of the head from a horizontal state is out of a predetermined range.

4. The information processing apparatus according to claim 3 ,
wherein the correction unit corrects the position of the predetermined part in a backward direction of the user in a case where the head is inclined downward from the horizontal state.

5. The information processing apparatus according to claim 3 ,
wherein the correction unit corrects the position of the predetermined part in a forward direction of the user in a case where the head is inclined upward from the horizontal state.

6. The information processing apparatus according to claim 1 , further comprising:
a display processing unit that changes a display mode of the image when the image is operated by the user.

7. The information processing apparatus according to claim 6 ,
wherein the display processing unit changes the display mode of the image according to an elapsed time from a start of an operation on the image by the user.

8. The information processing apparatus according to claim 6 ,
wherein the position processing unit estimates a position of a hand of the user,
the display control unit displays the image of the hand of the user to be overlapped with a space visually recognized by the user based on the position estimated by the position processing unit, and
the display processing unit changes the display mode of the image of the hand according to overlapping with the image operated by the user.

9. An information processing method comprising:
a position processing step of estimating a head position of a user and estimating a position of a predetermined part of a body of the user based on the estimated head position;
a correction step of correcting the position of the predetermined part estimated in the position processing step based on the head position and an angle of inclination of a head of the user; and
a display control step of executing processing of displaying an image operated by the user to be overlapped with a space visually recognized by the user based on the position corrected in the correction step.

10. A program causing a computer to execute:
a position processing step of estimating a head position of a user and estimating a position of a predetermined part of a body of the user based on the estimated head position;
a correction step of correcting the position of the predetermined part estimated in the position processing step based on the head position and an angle of inclination of a head of the user; and
a display control step of executing processing of displaying an image operated by the user to be overlapped with a space visually recognized by the user based on the position corrected in the correction step.

Assignees

• Sony Group Corp

Inventors

• Ichikawa Miwa
• Tajima Daisuke
• Ishikawa Tsuyoshi
• Nagano Keijiroh
• Shiroma Shin

Classifications

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G01B11/27

  for testing the alignment of axes {(means for centering or aligning a light guide within a ferrule G02B6/3834)} · CPC title