User perceived forward determination based on detected head center

Patent metadata

Field	Value
Publication number	US-2025111631-A1
Application number	US-202418794365-A
Country	US
Kind code	A1
Filing date	Aug 5, 2024
Priority date	Sep 28, 2023
Publication date	Apr 3, 2025
Grant date	—

Abstract

Various implementations disclosed herein include devices, systems, and methods that present a view with content at a 3D position within a 3D environment based on determining a difference between a user-specific forward direction and a head-mounted device (HMD)-forward direction. For example, a process may present a view of a content item at a position and an orientation within a three-dimensional (3D) environment. The process may further obtain a first change to the orientation of the content item within the 3D environment and a second change to the position of the content item with the 3D environment. The process may further determine a characteristic of a user-specific forward direction based on the first change and the second change and present additional content within one or more 3D environments based on the characteristic of the user-specific forward direction.

First claim

What is claimed is:

1 . A method comprising:
at a head-mounted device (HMD) having a processor:
presenting a view of a content item at a position and an orientation within a three-dimensional (3D) environment;
obtaining a first change to the orientation of the content item within the 3D environment;
obtaining a second change to the position of the content item with the 3D environment;
determining a characteristic of a user-specific forward direction based on the first change and the second change to the content item; and
presenting additional content within one or more 3D environments based on the characteristic of the user-specific forward direction.

2 . The method of claim 1 , wherein said presenting the view of the content item at the position and the orientation comprises:
determining an eye center based on sensor data from one or more sensors of the HMD, wherein the eye center is a center position between eyes of a user wearing the HMD; determining an eye-forward direction based on the eye center; and determining the position and the orientation, of the content item within the 3D environment, based on the eye-forward direction.

3 . The method of claim 1 , wherein said presenting the view of the content item at the position and the orientation comprises:
determining a device-forward direction based on a position of the HMD; and determining the position and the orientation, of the content item within the 3D environment, based on the device-forward direction.

4 . The method of claim 1 , wherein said determining the characteristic of the user-specific forward direction comprises determining a difference between a device-based forward direction and the user-specific forward direction.

5 . The method of claim 1 , wherein said determining the characteristic of the user-specific forward direction comprises determining a difference between an eye-based forward direction and the user-specific forward direction.

6 . The method of claim 1 , wherein the first change is obtained before the second change.

7 . The method of claim 1 , wherein said obtaining the first change to the orientation comprises:
presenting an instruction for a user to rotate the content item until the content item appears to the user to be facing the user.

8 . The method of claim 1 , further comprising:
based on the first change to the orientation, rotating an original vector used to determine the orientation of the content item; and reorienting the content item in the view based on the rotated original vector.

9 . The method of claim 1 , wherein said obtaining the second change to the position comprises:
presenting an instruction for a user to shift the content item left or right until the content item appears to the user to be centered in front of the user.

10 . The method of claim 1 , further comprising:
based on the second change to the position of the content item, shifting the content item left or right.

11 . The method of claim 1 , wherein the content item is a two-dimensional (2D) window.

12 . A head mounted device (HMD) comprising:
a non-transitory computer-readable storage medium; and one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising: presenting a view of a content item at a position and an orientation within a three-dimensional (3D) environment; obtaining a first change to the orientation of the content item within the 3D environment; obtaining a second change to the position of the content item with the 3D environment; determining a characteristic of a user-specific forward direction based on the first change to the orientation and the second change to the position of the content item; and presenting additional content within one or more 3D environments based on the characteristic of the user-specific forward direction.

13 . The HMD of claim 12 , wherein said presenting the view of the content item at the position and the orientation comprises:
determining an eye center based on sensor data from one or more sensors of the HMD, wherein the eye center is a center position between eyes of a user wearing the HMD; determining an eye-forward direction based on the eye center; and determining the position and the orientation, of the content item within the 3D environment, based on the eye-forward direction.

14 . The HMD of claim 12 , wherein said presenting the view of the content item at the position and the orientation comprises:
determining a device-forward direction based on a position of the HMD; and determining the position and the orientation, of the content item within the 3D environment, based on the device-forward direction.

15 . The HMD of claim 12 , wherein said determining the characteristic of the user-specific forward direction comprises determining a difference between a device-based forward direction and the user-specific forward direction.

16 . The HMD of claim 12 , wherein said determining the characteristic of the user-specific forward direction comprises determining a difference between an eye-based forward direction and the user-specific forward direction.

17 . The HMD of claim 12 , wherein the first change is obtained before the second change.

18 . The HMD of claim 12 , wherein said obtaining the first change to the orientation comprises:
presenting an instruction for a user to rotate the content item until the content item appears to the user to be facing the user.

19 . The HMD of claim 12 , further comprising:
based on the first change to the orientation, rotating an original vector used to determine the orientation of the content item; and reorienting the content item in the view based on the rotated original vector.

20 . A non-transitory computer-readable storage medium storing program instructions executable via one or more processors, of a head mounted device (HMD), to perform operations comprising:
presenting a view of a content item at a position and an orientation within a three-dimensional (3D) environment; obtaining a first change to the orientation of the content item within the 3D environment; obtaining a second change to the position of the content item with the 3D environment; determining a characteristic of a user-specific forward direction based on the first change to the orientation and the second change to the position of the content item; and presenting additional content within one or more 3D environments based on the characteristic of the user-specific forward direction.

Assignees

• Apple Inc

Inventors

• Kim Nahckjoon

Classifications

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• G06T2219/2016

  Rotation, translation, scaling · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title