Apparatus and method with virtual content adjustment

Patent metadata

Field	Value
Publication number	US-11869162-B2
Application number	US-202117140777-A
Country	US
Kind code	B2
Filing date	Jan 4, 2021
Priority date	Aug 18, 2020
Publication date	Jan 9, 2024
Grant date	Jan 9, 2024

Abstract

A processor-implemented method includes: adjusting a virtual content object based on a shape of the virtual content object projected onto a projection plane; and visualizing the adjusted virtual content object on the projection plane.

First claim

What is claimed is:

1. A processor-implemented method, comprising:
determining an adjustment of a virtual content object, for projection onto a projection plane, based on a shape to be projected of the virtual content object;
generating an adjusted virtual content object by adjusting the virtual content object based on the determined adjustment; and
visualizing the adjusted virtual content object on the projection plane,
wherein the shape to be projected is dependent on a physical depth represented by a reference element in a virtual space used for the adjusting of the virtual content object, and
wherein the adjusting of the virtual content object is performed based on information regarding the reference element, within the virtual space, separated from positions of the adjusted virtual content object as represented in the virtual space.

2. The method of claim 1 , wherein the adjusting of the virtual contact object comprises:
setting one of points in the virtual space corresponding to the virtual content object as a reference point; and
changing the virtual content object based on the set reference point.

3. The method of claim 2 , wherein the changing of the virtual content object includes changing of a current shape of the virtual content object by extending the current shape of the virtual content object along a direction axis oriented from a user toward the reference point.

4. The method of claim 2 , wherein the changing of the virtual content object includes changing a current shape of the virtual content object, comprising:
setting a reference axis, perpendicular to a direction axis oriented from a user toward the reference point, including the reference point; and
rotating the virtual content object based on the reference axis.

5. The method of claim 2 , wherein the setting of the one of the points as the reference point comprises determining one of the points at which a direction axis parallel to a reference plane, in the virtual space, and oriented from a user toward the virtual content object passes through the virtual content object as the reference point.

6. The method of claim 2 , wherein the setting of the one of the points as the reference point comprises selecting the one of the points based on a distance between a viewpoint of a user and physical positions of the points.

7. The method of claim 6 , wherein the selecting of the one of the points comprises determining a point closest to the viewpoint of the user among the points as the reference point.

8. The method of claim 1 , wherein the adjusting of the virtual content object comprises changing a height-to-width (h/w) ratio of the virtual content object based on a height-to-width (h/w) ratio of the shape of the virtual content object projected onto the projection plane.

9. The method of claim 1 , wherein the visualizing of the adjusted virtual content object comprises disposing a lower end portion of the virtual content object on a reference plane and visualizing the virtual content object with the lower end portion disposed on the reference plane.

10. The method of claim 9 , wherein the reference plane corresponds to a bottom surface of the virtual space in which the virtual content object is visualized.

11. The method of claim 1 , wherein the adjusting of the virtual content object comprises:
setting a first reference point and a first reference axis in a first graphic object corresponding to a left image;
adjusting the first graphic object based on the first reference point and the first reference axis;
setting a second reference point and a second reference axis in a second graphic object corresponding to a right image; and
adjusting the second graphic object based on the second reference point and the second reference axis.

12. The method of claim 11 , wherein the visualizing of the adjusted virtual content object comprises providing the adjusted first reference point to a left eye of a user and providing the adjusted second reference point to a right eye of the user.

13. The method of claim 11 , wherein the visualizing of the adjusted virtual content object comprises differently visualizing the adjusted first graphic object and the adjusted second graphic object on the projection plane based on a binocular disparity.

14. The method of claim 1 , wherein the adjusting of the virtual content object comprises changing the shape of the virtual content object in response to a movement of a viewpoint of a user being detected.

15. The method of claim 1 , wherein the adjusting of the virtual content object comprises:
reducing a length of the virtual content object along a direction axis parallel to a reference plane and oriented from a user toward a reference point, in response to a distance between a viewpoint of the user and a physical position of the virtual content object decreasing; or
increasing the length of the virtual content object along the direction axis parallel to the reference plane and oriented from the user toward the reference point, in response to the distance between the viewpoint of the user and the physical position of the virtual content object increasing.

16. The method of claim 1 , wherein the adjusting of the virtual content object comprises:
reducing an angle between a reference plane and a bottom surface of the virtual content object based on a reference axis, in response to a distance between a viewpoint of a user and a physical position of the virtual content object decreasing; or
increasing the angle between the reference plane and the bottom surface of the virtual content object based on the reference axis, in response to the distance between the viewpoint of the user and the physical position of the virtual content object increasing.

17. The method of claim 1 , wherein the visualizing of the adjusted virtual content object comprises overlaying the adjusted virtual content object over a physical environment outside of the apparatus by visualizing the adjusted virtual content object using a display of an augmented reality (AR) glasses apparatus.

18. The method of claim 1 , wherein the visualizing of the adjusted virtual content object comprises visualizing the adjusted virtual content object, using a head-up display (HUD) of a vehicle.

19. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1 .

20. The method of claim 1 , further comprising:
projecting the adjusted virtual content object on the projection plane.

21. A processor-implemented method, comprising:
determining an adjustment of a virtual content object, for projection onto a projection plane, based on a shape to be projected of the virtual content object;
adjusting the virtual content object based on the determined adjustment; and
visualizing the adjusted virtual content object on the projection plane,
wherein the adjusting of the virtual contact object comprises:
setting one of points belonging to a space corresponding to the virtual content object as a reference point; and
changing the virtual content object based on the set reference point, and

wherein the setting of the one of the points as the reference point comprises selecting the one of the points based on a distance between a viewpoint of a user and physical positions of the points.

22. The method of claim 21 , wherein the selecting of the one of the points comprises determining a point closest to the viewpoint of the user amon

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Heesae
• Chang Hyun Sung

Classifications

• B60K35/211

  producing three-dimensional [3D] effects, e.g. stereoscopic images · CPC title

• B60K35/29

  Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions · CPC title

• B60K35/23

  Head-up displays [HUD] (optical aspects of head-up displays G02B27/01) · CPC title

• B60K2360/149

  Instrument input by detecting viewing direction not otherwise provided for · CPC title

• B60K35/10 Primary

  Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor · CPC title