Method and apparatus with crosstalk correction

Patent metadata

Field	Value
Publication number	US-11719930-B2
Application number	US-202117225339-A
Country	US
Kind code	B2
Filing date	Apr 8, 2021
Priority date	Sep 7, 2020
Publication date	Aug 8, 2023
Grant date	Aug 8, 2023

Abstract

A processor-implemented method with crosstalk correction includes: determining a region in which a crosstalk is to occur based on a three-dimensional (3D) position relationship between a position of eyes of a user and a position of a virtual image of a virtual content object; generating a concealer image for correcting the region in which the crosstalk is to occur based on the determined region and the virtual content object; and correcting the crosstalk by combining the virtual content object and the generated concealer image.

First claim

What is claimed is:

1. A processor-implemented method with crosstalk correction, comprising:
determining a region in which a crosstalk is to occur based on a three-dimensional (3D) position relationship between a position of eyes of a user and a position of a virtual image of a virtual content object;
generating a concealer image for correcting the region in which the crosstalk is to occur based on the determined region and the virtual content object; and
correcting the crosstalk by combining the virtual content object and the generated concealer image.

2. The method of claim 1 , wherein the generating of the concealer image comprises:
adjusting one or more effect elements including any one or any combination of an afterimage range, a contrast, and a brightness of the concealer image.

3. The method of claim 2 , wherein the afterimage range of the concealer image corresponds to a width of the concealer image.

4. The method of claim 2 , wherein the adjusting of the one or more effect elements comprises any one or more of:
adjusting the afterimage range of the concealer image, corresponding to a size of the virtual image of the virtual content object, based on the 3D position relationship;
adjusting either one or both of the contrast and the brightness of the concealer image based on the 3D position relationship; and
adjusting the brightness of the concealer image based on an illumination of a surrounding environment.

5. The method of claim 4 , wherein the adjusting of the afterimage range of the concealer image comprises:
gradually expanding the afterimage range of the concealer image corresponding to the size of the virtual image of the virtual content object, as a distance between the position of the eyes of the user and the position of the virtual image increases while greater than a reference distance; and
gradually reducing the afterimage range of the concealer image corresponding to the size of the virtual image of the virtual content object, as the distance between the position of the eyes of the user and the position of the virtual image decreases while greater than the reference distance.

6. The method of claim 4 , wherein the adjusting of either one or both of the contrast and the brightness of the concealer image comprises:
gradually adjusting either one or both of the contrast and the brightness of the concealer image to be darker, as a distance between the position of the eyes of the user and the position of the virtual image increases while greater than a reference distance; and
gradually adjusting either one or both of the contrast and the brightness of the concealer image to be brighter, as the distance between the position of the eyes of the user and the position of the virtual image decreases while greater than the reference distance.

7. The method of claim 4 , wherein the adjusting of the brightness of the concealer image comprises:
gradually adjusting the brightness of the concealer image to be darker, as the illumination increases while greater than reference illumination; and
gradually adjusting the brightness of the concealer image to be brighter, as the illumination decreases while greater than the reference illumination.

8. The method of claim 1 , wherein the generating of the concealer image comprises:
generating the concealer image by blurring the virtual content object according to a shape of the virtual content object.

9. The method of claim 1 , wherein the generating of the concealer image comprises:
generating a blurred image by blurring the virtual content object; and
generating the concealer image by adjusting one or more effect elements including any one or any combination of an afterimage range, a contrast, and a brightness corresponding to the blurred image.

10. The method of claim 9 , wherein the generating of the blurred image comprises:
generating the blurred image according to a shape expanded from the virtual content object based on the 3D position relationship.

11. The method of claim 9 , wherein the generating of the blurred image comprises:
generating a first blurred image corresponding to a left eye of the eyes of the user and a second blurred image corresponding to a right eye of the eyes of the user, based on a shape of the virtual content object; and
generating the blurred image by combining the first blurred image and the second blurred image.

12. The method of claim 11 , wherein the generating of the blurred image by combining the first blurred image and the second blurred image comprises:
separating the first blurred image and the second blurred image from each other by a distance that is based on a disparity of the eyes of the user; and
combining the first blurred image and the second blurred image while maintaining the distance.

13. The method of claim 12 , wherein the combining of the first blurred image and the second blurred image while maintaining the distance comprises:
generating the blurred image by interpolating the first blurred image and the second blurred image that are separated from each other.

14. The method of claim 1 , wherein the correcting of the crosstalk comprises:
arranging the concealer image in a 3D space including the virtual content object;
generating a left image and a right image by rendering the virtual content object combined with the concealer image; and
projecting the left image and the right image.

15. The method of claim 1 , wherein the correcting of the crosstalk comprises:
generating a left image and a right image by rendering the virtual content object; and
projecting the left image, the right image, and the concealer image.

16. The method of claim 1 , wherein the determining of the region in which the crosstalk is to occur comprises:
determining the region in which the crosstalk is to occur based on a disparity between the eyes of the user and the 3D position relationship.

17. The method of claim 1 , wherein the determining of the region in which the crosstalk is to occur comprises:
determining the region in which the crosstalk is to occur by adjusting an afterimage range of the region in which the crosstalk is to occur based on a disparity between the eyes of the user and the 3D position relationship.

18. The method of claim 1 , further comprising:
detecting a movement of the position of the virtual content object,
wherein the determining of the region in which the crosstalk is to occur comprises:
determining the region in which the crosstalk is to occur based on either one or both of the 3D position relationship and a disparity between the eyes of the user that is changed based on the detected movement of the position.

19. The method of claim 1 , wherein the region in which the crosstalk is to occur corresponds to a position and a range at and in which the concealer image is to be arranged.

20. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, configure the processor to perform the method of claim 1 .

21. An apparatus with crosstalk correction, comprising:
a sensor configured to sense a position of eyes of a user; and
a processor configured to
determine a region in which a crosstalk is to occur based on a three-dimensional (3D) position relationship between the position of the eyes of the user and a position of a virtual image of a virtual content object,
generate a concealer image for correcting the region in which the crosstalk is to occur based on the determined region and the virtual conten

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Heesae
• Lee Junhwan
• Ha Inwoo

Classifications

• B60K35/234

  controlling the brightness, colour or contrast of virtual images depending on the driving conditions or on the condition of the vehicle or the driver · CPC title

• B60K35/10

  Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor · CPC title

• B60K2360/149

  Instrument input by detecting viewing direction not otherwise provided for · CPC title

• B60K35/28

  characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver · CPC title

• B60K2360/177

  Augmented reality · CPC title