Distortion meshes against chromatic aberrations

Patent metadata

Field	Value
Publication number	US-11748857-B2
Application number	US-202217881046-A
Country	US
Kind code	B2
Filing date	Aug 4, 2022
Priority date	Jun 26, 2014
Publication date	Sep 5, 2023
Grant date	Sep 5, 2023

Abstract

Described herein is a technique in which a plurality of distortion meshes compensate for radial and chromatic aberrations created by optical lenses. The plurality of distortion meshes may include different lens specific parameters that allow the distortion meshes to compensate for chromatic aberrations created within received images. The plurality of distortion meshes may correspond to a red color channel, green color channel, or blue color channel to compensate for the chromatic aberrations. The distortion meshes may also include shaped distortions and grids to compensate for radial distortions, such as pin cushion distortions. In one example, the system uses a barrel-shaped distortion and a triangulation grid to compensate for the distortions created when the received image is displayed on a lens.

First claim

What is claimed is:

1. An apparatus comprising:
an electronic display device;
a lens, the electronic display device to present an image to be viewed via the lens; and
a processor including one or more circuits configured to:
apply, for a frame, a first distortion mesh to a computer generated image generated for display via the electronic display device, the first distortion mesh to compensate for distortion to be caused by the lens when the computer generated image is viewed via the lens, wherein the first distortion mesh is to perform radial aberration compensation; and
apply, for the frame, a second distortion mesh to multiple layers of the computer generated image, the second distortion mesh to compensate for distortion to be caused by the lens when the computer generated image is viewed via the lens, wherein the second distortion mesh is to perform chromatic aberration compensation;
composition circuitry to generate a composite corrected image from the multiple layers of the computer generated image, the composite corrected image blended from the multiple layers of the computer generated image; and
output circuitry to present the composite corrected image to the electronic display device.

2. The apparatus as in claim 1 , additionally comprising multiple wide-angle lenses.

3. The apparatus as in claim 1 , additionally comprising one or more cameras.

4. The apparatus as in claim 1 , wherein the processor is to apply barrel distortion to the computer generated image to compensate for distortion caused by the lens.

5. The apparatus as in claim 4 , wherein the processor is to pre-warp multiple color channels of the multiple layers of the computer generated image via the second distortion mesh to compensate for chromatic aberration caused by the lens before the computer generated image is presented via the electronic display device.

6. The apparatus as in claim 4 , wherein the processor is to separately distort multiple different color channels while compensating for the chromatic aberration via multiple second distortion meshes.

7. The apparatus as in claim 6 , wherein the multiple different color channels include a red, green, and blue color channel.

8. One or more non-transitory machine readable media storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
compositing multiple layers of a view for display via an electronic device of a head mounted display, the compositing including separately pre-processing each of the multiple layers of the view, wherein separately pre-processing the multiple layers of the view includes performing distortion and chromatic aberration correction on each of the multiple layers of the view;
blending each of the separately pre-processed layers; and
presenting output of the blending to the head mounted display, wherein performing distortion and chromatic aberration correction on each of the multiple layers of the view includes:
applying, for a frame, a first distortion mesh to a computer generated image generated for display by the electronic device of the head mounted display, the first distortion mesh to compensate for distortion to be caused by a lens when the computer generated image is viewed on the electronic display device via the lens, wherein the first distortion mesh is to perform radial aberration compensation; and
applying, for the frame, a second distortion mesh to multiple layers of the computer generated image, the second distortion mesh to compensate for distortion caused by the lens when the computer generated image is viewed via the lens, wherein the second distortion mesh is to perform chromatic aberration compensation.

9. The one or more non-transitory machine readable media as in claim 8 , the operations additionally including automatically generating the first distortion mesh and/or the second distortion mesh for use in performing distortion correction.

10. The one or more non-transitory machine readable media as in claim 9 , wherein performing distortion correction on each of the multiple layers of the view includes applying barrel distortion to the computer generated image via the first distortion mesh.

11. The one or more non-transitory machine readable media as in claim 9 , the operations additionally including performing chromatic aberration correction on the multiple layers of the computer generated image via the second distortion mesh.

12. The one or more non-transitory machine readable media as in claim 9 , the operations additionally including pre-warping multiple color channels of the multiple layers of the computer generated image via multiple second distortion meshes to compensate for chromatic aberration caused by the lens before the computer generated image is presented via the electronic display device.

13. The one or more non-transitory machine readable media as in claim 12 , wherein performing chromatic aberration correction includes separately distorting multiple color channels of the computer generated image.

14. The one or more non-transitory machine readable media as in claim 13 , the operations additionally comprising associating each of multiple different color channels of the computer generated image with a separate distortion mesh.

15. The one or more non-transitory machine readable media as in claim 14 , wherein the multiple color channels include red, green, and blue color channels.

16. A method comprising:
compositing multiple layers of a view for display via an electronic device of a head mounted display, the compositing including separately pre-processing each of the multiple layers of the view, wherein separately pre-processing the multiple layers of the view includes performing distortion and chromatic aberration correction on each of the multiple layers of the view;
blending each of the separately pre-processed layers; and
presenting output of the blending to the head mounted display, wherein performing distortion and chromatic aberration correction on each of the multiple layers of the view includes:
applying, for a frame, a first distortion mesh to a computer generated image generated for display by the electronic device of the head mounted display, the first distortion mesh to compensate for distortion to be caused by a lens when the computer generated image is viewed on the electronic display device via the lens, wherein the first distortion mesh is to perform radial aberration compensation; and
applying, for the frame, a second distortion mesh to multiple layers of the computer generated image, the second distortion mesh to compensate for distortion caused by the lens when the computer generated image is viewed via the lens, wherein the second distortion mesh is to perform chromatic aberration compensation.

17. The method as in claim 16 , additionally including automatically generating the first distortion mesh and/or the second distortion mesh for use in performing distortion correction.

18. The method as in claim 17 , wherein performing distortion correction on each of the multiple layers of the view includes applying barrel distortion to each of the multiple layers of the view via the first distortion mesh.

19. The method as in claim 17 , additionally including performing chromatic aberration correction on the multiple layers of the view via a second distortion mesh.

20. The method as in claim 17 , additionally including performing chromatic aberration correction on the multiple layers of the computer generated image via the second dist

Assignees

• Intel Corp

Inventors

• Pohl Daniel

Classifications

• G06T5/80 Primary

  Geometric correction · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2207/20221

  Image fusion; Image merging · CPC title