Apparatus, method and computer program for image capturing

Patent metadata

Field	Value
Publication number	US-11611726-B2
Application number	US-202117358899-A
Country	US
Kind code	B2
Filing date	Jun 25, 2021
Priority date	Jul 16, 2020
Publication date	Mar 21, 2023
Grant date	Mar 21, 2023

Abstract

Examples of the disclosure relate to apparatus, methods and computer programs for enabling sub-pixel information to be determined in captured images. The apparatus can comprise means for activating at least one filter wherein the at least one filter is positioned in front of at least one image sensor. The at least one filter is configured to at least partially filter light such that the at least one filter has a spatial variation of transparency on an analogue scale across an area covered by the at least one filter. The apparatus also comprises means for detecting an image captured by the at least one image sensor; and using information relating to the spatial variation of transparency of the at least one filter to determine sub-pixel information in the captured image.

First claim

I claim:

1. An apparatus comprising:
at least one processor; and
at least one memory including computer program code;
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:
activate at least one filter wherein the at least one filter is positioned in front of at least one image sensor and the at least one filter is configured to at least partially filter light such that the at least one filter has a spatial variation of transparency on an analogue scale across an area covered by the at least one filter;
detect an image captured by the at least one image sensor; and
use information relating to the spatial variation of transparency of the at least one filter to determine sub-pixel information in the captured image,
wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to: determine an angle of an edge at a sub pixel resolution using the intensity of a pixel of the at least one image sensor and information about the spatial variation of the transparency of the at least one filter in an area overlaying the pixel.

2. An apparatus as claimed in claim 1 wherein the at least one filter comprises electrochromic glass and activating the at least one filter comprises providing a potential difference across the electrochromic glass.

3. An apparatus as claimed in claim 2 wherein a plurality of electrodes are coupled to the electrochromic glass and configured to enable different potential differences to be applied to different areas of the electrochromic glass and the apparatus is configured to activate the at least one filter by enabling different potential differences to be provided to different electrodes at different times.

4. An apparatus as claimed in claim 3 wherein the potential differences applied to the different electrodes are configured to control the spatial variation of transparency of the at least one filter.

5. An apparatus as claimed in claim 1 wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: enable spatial or temporal variation of the transparency of the at least one filter.

6. An apparatus as claimed in claim 1 wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: coordinate the timing of the activating of the at least one filter with a timing of capturing of an image by the image sensor so that the image is captured a predetermined time after the activation of the at least one filter has been initiated.

7. An apparatus as claimed in claim 1 wherein spatial positions of defects in the at least one filter is used to determine sub-pixel information.

8. An apparatus as claimed in claim 1 wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: calibrate the at least one filter by causing the at least one image sensor to capture a first image of a scene without using the at least one filter and a second image of the scene using the at least one filter and comparing the two images to determine information about the spatial variation of transparency of the at least one filter.

9. An apparatus as claimed in claim 1 wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: detect a plurality of images of a scene at different times with the at least one filter in different configurations having different spatial variations of transparency and use the different intensities of pixels of the at least one image sensor at the different times to determine sub pixel information.

10. An apparatus as claimed in claim 1 wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to: control the spatial variation of transparency of the at least one filter in a first direction at a first time while a first image of a scene is captured and to control the spatial variation of transparency of the at least one filter in a second direction at a second time while a second image of the scene is captured and compare intensity values of pixels in the first image with intensity values of pixels in the second image to determine sub-pixel information.

11. An apparatus as claimed in claim 1 wherein the apparatus is an image capturing device.

12. A method comprising:
activating at least one filter wherein the at least one filter is positioned in front of at least one image sensor and the at least one filter is configured to at least partially filter light such that the at least one filter has a spatial variation of transparency on an analogue scale across an area covered by the at least one filter;
detecting an image captured by the at least one image sensor; and
using information relating to the spatial variation of transparency of the at least one filter to determine sub-pixel information in the captured image, the method further comprising:
determining an angle of an edge at a sub pixel resolution using the intensity of a pixel of the at least one image sensor and information about the spatial variation of the transparency of the at least one filter in an area overlaying the pixel.

13. A method as claimed in claim 12 wherein the at least one filter comprises electrochromic glass and activating the at least one filter comprises providing a potential difference across the electrochromic glass.

14. A method as claimed in claim 12 further comprising: enabling spatial or temporal variation of the transparency of the at least one filter.

15. A method as claimed in claim 12 further comprising: using spatial positions of defects in the at least one filter to determine sub-pixel information.

16. A non-transitory computer readable medium comprising program instructions stored thereon for performing at least the following:
activate at least one filter wherein the at least one filter is positioned in front of at least one image sensor and the at least one filter is configured to at least partially filter light such that the at least one filter has a spatial variation of transparency on an analogue scale across an area covered by the at least one filter;
detect an image captured by the at least one image sensor; and
use information relating to the spatial variation of transparency of the at least one filter to determine sub-pixel information in the captured image, the non-transitory computer readable medium comprising program instructions stored thereon for further performing:
determine an angle of an edge at a sub pixel resolution using the intensity of a pixel of the at least one image sensor and information about the spatial variation of the transparency of the at least one filter in an area overlaying the pixel.

17. The non-transitory computer readable medium of claim 16 wherein
the at least one filter comprises electrochromic glass and wherein the instructions are further configured to perform: activating the at least one filter comprising providing a potential difference across the electrochromic glass.

18. The non-transitory computer readable medium of claim 16 wherein
the instructions are further configured to perform: enabling spatial or temporal variation of the transparency of the at least one filter.

19. The non-transitory computer readable medium of claim 16 wherein
the instruction

Assignees

• Nokia Technologies Oy

Inventors

• Wright Christopher

Classifications

• G02F1/15

  based on an electrochromic effect · CPC title

• H04N23/54 Primary

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• H04N23/55 Primary

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• H04N25/11 Primary

  Arrangement of colour filter arrays [CFA]; Filter mosaics · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title