Systems, methods, and media for extracting information and a display image from two captured images

Patent metadata

Field	Value
Publication number	US-2017034412-A1
Application number	US-201515302670-A
Country	US
Kind code	A1
Filing date	Apr 15, 2015
Priority date	Apr 15, 2014
Publication date	Feb 2, 2017
Grant date	—

Abstract

Systems, methods, and media for extracting information and a display image from two captured images are provided, in some embodiments, systems for extracting information and a display image from two captured images are provided, the systems comprising: a rolling shutter sensor; and a hardware processor coupled to the rolling shutter sensor that is configured to: cause the roiling shutter sensor to capture two captured images; receive the two captured images; and extract the information, and the display image from the two captured images, wherein the information is represented in the captured images as a flicker pattern.

First claim

What is claimed is.:

1 . A system for extracting information and a display image from two captured images, comprising:
a roiling shutter sensor; and a hardware processor coupled to the rolling shutter sensor that is configured to:
cause the rolling shutter sensor to capture two captured images;
receive the two captured images; and
extract the information and the display image from the two captured images,
wherein the information is represented in the captured images as a flicker pattern.

2 . The system of claim 1 , wherein the hardware processor causes the rolling shutter sensor to capture the two captured images using an exposure bracketing mode.

3 . The system of claim 2 , wherein the hardware processor also performs motion compensation on at least one of the two captured images.

4 . The system of claim 1 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.

5 . The system of claim 1 , wherein the rolling shutter camera detects phase-shift keying modulated light.

6 . The system of claim 1 , wherein the rolling shutter camera detects binary phase-shift keying modulated light.

7 . The system of claim 1 , wherein the rolling shutter sensor detects modulated light in orthogonal frequency division multiplexing signal.

8 . The system of claim 1 , wherein the hardware processor detects pilot symbols in the information to synchronize detection of the information with a display source.

9 . The system of claim 1 , wherein the hardware processor determines a guard interval to synchronize detection of the information with a display source.

10 . A method for extracting information and a display image from two captured images, comprising:
causing a rolling shutter sensor to capture two captured images using a hardware processor; receiving the two captured images using the hardware processor; and extracting the information and the display image from the two captured images using t hardware processor,
wherein the information is represented in the captured images as a flicker pattern.

11 . The method of claim 10 , wherein the causing the roiling shutter sensor to capture the two captured images uses an exposure bracketing mode.

12 . The method of claim 11 , further comprising performing motion compensation on at least one at he two captured images.

13 . The method of claim 10 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.

14 . The method of claim 10 , further comprising detecting phase-shift keying modulated light.

15 . The method of claim 10 , further comprising detecting binary phase-shift keying modulated light.

16 . The method of claim 10 , further comprising detecting modulated light in an orthogonal frequency division multiplexing signal.

17 . The method of claim 10 , further comprising detecting pilot symbols ill the information to synchronize detection of the information with a display source.

18 . The method of claim 10 , further comprising determining a guard interval to synchronize detection of the information with a display source.

19 . A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for extracting information and a display image from two captured images, the method comprising:
causing a rolling shutter sensor to capture two captured images; receiving the two captured images; and extracting the information and the display image from the two captured images,
wherein the information is represented in the captured images as a flicker pattern.

20 . The non-transitory computer-readable medium of claim 19 , wherein the causing the rolling shutter sensor to capture the two captured images uses an exposure bracketing mode.

21 . The non-transitory computer-readable medium of claim 20 , wherein the method further comprises performing motion compensation on at least one of the two captured images.

22 . The non-transitory computer-readable medium of claim 19 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.

23 . The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting phase-shift keying modulated light.

24 . The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting binary phase-shift keying modulated light.

25 . The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting modulated light in an orthogonal frequency division multiplexing signal.

26 . The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting pilot symbols in the information to synchronize detection of the information with a display source.

27 . The non-transitory computer-readable medium of claim 19 , wherein the method further comprises determining a guard interval to synchronize detection of the information with a display source.

Assignees

• Sony Corp
• Univ Columbia

Inventors

• Kensei Jo
• Mohit Gupta
• Shree Nayar K

Classifications

• H04N23/745

  Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination · CPC title

• H04N23/743

  Bracketing, i.e. taking a series of images with varying exposure conditions · CPC title

• H04N25/585

  with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• H04N25/589

  with different integration times, e.g. short and long exposures · CPC title