Systems, methods, and media for extracting information and a display image from two captured images

Patent metadata

Field	Value
Publication number	US-10070067-B2
Application number	US-201515302670-A
Country	US
Kind code	B2
Filing date	Apr 15, 2015
Priority date	Apr 15, 2014
Publication date	Sep 4, 2018
Grant date	Sep 4, 2018

Abstract

Systems, methods, and media for extracting information and a display image from two captured images are provided, in some embodiments, systems for extracting information and a display image from two captured images are provided, the systems comprising: a rolling shutter sensor; and a hardware processor coupled to the rolling shutter sensor that is configured to: cause the rolling shutter sensor to capture two captured images; receive the two captured images; and extract the information, and the display image from the two captured images, wherein the information is represented in the captured images as a flicker pattern.

First claim

What is claimed is:

1. A system for extracting a message and a display image from two captured images, comprising:
a rolling shutter sensor; and
a hardware processor coupled to the rolling shutter sensor that is configured to:
cause the rolling shutter sensor to capture two captured images;
receive the two captured images; and
extract the message and the display image from the two captured images, wherein the message is represented in the captured images as a flicker pattern based on modulated brightness of a display source that generates the display image.

2. The system of claim 1 , wherein the hardware processor causes the rolling shutter sensor to capture the two captured images using an exposure bracketing mode.

3. The system of claim 2 , wherein the hardware processor also performs motion compensation on at least one of the two captured images.

4. The system of claim 1 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.

5. The system of claim 1 , wherein the rolling shutter sensor detects phase-shift keying modulated light.

6. The system of claim 1 , wherein the rolling shutter sensor detects binary phase-shift keying modulated light.

7. The system of claim 1 , wherein the rolling shutter sensor detects modulated light in orthogonal frequency division multiplexing signal.

8. The system of claim 1 , wherein the hardware processor detects pilot symbols in the message to synchronize detection of the message with the display source.

9. The system of claim 1 , wherein the hardware processor determines a guard interval to synchronize detection of the message with the display source.

10. A method for extracting a message and a display image from two captured images, comprising:
causing a rolling shutter sensor to capture two captured images using a hardware processor;
receiving the two captured images using the hardware processor; and
extracting the message and the display image from the two captured images using the hardware processor,

wherein the message is represented in the captured images as a flicker pattern based on modulated brightness of a display source that generates the display image.

11. The method of claim 10 , wherein the causing the rolling shutter sensor to capture the two captured images uses an exposure bracketing mode.

12. The method of claim 11 , further comprising performing motion compensation on at least one of the two captured images.

13. The method of claim 10 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.

14. The method of claim 10 , further comprising detecting phase-shift keying modulated light.

15. The method of claim 10 , further comprising detecting binary phase-shift keying modulated light.

16. The method of claim 10 , further comprising detecting modulated light in an orthogonal frequency division multiplexing signal.

17. The method of claim 10 , further comprising detecting pilot symbols in the message to synchronize detection of the message with the display source.

18. The method of claim 10 , further comprising determining a guard interval to synchronize detection of the message with the display source.

19. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for extracting a message and a display image from two captured images, the method comprising:
causing a rolling shutter sensor to capture two captured images;
receiving the two captured images; and
extracting the message and the display image from the two captured images, wherein the message is represented in the captured images as a flicker pattern based on modulated brightness of a display source that generates the display image.

20. The non-transitory computer-readable medium of claim 19 , wherein the causing the rolling shutter sensor to capture the two captured images uses an exposure bracketing mode.

21. The non-transitory computer-readable medium of claim 20 , wherein the method further comprises performing motion compensation on at least one of the two captured images.

22. The non-transitory computer-readable medium of claim 19 , wherein the rolling shutter sensor is a simultaneous dual exposure sensor.

23. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting phase-shift keying modulated light.

24. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting binary phase-shift keying modulated light.

25. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting modulated light in an orthogonal frequency division multiplexing signal.

26. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises detecting pilot symbols in the message to synchronize detection of the message with the display source.

27. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises determining a guard interval to synchronize detection of the message with the display source.

Assignees

• Sony Corp

Inventors

• Jo Kensei
• Gupta Mohit
• Nayar Shree K

Classifications

• H04N25/585

  with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes · CPC title

• H04N23/743

  Bracketing, i.e. taking a series of images with varying exposure conditions · CPC title

• H04N23/745

  Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• H04N23/72 Primary

  Combination of two or more compensation controls · CPC title