Display detection for augmented reality

Patent metadata

Field	Value
Publication number	US-2016255264-A1
Application number	US-201414421101-A
Country	US
Kind code	A1
Filing date	May 2, 2014
Priority date	May 2, 2014
Publication date	Sep 1, 2016
Grant date	—

Abstract

Technologies are generally described for systems, devices and methods effective to detect a presence of a display. In some examples, a processor may receive image data from a camera. The image data may relate to light incident on the camera. The processor may analyze the image data to determine that the light includes flickering at a frequency. The processor may detect the presence of the display based on the frequency of the flickering.

First claim

What is claimed is:

1 . A method to detect a presence of display, the method comprising by a processor:
receiving image data from a camera, wherein the image data relates to light incident on the camera; analyzing the image data to determine that the light includes flickering at a frequency; and detecting the presence of the display based on the determined flickering and frequency of the flickering.

2 . The method of claim 1 , wherein analyzing the image data to determine that the light includes flickering further comprises, by the processor:
determining an intensity of the light; and determining that the intensity changes in value at the frequency.

3 . The method of claim 1 , wherein detecting the presence of the display includes a determination that the frequency of the flickering is at least one of about 24 Hz, about 25 Hz, about 30 Hz, about 50 Hz, or about 60 Hz.

4 . The method of claim 1 , wherein the analyzing the image data includes analyzing waveform characteristics of the flickering and the detecting is further based on the analyzed waveform characteristics, the method further comprising:
determining a type of the detected display based on the analyzed waveform characteristics.

5 . The method of claim 1 , wherein the analyzing the image data to determine that the light includes flickering further comprises, by the processor:
determining a chromaticity of the light; determining that the chromaticity changes in value at the frequency; determining that the detected display is chromatically flickering; and determining the detected display includes a plasma television or a DLP light projector.

6 . The method of claim 1 , further comprising:
varying a capture frequency of the camera so that a first portion of the image data is captured at a first capture frequency, the first capture frequency being higher than a second capture frequency at which the second portion of the image data is captured; and determining the frequency of the flickering based on an analysis of the first and second portions of the image data and the first and second capture frequencies.

7 . The method of claim 1 , further comprising determining a location of the display by:
identifying first data in the image data which corresponds to the flickering at the frequency; identifying second data in the image data which does not correspond to the flickering at the frequency; and determining the location of the display based on the identified first and second data.

8 . The method of claim 7 , further comprising determining the location by extrapolating the first data based on a rectangular shape.

9 . The method of claim 1 , further comprising:
determining that a contiguous area of the image data which flickers at the frequency is a convex quadrilateral.

10 . The method of claim 1 , further comprising determining a first location of the display at a first time by:
identifying first data in the image data which corresponds to the flickering at the frequency; identifying second data in the image data which does not correspond to the flickering at the frequency; and determining the first location of the display at the first time based on the identified first and second data; and determining a second location of the display at a second time by:
receiving spatial data from an accelerometer and/or a gyroscope; and
analyzing the spatial data and the first location.

11 . The method of claim 1 , further comprising, by the processor:
generating and displaying an augmented reality image on an augmented reality device so that the augmented reality image overlays at least part of the detected display as viewed through the augmented reality device.

12 . The method of claim 11 , further comprising, by the processor:
identifying content output from the display; and generating and displaying an augmented reality image based at least in part on the identified content so that the augmented reality image overlays at least part of the detected display.

13 . The method of claim 1 , wherein the camera has a frame rate of at least 25 frames per second and a shutter speed of less than 1/60 second.

14 . A device effective to detect a display, the device comprising:
a memory that includes instructions; a camera effective to receive light incident on the camera and produce image data in response to the light; a processor configured to be in communication with the memory and the camera, the processor configured to:
receive the image data from the camera;
analyze the image data to determine that the light includes flickering at a frequency; and
detect the presence of the display based on the determined flickering and frequency of the flickering.

15 . The device of claim 14 , wherein the processor is effective to determine that the image data includes flickering based on a determination that an intensity of the light changes in value at the frequency.

16 . The device of claim 14 , wherein the detection of the presence of the display is based on a determination that the frequency of the flickering is at least one of about 24 Hz, about 25 Hz, about 30 Hz, about 50 Hz, or about 60 Hz.

17 . The device of claim 15 , wherein the processor is further configured to:
identify first data in the image data which corresponds to the flickering at the frequency; identify second data in the image data which does not correspond to the flickering at the frequency; and determine a location of the display based on the identified first and second data.

18 . The device of claim 17 , wherein the processor is effective to determine the location of the display based on an extrapolation of the first data and based on a rectangular shape.

19 . The device of claim 14 , wherein the processor is further effective to:
identify first data in the image data which corresponds to the flickering at the frequency; identify second data in the image data which does not correspond to the flickering at the frequency; and determine a first location of the display at a first time based on the identified first and second data; receive spatial data from an accelerometer and/or a gyroscope; and determine a second location of the display at a second time based on the spatial data and the first location.

20 . The device of claim 14 , where the processor is further configured to:
generate and display an augmented reality image on an augmented reality device so that the augmented reality image overlays at least part of the detected display as viewed through the augmented reality device.

21 . The device of claim 20 , wherein the processor is further configured to:
identify content output from the display; and generate and display an augmented reality image based at least in part on the identified content so that the augmented reality image overlays at least part of the detected display.

22 . The device of claim 14 , wherein the camera has a frame rate of at least 25 frames per second and a shutter speed of less than 1/60 second.

23 . A method to detect two displays, the method comprising, by a processor:
receiving image data from a camera, wherein the image data relates to light incident on the camera; analyzing the image data to determine that the light includes flickering; determining a first frequency of flickering in the image data; determining a second frequency of flickering in the image data, wherein the second frequency of flickering is

Assignees

• Empire Technology Dev Llc

Inventors

• Russell Jake Armstrong

Classifications

• G06F3/147 Primary

  using display panels · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N23/745 Primary

  Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• H04N9/3179

  Video signal processing therefor · CPC title