Identifying an object in a field of view

Patent metadata

Field	Value
Publication number	US-10229339-B2
Application number	US-201715457943-A
Country	US
Kind code	B2
Filing date	Mar 13, 2017
Priority date	Mar 15, 2013
Publication date	Mar 12, 2019
Grant date	Mar 12, 2019

Abstract

The technology disclosed relates to identifying an object in a field of view of a camera. In particular, it relates to identifying a display in the field of view of the camera. This is achieved by monitoring a space including acquiring a series of image frames of the space using the camera and detecting one or more light sources in the series of image frames. Further, one or more frequencies of periodic intensity or brightness variations, also referred to as ‘refresh rate’, of light emitted from the light sources is measured. Based on the one or more frequencies of periodic intensity variations of light emitted from the light sources, at least one display that includes the light sources is identified.

First claim

What is claimed is:

1. A method of recognizing a display in a field of view of a camera, the method including:
acquiring a series of image frames from the camera, the image frames including an object;
detecting one or more light sources in the series of image frames;
analyzing the one or more light sources across the series of image frames for periodic brightness variations to determine a frequency of periodic change in brightness of the one or more light sources; and
recognizing an object in the series of images as a display that includes the one or more light sources, the recognizing based on the determined frequency of periodic change in brightness of the one or more light sources.

2. The method of claim 1 , wherein the frequency of periodic change in brightness is determined by measuring frequencies of the one or more light sources over time.

3. The method of claim 1 , further including varying a rate of capture of the series of image frames.

4. The method of claim 3 , wherein the rate of capture is 50, 60, 75, 100, or 120 frames per second.

5. The method of claim 3 , further including using a beat frequency of the periodic brightness variations against the rate of capture to determine the frequency of periodic change in brightness.

6. The method of claim 1 , further including determining a distance between a user in the field of view of the camera and the display.

7. The method of claim 6 , further including setting a context for interpreting user gestures as user-input commands based at least in part on the determined distance.

8. The method of claim 1 , further including prompting a user to make a plurality of contacts at multiple locations on the display and determining a plane occupied by the display based on the plurality of contacts.

9. The method of claim 1 , further including prompting a user to point, with a stylus, to a target presented on the display and detecting a position of the stylus.

10. The method of claim 9 , further including prompting the user to point multiple times at multiple targets and determining a plane occupied by the display based on the detected position of the stylus.

11. A method of recognizing a display in a field of view of a camera, the method including:
monitoring a space using the camera;
in response to a detection of one or more light sources in the space, measuring one or more frequencies of periodic intensity variations of light emitted from the one or more light sources to determine a frequency of periodic change in brightness of the one or more light sources; and
recognizing at least one object within the space as a display that includes the one or more light sources, the recognizing based on the determined frequency of periodic change in brightness from the measured one or more frequencies of the periodic intensity variations.

12. The method of claim 11 , wherein the recognizing of the at least one object as the display includes determining a shape of the recognized at least one object.

13. The method of claim 12 , further including determining a length, a width, or an aspect ratio of the recognized at least one object.

14. The method of claim 11 , wherein the recognizing of the at least one object as the display includes determining that a shape of the recognized at least one object is rectangular.

15. The method of claim 11 , wherein the recognizing of the at least one object as the display includes comparing a length, a width, or an aspect ratio of the recognized at least one object to a predetermined length, a predetermined width, or a predetermined aspect ratio of the display.

16. A system of recognizing a display in a field of view of a camera, the system including:
the camera that captures a series of images in the field of view including at least one object; and
an intensity analyzer running on at least one processor coupled to the camera, wherein the intensity analyzer:
detects one or more light sources in the series of images;
analyzes the one or more light sources across the series of images for periodic brightness variations to determine a frequency of periodic change in brightness of the one or more light sources; and
recognizes an object of the at least one object as a display that includes the one or more light sources, the recognizing based on the determined frequency of periodic change in brightness.

17. The system of claim 16 , further configured to determine a distance between a user in the field of view of the camera and the display.

18. The system of claim 16 , further configured to vary a rate of capture of the series of images.

19. The system of claim 18 , further configured to use a beat frequency of the periodic brightness variations against the rate of capture to determine the frequency of periodic change in brightness.

Assignees

• Leap Motion Inc

Inventors

• Holz David

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• G06F3/0425

  using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386) · CPC title