Identifying an object in a field of view

Patent metadata

Field	Value
Publication number	US-12147609-B2
Application number	US-202318387142-A
Country	US
Kind code	B2
Filing date	Nov 6, 2023
Priority date	Mar 15, 2013
Publication date	Nov 19, 2024
Grant date	Nov 19, 2024

Abstract

The technology disclosed relates to identifying an object in a field of view of a camera. In particular, it relates to identifying a display in the field of view of the camera. This is achieved by monitoring a space including acquiring a series of image frames of the space using the camera and detecting one or more light sources in the series of image frames. Further, one or more frequencies of periodic intensity or brightness variations, also referred to as ‘refresh rate’, of light emitted from the light sources is measured. Based on the one or more frequencies of periodic intensity variations of light emitted from the light sources, at least one display that includes the light sources is identified.

First claim

What is claimed is:

1. A camera, including:
an imaging optic including at least a lens;
an image sensor to perform capturing a series of image frames including objects within a field of view of the camera; and
a communications connection providing communications via device interface with a computer; and
wherein the computer comprises at least one processor and a memory that stores instructions for recognizing a display in a field of view of a camera; and
wherein the instructions, when executed implement:
recognition that one or more light sources in the series of image frames is a display captured by the camera in the series of image frames; and
provision of an indication that the one or more light sources is recognized as a display; and
wherein recognition is based on a rate of periodic change in brightness of one or more light sources detected in the series of image frames.

2. The camera of claim 1 , wherein the image sensor includes a sensor selected from a charge-coupled device (CCD) sensor and a complementary metal oxide semiconductor (CMOS) sensor.

3. The camera of claim 1 , wherein the camera is one selected from a visible-light camera, an infrared (IR) camera, an ultraviolet camera, and a camera operating in another electromagnetic frequency regime.

4. The camera of claim 1 , wherein rate of periodic change in brightness is determined by measuring frequencies of the one or more light sources over time.

5. The camera of claim 1 , further including the camera having a variable rate of capture of the series of image frames.

6. The camera of claim 5 , wherein the rate of capture is selected from at least 50, 60, 75, 100, or 120 frames per second.

7. The camera of claim 5 , wherein the instructions when executed further implement using a beat frequency of periodic brightness variations against the rate of capture to determine a rate of periodic change in brightness.

8. The camera of claim 1 , wherein the instructions when executed further implement determining a distance between a user in the field of view of the camera and the display.

9. The camera of claim 8 , wherein the instructions when executed further implement setting a context for interpreting user gestures as user-input commands based at least in part on the determined distance.

10. The camera of claim 1 , wherein the instructions when executed further implement prompting a user to make a plurality of contacts at multiple locations on the display and determining a plane occupied by the display based on the plurality of contacts.

11. The camera of claim 1 , wherein the instructions when executed further implement prompting a user to point, with a stylus, to a target presented on the display and detecting a position of the stylus.

12. The camera of claim 11 , wherein the instructions when executed further implement prompting the user to point multiple times at multiple targets and determining a plane occupied by the display based on the detected position of the stylus.

13. The camera of claim 1 , wherein recognition of one or more light sources as a display includes:
computing a frequency of an intensity curve for an object; and
using the frequency of the intensity curve as computed to identify the object.

14. The camera of claim 1 , wherein recognition of one or more light sources as a display includes determining a shape of the display.

15. The camera of claim 14 , wherein the instructions when executed further implement determining a length, a width, or an aspect ratio of the display.

16. The camera of claim 1 , wherein recognition of one or more light sources as a display includes determining that a shape of the display is rectangular.

17. The camera of claim 1 , wherein recognition of one or more light sources as a display includes comparing a length, a width, or an aspect ratio of the display to a predetermined length, a predetermined width, or a predetermined aspect ratio of the display.

18. An apparatus, including:
a plurality of cameras arranged such that at least a portion of their fields of view overlap in a viewed region to perform capturing a series of image frames including objects within their fields of view; and
a communications connection providing communications via device interface with a computer; and
wherein the computer comprises at least one processor and a memory that stores instructions for recognizing a display in a field of view of a camera; and
wherein the instructions, when executed implement:
recognition that one or more light sources in the series of image frames is a display captured by the camera in the series of image frames; and
provision of an indication that the one or more light sources is recognized as a display; and
wherein recognition is based on a rate of periodic change in brightness of one or more light sources detected in the series of image frames.

19. The apparatus of claim 18 , wherein each camera comprises an image sensor selected from a charge-coupled device (CCD) sensor and a complementary metal-oxide semiconductor (CMOS) sensor.

20. The apparatus of claim 18 , wherein each camera is one selected from a visible-light camera, an infrared (IR) camera, an ultraviolet camera, and a camera operating in another electromagnetic frequency regime.

21. A system, including:
one or more cameras to perform capturing a series of image frames including objects within a field of view of the camera; and
a computer communicatively coupled to the one or more cameras, and including at least one processor and a memory that stores instructions for recognizing a display in a field of view of a camera; wherein the instructions, when executed implement:
recognition that one or more light sources identified in the series of image frames is a display captured by the camera in the series of image frames, wherein recognition is based on a rate of periodic change in brightness of one or more light sources detected in the series of image frames; and
provision of an indication that the one or more light sources is recognized as a display.

Assignees

• Ultrahaptics Ip Two Ltd

Inventors

• Holz David

Classifications

• G06T2207/20101

  Interactive definition of point of interest, landmark or seed · CPC title

• G06T2207/10141

  Special mode during image acquisition · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T7/55

  from multiple images · CPC title