Region of interest segmentation

Patent metadata

Field	Value
Publication number	US-10007330-B2
Application number	US-201113164785-A
Country	US
Kind code	B2
Filing date	Jun 21, 2011
Priority date	Jun 21, 2011
Publication date	Jun 26, 2018
Grant date	Jun 26, 2018

Abstract

A sensor manager provides dynamic input fusion using thermal imaging to identify and segment a region of interest. Thermal overlay is used to focus heterogeneous sensors on regions of interest according to optimal sensor ranges and to reduce ambiguity of objects of interest. In one implementation, a thermal imaging sensor locates a region of interest that includes an object of interest within predetermined wavelengths. Based on the thermal imaging sensor input, the regions each of the plurality of sensors are focused on and the parameters each sensor employs to capture data from a region of interest are dynamically adjusted. The thermal imaging sensor input may be used during data pre-processing to dynamically eliminate or reduce unnecessary data and to dynamically focus data processing on sensor input corresponding to a region of interest.

First claim

What is claimed is:

1. A method comprising:
segmenting a region of interest within a field of view of a target recognition, analysis and tracking system using passive sensing of a first sensor, the region of interest being a subset of the field of view of the target recognition, analysis and tracking system; and
changing a first operation of data capture by a second sensor within the segmented region of interest of the field of view relative to a second operation of the data capture by the second sensor concurrently collecting data from the field of view outside the segmented region of interest.

2. The method of claim 1 wherein the changing operation comprises:
changing resolution of capture by the second sensor within the segmented region of interest relative to the field of view outside the segmented region of interest.

3. The method of claim 2 wherein the operation of changing resolution comprises:
increasing resolution of capture by the second sensor within the segmented region of interest; and
decreasing resolution of capture by the second sensor within the field for view outside the segmented region of interest.

4. The method of claim 1 wherein the changing operation comprises:
expanding the field of view of at least one sensor of the target recognition, analysis and tracking system.

5. The method of claim 4 wherein the changing operating further comprises:
decreasing resolution of capture by the second sensor within the expanded field of view outside the segmented region of interest.

6. The method of claim 1 wherein the changing operation comprises:
changing sensitivity of capture by the second sensor within the segmented region of interest relative to the field of view outside the segmented region of interest.

7. The method of claim 6 wherein the operation of changing resolution comprises:
increasing sensitivity of capture by the second sensor within the segmented region of interest; and
decreasing sensitivity of capture by the second sensor within the field of view outside the segmented region of interest.

8. The method of claim 1 wherein the passive sensing includes passive thermal sensing.

9. A multimedia system comprising:
a first sensor;
a second sensor;
one or more processors; and
a sensor manager executed by the one or more processors and configured to segment a region of interest within a field of view of the multimedia system using passive sensing of the first sensor, the region of interest being a subset of the field of view of the multimedia system, the sensor manager configured to change a first operation of data capture by the second sensor within the segmented region of interest of the field of view relative to a second operation of the data capture by the second sensor concurrently collecting data from the field of view outside the segmented region of interest.

10. The multimedia system of claim 9 wherein the sensor manager changes the data capture operation of the second sensor by:
changing resolution of capture by the second sensor within the segmented region of interest relative to the field of view outside the segmented region of interest.

11. The multimedia system of claim 10 wherein the sensor manager changes the data capture operation of the second sensor by:
increasing resolution of capture by the second sensor within the segmented region of interest; and
decreasing resolution of capture by the second sensor within the field of view outside the segmented region of interest.

12. The multimedia system of claim 9 wherein the sensor manager changes the data capture operation of the second sensor by:
expanding the field of view of at least one sensor of the multimedia system.

13. The multimedia system of claim 12 wherein the sensor manager changes the data capture operation of the second sensor by
decreasing resolution of capture by the second sensor within the expanded field of view outside the segmented region of interest.

14. The multimedia system one or more processor-readable storage media of claim 9 wherein the sensor manager changes the data capture operation of the second sensor by
changing sensitivity of capture by the second sensor within the segmented region of interest relative to the field of view outside the segmented region of interest.

15. The multimedia system of claim 14 wherein the sensor manager changes the data capture operation of the second sensor by increasing sensitivity of capture by the second sensor within the segmented region of interest and decreasing sensitivity of capture by the second sensor within the field of view outside the segmented region of interest.

16. The multimedia system one of claim 9 wherein the passive sensing includes passive thermal sensing.

17. A system comprising:
a sensor manager configured to segment a region of interest within a field of view of the system using passive sensing of a first sensor, the region of interest being a subset of the field of view of the system; and
a second sensor configured to change a resolution of a first operation of data capture within the segmented region of interest of the field of view relative to a resolution of a second operation of data capture by the second sensor concurrently collecting data from the field of view outside the segmented region of interest.

18. The system of claim 17 wherein the second sensor is configured to increase the resolution of the data capture within the segmented region of interest relative to the resolution of the data capture within the field of view outside the segmented region of interest.

19. The system of claim 17 wherein the second sensor is further configured to change a sensitivity of the data capture by the second sensor within the segmented region of interest relative to the sensitivity of the data capture within the field of view outside the segmented region of interest.

20. The system of claim 17 wherein the second sensor is further configured to expand the field of view of at least one sensor.

Assignees

• Murthi Raghu
• Bathiche Steven
• Tardif John Allen
• Baker Nicholas Robert
• Microsoft Technology Licensing Llc

Inventors

• Murthi Raghu
• Bathiche Steven
• Tardif John Allen
• Baker Nicholas Robert

Classifications

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06K9/209

  Physics · mapped topic

• H04H60/45

  for identifying users · CPC title

• G06F3/005

  Input arrangements through a video camera · CPC title