Extracting information about people from sensor signals

Patent metadata

Field	Value
Publication number	US-12555409-B2
Application number	US-202017759462-A
Country	US
Kind code	B2
Filing date	Dec 14, 2020
Priority date	Jan 27, 2020
Publication date	Feb 17, 2026
Grant date	Feb 17, 2026

Abstract

There is provided a computer implemented method of extracting information about a person. Incoming sensor signals for monitoring people within a field of view of a sensor system are received and processed. In response to detecting a person located within a notification region, an output device outputs a notification to the detected person. Processing of the incoming sensor signals continues in order to monitor behaviour patterns of the person and determine from his behaviour patterns whether he is currently in a consenting or non-consenting state. An extraction function attempts to extract information about the person irrespective of his determined state. A sharing function determines whether or not to share an extracted piece of information about the person with a receiving entity in accordance with his determined state, the information not being shared unless and until it is subsequently determined that the person is in the consenting state.

First claim

The invention claimed is:

1 . An information extraction system comprising:
an input device configured to receive, from a sensor system, incoming sensor signals to monitor people within a field of view of the sensor system; and a processor configured to:
detect a presence of a person within a notification region of the field of view of the sensor system, the notification region being smaller than the field of view, the notification region comprising a non-consenting region and a consenting region;
cause an output device associated with the sensor system to render a notification to the person upon detecting the presence of the person within the notification region; determine the person to be consenting when the person is located in the consenting region of the notification region, and non-consenting when the person is located in the non-consenting region of the notification region, wherein the notification to the person in the non-consenting region is a first type of notification indicating that the person is being tracked, and the notification to the person in the consenting region is a second type of notification indicating that information about the person is being shared; and implement: (i) an extraction function that attempts to extract identity information about the person irrespective of their determined region and consent, and (ii) a sharing function that determines whether or not to share an extracted piece of identity information about the person with a receiving entity in accordance with their determined consent, wherein the piece of identity information about the person extracted when they are determined to be non-consenting is not shared unless and until it is subsequently determined that the person is now consenting.

2 . The information extraction system according to claim 1 , wherein the processor is configured to determine the person to be consenting when the person performs a predetermined consent gesture when located in the notification region, and non-consenting if the person has not performed the consent gesture in the notification region.

3 . The information extraction system according to claim 1 , wherein the processor is configured to determine the person to be consenting when the person remains in the notification region for a predefined period of time, and the person is non-consenting prior to expiry of said predefined period of time.

4 . The information extraction system according to claim 1 , wherein the extraction function comprises at least one of a facial recognition process, a pose tracking process, or an object tracking process.

5 . The information extraction system according to claim 1 , wherein the receiving entity is a user, and the information is shared with the user via a user interface.

6 . The information extraction system according to claim 1 , wherein the receiving entity is an external computer system or storage device, and the information is shared therewith with a data interface of the information extraction system.

7 . The information extraction system according to claim 1 , wherein the notification is rendered to the person as a visual or audio notification, the processor is configured to update the notification in response to changes in behaviour pattern of the person.

8 . The information extraction system according to claim 1 , wherein a confidence value is calculated for each piece of extracted information, the piece of extracted information only being shared with the receiving entity if the confidence value is greater than a predefined confidence threshold.

9 . The information extraction system according to claim 3 , wherein the person remains non-consenting after the expiry of the predefined period of time if the person performs a predefined non-consent gesture before expiry of the predefined period of time when located in the notification region.

10 . The information extraction system according to claim 5 , wherein the user interface, the sensor system and the output device are embodied in a wearable device.

11 . A computer implemented method of extracting information about a person, the method comprising:
receiving from a sensor system incoming sensor signals to monitor people within a field of view of the sensor system; detecting a presence of a person within a notification region of the field of view of the sensor system, the notification region being smaller than the field of view, the notification region comprising a non-consenting region and a consenting region; causing an output device associated with the sensor system to provide a notification to the person upon entering the notification region; determining the person to be consenting when the person is located in the consenting region of the notification region, and non-consenting when the person is located in the non-consenting region of the notification region, wherein the notification to the person in the non-consenting region is a first type of notification indicating that the person is being tracked, and the notification to the person in the consenting region is a second type of notification indicating that information about the person is being shared; and wherein: (i) an extraction function attempts to extract identity information about the person irrespective of their determined region and consent, and (ii) a sharing function determines whether or not to share an extracted piece of identity information about the person with a receiving entity in accordance with their determined consent, wherein the piece of identity information about the person extracted when they are determined to be non-consenting is not shared unless and until it is subsequently determined that the person is now consenting.

12 . The computer implemented method according to claim 11 , wherein the person is determined to be consenting when the person performs a predetermined consent gesture when located in the notification region, and non-consenting if the person has not performed the consent gesture in the notification region.

13 . The computer implemented method according to claim 11 , wherein the person is determined to be consenting when the person remains in the notification region for a predefined period of time, and the person is non-consenting prior to expiry of said predefined period of time.

14 . The computer implemented method according to claim 11 , wherein the extraction function comprises at least one of a facial recognition process, a pose tracking process, or an object tracking process.

15 . The computer implemented method according to claim 13 , wherein the person remains non-consenting after the expiry of the predefined period of time if the person performs a predefined non-consent gesture before expiry of the predefined period of time when located in the notification region.

16 . A computer program, stored on a non-transitory storage medium, for programming a computer system to implement functionality of:
receiving, from a sensor system, incoming sensor signals to monitor people within a field of view of the sensor system; detecting a presence of a person within a notification region of the field of view of the sensor system, the notification region being smaller than the field of view, the notification region comprising a non-consenting region and a consenting region; causing an output device associated with the sensor system to render a notification to the person upon detecting the presence of the person within the notification region; determining the person to be consenting when the person is located in the consenting region of the notification region, and

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Morrison Cecily Peregrine Borgatti
• Grayson Martin Philip
• Dunphy Anja
• Cutrell Edward Bryan

Classifications

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06V10/22

  by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06V40/173

  face re-identification, e.g. recognising unknown faces across different face tracks · CPC title