Warning a user about adverse behaviors of others within an environment based on a 3D captured image stream

Patent metadata

Field	Value
Publication number	US-9412011-B2
Application number	US-201514962761-A
Country	US
Kind code	B2
Filing date	Dec 8, 2015
Priority date	Jan 12, 2007
Publication date	Aug 9, 2016
Grant date	Aug 9, 2016

Abstract

A tactile feedback output device receives one or more warning signals for controlling one or more types of tactile output by the one or more tactile feedback output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more tactile feedback output devices worn by the supervising user.

First claim

What is claimed is:

1. A system, comprising:
one or more tactile feedback output devices operative to receive one or more warning signals for controlling one or more types of tactile output by the one or more tactile feedback output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more tactile feedback output devices worn by the supervising user; and
the one or more tactile feedback output devices operative to control the one or more types of tactile outputs of the one or more tactile feedback output devices that are detectable by the supervising user wearing the one or more tactile feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse.

2. The system according to claim 1 , further comprising:
a computer system operative to capture a three-dimensional movement of the monitored user within the particular environment monitored by the supervising user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the monitored user;
the computer system operative to identify a three-dimensional object properties stream using the captured movement;
the computer system operative to access a selection of adverse behavior definitions specified for the particular environment from among a plurality of adverse behavior definitions specified for a plurality of environments from a behavior database;
the computer system operative to identify a particular defined adverse behavior of the monitored user represented by the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with the selection of adverse behavior definitions by calculating a percentage of probability that the captured three-dimensional movement represents the particular behavior defined in the selection of adverse behavior definitions and calculating the percentage of probability that the captured three-dimensional movement is adverse;
the computer system, in response to identifying the particular defined adverse behavior of the monitored user from among the plurality of adverse behavior definitions, operative to notify the supervising user for the particular environment about the particular defined adverse behavior of the monitored user through an interface only detectable by the supervising user by sending the one or more warning signals to the one or more tactile feedback output devices.

3. The system according to claim 2 , further comprising:
the computer system operative to capture a response by the supervising user to the supervising user receiving the notification of the particular adverse behavior through the interface of the one or more tactile feedback output devices, wherein the response indicates whether the particular adverse behavior is correctly identified; and
adjusting at least one definition in the selection of adverse behavior definitions specified for the particular environment in the behavior database to reflect the response.

4. The system according to claim 1 , further comprising:
the computer system operative to translate the particular adverse behavior into the one or more warning signals comprising one or more tactile feedback control signals with a feedback strength specified to a percentage of total feedback strength to reflect the percentage probability that the captured three-dimensional movement is adverse and with a feedback position specified to one or multiple feedback positions to reflect a position of the monitored user of the particular adverse behavior within the particular environment; and
the computer system operative to control output of the one or more warning signals comprising the one or more feedback control signals to the one or more tactile feedback output devices detectable by the supervising user only for controlling a feedback strength and a feedback position of the feedback output by the one or more tactile feedback output devices.

5. The system according to claim 1 , further comprising:
the one or more tactile feedback output devices each comprising a wireless transmitter for receiving the one or more warning signals via a wireless network transmission from a warning system that transmits the one or more warning signals to the tactile feedback output devices only, the warning system translating the particular adverse behavior and percentage probability into the one or more warning signals.

6. The system according to claim 1 , further comprising:
the one or more tactile feedback output devices each comprising a controller for controlling the one or more types of tactile output comprising one or more detectable pressure pulses with adjustable frequency, intensity, duration, and timing; and
the controller for specifying the positions of pulses within the one or more detectable pressure pulses and for specifying the frequency, intensity, duration, and timing of the pulses based on the one or more warning signals.

7. The system according to claim 1 , further comprising:
the one or more tactile feedback output devices operative to receive the one or more warning signals comprising x and y coordinates;
the one or more tactile feedback output devices operative to detect a relative position of each of the one or more tactile feedback output devices compared with a force of gravity as the supervising user wears the one or more tactile feedback output devices; and
the one or more tactile feedback output devices operative to reposition the one or more types of tactile outputs based on the x and y coordinates and the relative position of each of the one or more tactile feedback output devices compared with the force of gravity to maintain the y coordinate as up relative to the force of gravity.

8. A method, comprising:
receiving, by one or more tactile feedback output devices, one or more warning signals for controlling one or more types of tactile output by the one or more tactile feedback output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more tactile feedback output devices worn by the supervising user; and
controlling, by the one or more tactile feedback output devices, the one or more types of tactile outputs of the one or more tactile feedback output devices that are detectable by the supervising user wearing the one or more tactile feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse.

9. The method according to claim 8 , further comprising:
capturing, by a computer system, a three-dimensional movement of the monitored user within the particular environment monitored by the supervising user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the monitored user;
identifying, by the computer system, a three-dimensional object properties stream usi

Assignees

• IBM

Inventors

• Albertson Jacob C
• Arnold Kenneth C
• Goldman Steven D
• Paolini Michael A
• Sessa Anthony J

Classifications

• G08B13/19613 Primary

  Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion · CPC title

• G06T7/2093

  Physics · mapped topic

• G06K9/00335 Primary

  Physics · mapped topic

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title