Biosensor-triggered collaboration

Patent metadata

Field	Value
Publication number	US-11032515-B2
Application number	US-202016988865-A
Country	US
Kind code	B2
Filing date	Aug 10, 2020
Priority date	Mar 9, 2015
Publication date	Jun 8, 2021
Grant date	Jun 8, 2021

Abstract

Embodiments include a computer program product for using a biosensor worn by a user to trigger an event and activate a camera worn by the user to begin streaming and/or recording video data. The biosensor trigger also initiates a real time multimedia collaboration session with the user wearing the biosensor and one or more designated parties. Through an interoperability gateway device, a voice communications device of the user is bridged with voice communications devices of the designated parties, and the video data is electronically transmitted to the designated parties. Thus, the designated parties may have real time voice communications among each other and with the user, and the designated parties may also view the video data in real time. Embodiments also determine when an event has ended and deactivates the camera worn by the user.

First claim

What is claimed is:

1. A system, comprising:
a transceiver; and
one or more processors coupled to the transceiver, wherein the one or more processors are configured to:
transmit, via the transceiver, an activation message to a camera device worn by a user to begin recording and transmitting video data;
transmit, via the transceiver, an event alert to an interoperability workstation (IWS), wherein the IWS establishes a biosensor-triggered multimedia collaboration session including a voice communication device of the user and the camera device;
receive, via the transceiver, a first biometric signal from a biosensor worn by the user; determine, using the first biometric signal, that an event has ceased; and transmit, via the transceiver, a deactivation message to the camera device.

2. The system of claim 1 , wherein the one or more processors are further configured to:
receive, via the transceiver, video data from the camera device; and
transmit, via the transceiver, the video data to the biosensor-triggered multimedia collaboration session.

3. The system of claim 1 , wherein the one or more processors are further configured to:
receive, via the transceiver, a second biometric signal from the biosensor;
based on the second biometric signal, determine that an event occurs; and
generate the event alert.

4. The system of claim 3 , wherein to determine that the event occurs, the one or more processors are configured to:
compare the second biometric signal with a trigger threshold; and
determine that the trigger threshold is satisfied, wherein the trigger threshold comprises a criteria, a parameter, a static rule, or a dynamic rule.

5. The system of claim 4 , wherein the trigger threshold further comprises: a change in a value over time, a rate of change of the value over time, correlations with data from a different biosensor sensor, correlations with data from an environmental sensor, correlations with data from a GPS system, a health or a fitness condition of the user wearing the biosensor, a condition of other personnel being monitored in proximity to the user, a material rating, a system rating, or a system limit.

6. The system of claim 3 , wherein the second biometric signal comprises: a respiration rate, a heart rate, a blood pressure, a perspiration rate, an oxygen level, a body temperature, a voltaic skin response, a bioelectric activity, an altitude, a pitch, a yaw, a rotation or other angular movement, a position, a force, a location, an acceleration, a deceleration, or a change in any of the above.

7. The system of claim 1 , wherein the one or more processors are further configured to: electronically transmit an audio or visual message to the user wearing the biosensor based on: a second biometric signal, an environmental sensor signal, a third biometric signal from another biosensor, or a change in a trigger threshold.

8. The system of claim 1 , wherein the one or more processors are further configured to: receive an environmental condition signal from an environmental sensor in proximity to the biosensor comprising: an ambient temperature, a wind chill, a dew point, a radiation level, a chemical level, a biological agent, a sound, a pressure, a humidity level, a precipitation level, an air pollutant level, a lightning strike, a terrain, an altitude, a location, an air quality level, or a change in any of the above.

9. The system of claim 1 , wherein the one or more processors are further configured to: receive input from the user via a graphical user interface (GUI), a voice interaction interface, or a gesture recognition interface.

10. The system of claim 1 , wherein the one or more processors are further configured to: based on the determination that the event has ceased, transmit, via the transceiver, an event-ended message to the IWS.

11. The system of claim 1 , wherein the transceiver is configured to perform interoperability gateway functions among protocols, comprising: 3G/4G LTE network protocols, IP, push to talk (PTT) communications, emergency voice channel, Bluetooth, WiFi, Zigbee, or other wireless protocol.

12. The system of claim 1 , wherein the voice communication device is configured to operate in Very High Frequency (VHF) or Ultra High Frequency (UHF) communications channels.

13. A method, comprising:
transmitting an activation message to a camera device worn by a user to begin recording and transmitting video data;
transmitting an event alert to an interoperability workstation (IWS), wherein the IWS establishes a biosensor-triggered multimedia collaboration session including a voice communication device of the user and the camera device;
receiving a first biometric signal from a biosensor worn by the user;
determining, using the first biometric signal, that an event has ceased; and
transmitting a deactivation message to the camera device.

14. The method of claim 13 , further comprising:
receiving video data from the camera device; and
transmitting the video data to the biosensor-triggered multimedia collaboration session.

15. The method of claim 13 , further comprising:
receiving a second biometric signal from the biosensor;
based on the second biometric signal, determining that an event occurs; and
generating the event alert.

16. The method of claim 15 , wherein the determining that the event occurs further comprises:
comparing the second biometric signal with a trigger threshold; and
determining that the trigger threshold is satisfied, wherein the trigger threshold comprises a criteria, a parameter, a static rule, or a dynamic rule.

17. The method of claim 15 , wherein the second biometric signal comprises: a respiration rate, a heart rate, a blood pressure, a perspiration rate, an oxygen level, a body temperature, a voltaic skin response, a bioelectric activity, an altitude, a pitch, a yaw, a rotation or other angular movement, a position, a force, a location, an acceleration, a deceleration, or a change in any of the above.

18. The method of claim 13 , further comprising: electronically transmitting an audio or visual message to the user wearing the biosensor based on: a second biometric signal, an environmental sensor signal, a third biometric signal from another biosensor, or a change in a trigger threshold.

19. The method of claim 13 , further comprising: receiving input from the user via a graphical user interface (GUI), a voice interaction interface, or a gesture recognition interface.

20. A non-transitory computer-readable medium storing instructions that, when executed by a processor of an electronic device, cause the processor to perform operations, the operations comprising:
transmitting an activation message to a camera device worn by a user to begin recording and transmitting video data;
transmitting an event alert to an interoperability workstation (IWS), wherein the IWS establishes a biosensor-triggered multimedia collaboration session including a voice communication device of the user and the camera device;
receiving a first biometric signal from a biosensor worn by the user; determining, using the first biometric signal, that an event has ceased; and transmitting a deactivation message to the camera device.

Assignees

• Mutualink Inc

Inventors

• Mazzarella Joseph R
• Wengrovitz Michael S

Classifications

• H04N7/185

  from a mobile camera, e.g. for remote control · CPC title

• H04W76/50

  for emergency connections · CPC title

• H04N7/188

  Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253) · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• H04N5/772

  the recording apparatus and the television camera being placed in the same enclosure · CPC title