Data leak prevention using user and device contexts

Patent metadata

Field	Value
Publication number	US-11830098-B2
Application number	US-202016794265-A
Country	US
Kind code	B2
Filing date	Feb 19, 2020
Priority date	Jan 2, 2020
Publication date	Nov 28, 2023
Grant date	Nov 28, 2023

Abstract

Disclosed are various examples for audio data leak prevention using user and device contexts. In some examples, a voice assistant device can be connected to a remote service that provides enterprise data to be audibly emitted by the voice assistant device. In response to a request for the enterprise data being received from the voice assistant device, an audio signal can be generated that audibly broadcasts the enterprise data. The audio signal can be generated to audibly redact at least a portion of the enterprise data based at least in part on a mode of operation of the voice assistant device. The voice assistant device can be directed to emit the enterprise data through a playback of the audio signal.

First claim

What is claimed is:

1. A system, comprising:
at least one computing device; and
program instructions stored in memory and executable by the at least one computing device that, when executed, direct the at least one computing device to:
connect a voice assistant device to a remote service that provides enterprise data to be audibly emitted by the voice assistant device;
receive whitelist data for a mode of operation of the voice assistant device, the whitelist data comprising a first list of words, phrases, or regular expressions to not be redacted;
receive blacklist data for the mode of operation of the voice assistant device, the blacklist data comprising a second list of words, phrases, or regular expressions to be redacted;
in response to a request for the enterprise data being received from the voice assistant device, generate an audio signal that audibly broadcasts the enterprise data, wherein at least a first portion of the audio signal is generated to audibly redact at least a first portion of the enterprise data based at least in part on the first portion of the enterprise data matching the blacklist data for the mode of operation of the voice assistant device, and wherein at least a second portion of the audio signal is generated to not audibly redact at least a second portion of the enterprise data based at least in part on the second portion of the enterprise data matching the whitelist data for the mode of operation of the voice assistant device; and
direct the voice assistant device to emit the enterprise data through a playback of the audio signal.

2. The system of claim 1 , wherein the at least one computing device is further directed to:
maintain, in association with the voice assistant device, a plurality of security modes, the mode of operation of the voice assistant device being one of the security modes, wherein individual ones of the security modes are different from one another; and
in response to a request for the enterprise data being received from the voice assistant device, identify an active one of the plurality of security modes, wherein the audio signal is generated based at least in part on the active one of the plurality of security modes.

3. The system of claim 2 , wherein the at least one computing device is further directed to:
receive a request to change the active one of the security modes to another one of the security modes based at least in part on a verbalized command received from the voice assistant device.

4. The system of claim 2 , wherein the at least one computing device is further directed to:
adjust the active one of the security modes to another one of the security modes without a verbalized command based at least in part on a sensitivity of at least a portion of the enterprise data.

5. The system of claim 2 , wherein:
the active one of the security modes is enabled based at least in part on: multiple individuals being detected within an audible range of the voice assistant device or an analysis of a calendar item indicating that multiple individuals are present.

6. The system of claim 1 , wherein the enterprise data comprises at least one of:
an email; a calendar item; a reminder; an instant message; and a short message service (SMS) message.

7. The system of claim 1 , wherein a portion of the enterprise data is modified by:
replacing the first portion of the enterprise data with a predetermined audio tone;
replacing the first portion of the enterprise data with static sound; or
replacing the first portion of the enterprise data with silence.

8. A non-transitory computer-readable medium comprising machine-readable instructions, wherein the machine-readable instructions, when executed by at least one processor, direct the at least one computing device to at least:
connect a voice assistant device to a remote service that provides enterprise data to be audibly emitted by the voice assistant device;
receive whitelist data for a mode of operation of the voice assistant device, the whitelist data comprising a first list of words, phrases, or regular expressions to not be redacted;
receive blacklist data for the mode of operation of the voice assistant device, the blacklist data comprising a second list of words, phrases, or regular expressions to be redacted;
in response to a request for the enterprise data being received from the voice assistant device, generate an audio signal that audibly broadcasts the enterprise data, wherein at least a first portion of the audio signal is generated to audibly redact at least a first portion of the enterprise data based at least in part on the first portion of the enterprise data matching the blacklist data for the mode of operation of the voice assistant device, and wherein at least a second portion of the audio signal is generated to not audibly redact at least a second portion of the enterprise data based at least in part on the second portion of the enterprise data matching the whitelist data for the mode of operation of the voice assistant device; and
direct the voice assistant device to emit the enterprise data through a playback of the audio signal.

9. The non-transitory computer-readable medium of claim 8 , wherein the at least one computing device is further directed to:
maintain, in association with the voice assistant device, a plurality of security modes, the mode of operation of the voice assistant device being one of the security modes, wherein individual ones of the security modes are different from one another; and
in response to a request for the enterprise data being received from the voice assistant device, identify an active one of the plurality of security modes, wherein the audio signal is generated based at least in part on the active one of the plurality of security modes.

10. The non-transitory computer-readable medium of claim 9 , wherein the at least one computing device is further directed to:
receive a request to change the active one of the security modes to another one of the security modes based at least in part on a verbalized command received from the voice assistant device.

11. The non-transitory computer-readable medium of claim 9 , wherein the at least one computing device is further directed to:
adjust the active one of the security modes to another one of the security modes without a verbalized command based at least in part on a sensitivity of at least a portion of the enterprise data.

12. The non-transitory computer-readable medium of claim 9 , wherein:
the active one of the security modes is enabled based at least in part on: multiple individuals being detected within an audible range of the voice assistant device or an analysis of a calendar item indicating that multiple individuals are present.

13. The non-transitory computer-readable medium of claim 8 , wherein the enterprise data comprises at least one of: an email; a reminder; a calendar item; an instant message; and a short message service (SMS) message.

14. The non-transitory computer-readable medium of claim 8 , wherein a portion of the enterprise data is modified by:
replacing the first portion of the enterprise data with a predetermined audio tone;
replacing the first portion of the enterprise data with static sound; or
replacing the first portion of the enterprise data with silence.

15. A method, comprising:
connecting a voice assistant device to a remote service that provides enterprise data to be audibly emitted by the voice assistant device;
receiving whitelist data for a mode of operation of the voice assistant device, the whitelist data comprising a first list of words, phrases, or reg

Assignees

• Vmware Inc

Inventors

• Shetty Rohit Pradeep
• Stuntebeck Erich Peter
• Panchapakesan Ramani
• Aluvala Suman
• Xuan Chaoting

Classifications

• G06Q50/265 Primary

  Personal security, identity or safety · CPC title

• G06F21/74

  operating in dual or compartmented mode, i.e. at least one secure mode · CPC title

• G06Q10/107

  Computer-aided management of electronic mailing [e-mailing] · CPC title

• G06Q10/109 Primary

  Time management, e.g. calendars, reminders, meetings or time accounting · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title