Confidentiality-smart voice delivery of text-based incoming messages

Patent metadata

Field	Value
Publication number	US-10257340-B2
Application number	US-201715842973-A
Country	US
Kind code	B2
Filing date	Dec 15, 2017
Priority date	May 27, 2016
Publication date	Apr 9, 2019
Grant date	Apr 9, 2019

Abstract

Methods, computer program products, and systems are presented. The methods include, for instance: a voice delivery application, running on a mobile device of a user, receives a text message from a user; by use of sensor inputs of the mobile device, the mobile device stores data regarding environment of the mobile device including external audio equipment, speed of the user, and bystanders within a hearing range of the environment; various data describing a sender of the text message and the bystanders are analyzed for respective relationships with the user and with each other to determine a confidentiality group dictating whether or not the text message may be heard by the bystander; the text message may be scanned for content screening, then according to configuration of the voice delivery application, the text message is securely delivered to the user by voice.

First claim

What is claimed is:

1. A computer implemented method for confidentially delivering a text-based message by voice, comprising:
receiving, by one or more processor of a user mobile device running a voice delivery application, the text-based message sent from a sender using a sender device via mobile services network to a user using the user mobile device;
storing device environment data comprising inputs from at least one sensor of the user mobile device;
determining, based on the device environment data, that the user mobile device is enabled to read the text-based message out for the user, and that at least one bystander is present within a hearing distance from the user;
recording that the sender and the bystander are in a same confidentiality group based on data that includes one or more of the following selected from the group consisting of communication service subscription data of the user, contacts stored in the user mobile device, social media data of the user, social media data of the sender, and social media data of the bystander, wherein the recording comprises discovering that the user shares a subscription plan with the sender and the bystander;
scanning content of the text-based message for any confidentiality restriction based on one or more keyword of the text based message;
ascertaining that the user wants the text-based message to be read to the user; and
delivering the text-based message by voice such that the user hears the text-based message.

2. The computer implemented method of claim 1 , said determining comprising:
discovering that the user mobile device is coupled to an external speaker; and
discovering that the bystander is present within a range of the external speaker.

3. The computer implemented method of claim 1 , said determining comprising:
discovering that the bystander is present within a range of an embedded speaker of the user mobile device.

4. The computer implemented method of claim 3 , said determining comprising: discovering that the user mobile device is not coupled to an external speaker.

5. The computer implemented method of claim 3 , said determining comprising: discovering that the user mobile device is moving slower than a threshold speed set for delivering the text-based message by voice.

6. The computer implemented method of claim 1 , said determining comprising:
discovering that the user mobile device is not coupled to an external speaker.

7. The computer implemented method of claim 1 , said delivering comprising:
playing an audio stream corresponding to the text-based message on a speaker, wherein the speaker is either embedded in the user mobile device or external and coupled to the user mobile device; and
storing a responding speech from the user via a recording device coupled to the user mobile device, wherein the responding speech is enabled by a configuration of the voice delivery application.

8. The computer implemented method of claim 1 , said recording comprising:
discovering that the user does not share a subscription plan with the sender and the bystander;
discovering that the sender and the bystander are not in a same group of the contacts of the user mobile device;
discovering that the sender, the user, and the bystander are related in at least one social media and have interactions more than a minimum set of the same confidentiality group; and
recording that the sender and the bystander are in the same confidentiality group.

9. The computer implemented method of claim 1 , said delivering comprising:
playing an audio stream corresponding to the text-based message on a speaker, wherein the speaker is either embedded in the user mobile device or external and coupled to the user mobile device;
storing a responding speech from the user via a recording device coupled to the user mobile device, wherein the responding speech is enabled by a configuration of the voice delivery application;
converting the responding speech to a response text message; and
sending the response text message to the sender by use of envelope data of the received text message.

10. The computer implemented method of claim 1 , wherein said delivering the text-based message by voice such that the user hears the text-based message includes delivering the text-based message by voice such that the user hears the text-based message based on the one or more keyword of the text based message being a business related keyword defined as confidential and there being a confidential relationship between the user and the bystander.

11. The computer implemented method of claim 1 , wherein the method incudes delivering a subsequent text-based message by text such that the user does not hear the text-based message based on the one or more keyword of the subsequent text based message being a business related keyword defined as confidential and there not being a confidential relationship between the user and the bystander.

12. A computer program product comprising:
a computer readable storage medium readable by one or more processor and storing instructions for execution by the one or more processor for performing a method for confidentially delivering a text-based message by voice, comprising:
receiving, by the one or more processor of a user mobile device running a voice delivery application, the text-based message sent from a sender using a sender device via mobile services network to a user using the user mobile device;
storing device environment data comprising inputs from at least one sensor of the user mobile device;
determining, based on the device environment data, that the user mobile device is enabled to read the text-based message out for the user, and that at least one bystander is present within a hearing distance from the user;
recording that the sender and the bystander are in a same confidentiality group based on data that includes one or more of the following selected from the group consisting of communication service subscription data of the user, contacts stored in the user mobile device, social media data of the user, social media data of the sender, and social media data of the bystander;
scanning content of the text-based message for any confidentiality restriction based on predefined keywords appearing in envelope data of the text based message;
ascertaining that the user wants the text-based message to be read to the user, according to configuration of the voice delivery application or a response to read the text-based message from the user upon being prompted; and delivering the text-based message by voice such that the user hears the text-based message.

13. The computer program product of claim 12 , said determining comprising:
discovering that the user mobile device is coupled to an external speaker; and
discovering that the bystander is present within a range of the external speaker.

14. The computer program product of claim 12 , said determining comprising:
discovering that the user mobile device is not coupled to an external speaker;
discovering that the user mobile device is moving slower than a threshold speed set for delivering the text-based message by voice; and
discovering that the bystander is present within a range of an embedded speaker of the user mobile device.

15. The computer program product of claim 12 , said delivering comprising:
playing an audio stream corresponding to the text-based message on a speaker, wherein the speaker is either embedded in the user mobile device or external and coupled to the user mobile device; and
storing a responding speech from the user via a recording device coupled to the user mobile

Assignees

• IBM

Inventors

• Adderly Darryl M
• Jackson Jonathan W
• Jariwala Ajit
• Libow Eric B

Classifications

• H04M1/67

  by electronic means · CPC title

• G10L13/00 Primary

  Speech synthesis; Text to speech systems · CPC title

• H04L63/104

  Grouping of entities · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• H04W4/14

  Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD] · CPC title