Human centered computing based digital persona generation

Patent metadata

Field	Value
Publication number	US-11860925-B2
Application number	US-202117222567-A
Country	US
Kind code	B2
Filing date	Apr 5, 2021
Priority date	Apr 17, 2020
Publication date	Jan 2, 2024
Grant date	Jan 2, 2024

Abstract

In some examples, human centered computing based digital persona generation may include generating, for a digital persona that is to be generated for a target person, synthetic video files and synthetic audio files that are combined to generate synthetic media files. The digital persona may be generated based on a synthetic media file. An inquiry may be received from a user of the generated digital persona. Another synthetic media file may be used by the digital persona to respond to the inquiry. A real-time emotion of the user may be analyzed based on a text sentiment associated with the inquiry, and a voice sentiment and a facial expression associated with the user. Based on the real-time emotion of the user, a further synthetic media file may be utilized by the digital persona to continue or modify a conversation between the generated digital persona and the user.

First claim

What is claimed is:

1. A human centered computing based digital persona generation apparatus comprising:
a face superimposer, executed by at least one hardware processor, to
generate, for a digital persona that is to be generated for a target person, a plurality of synthetic video files;

a speech synthesizer, executed by the at least one hardware processor, to
generate, for the digital persona that is to be generated for the target person, a plurality of synthetic audio files;

a synthetic media generator, executed by the at least one hardware processor, to
generate a plurality of synthetic media files by combining the synthetic video files and the synthetic audio files;

a digital persona generator, executed by the at least one hardware processor, to
generate, based on a synthetic media file of the plurality of synthetic media files, the digital persona displayed as a holographic projection of the target person;
a dialogue and navigation manager, executed by the at least one hardware processor, to
receive, from a user of the generated digital persona, an inquiry, and
utilize, based on an analysis of the inquiry and by the generated digital persona, another synthetic media file of the plurality of synthetic media files to respond to the inquiry; and

a real-time emotion analyzer, executed by the at least one hardware processor, to
analyze a real-time emotion of the user by analyzing a text sentiment associated with the inquiry, a voice sentiment associated with the user, and a facial expression associated with the user.

2. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
utilize, based on the real-time emotion of the user and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.

3. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
utilize, based on a level selected from a plurality of levels associated with the real-time emotion of the user and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.

4. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
utilize, based on the real-time emotion of the user, a topic of interest specified by the user, and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.

5. The human centered computing based digital persona generation apparatus according to claim 1 , further comprising:
a conversation adapter, executed by the at least one hardware processor, to
compare an involvement level of the user to a specified threshold;
based on a determination that the involvement level meets or exceeds the specified threshold, continue a conversation between the generated digital persona and the user; and
based on a determination that the involvement level is less than the specified threshold, modify the conversation between the generated digital persona and the user.

6. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to receive, from the user of the generated digital persona, the inquiry by:
receiving, within a specified time interval associated with monitoring for inquiries, the inquiry from the user.

7. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to:
determine whether a specified time interval associated with monitoring for inquiries is exceeded; and
based on a determination that the specified time interval associated with monitoring for inquiries is exceeded, utilize, by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to prompt the user.

8. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to:
end, based on a keyword in the inquiry, a conversation between the generated digital persona and the user.

9. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the dialogue and navigation manager is executed by the at least one hardware processor to:
determine, based on training associated with a plurality of user utterances, which synthetic media file of the plurality of synthetic media files to utilize to respond to the inquiry.

10. The human centered computing based digital persona generation apparatus according to claim 1 , wherein the speech synthesizer is executed by the at least one hardware processor to generate, for the digital persona that is to be generated for the target person, the plurality of synthetic audio files by:
generating, based on a plurality of audio file samples of different time intervals, for the digital persona that is to be generated for the target person, the plurality of synthetic audio files.

11. A method for human centered computing based digital persona generation, the method comprising:
generating, by at least one hardware processor, for a digital persona that is to be generated for a target person, a plurality of synthetic video files;
generating, by the at least one hardware processor, for the digital persona that is to be generated for the target person, a plurality of synthetic audio files;
generating, by the at least one hardware processor, a plurality of synthetic media files by combining the synthetic video files and the synthetic audio files;
generating, by the at least one hardware processor, based on a synthetic media file of the plurality of synthetic media files, the digital persona displayed as a holographic projection of the target person;
receiving, by the at least one hardware processor, from a user of the generated digital persona, an inquiry; and
analyzing, by the at least one hardware processor, a real-time emotion of the user by analyzing at least one of a text sentiment associated with the inquiry, a voice sentiment associated with the user, or a facial expression associated with the user.

12. The method for human centered computing based digital persona generation according to claim 11 , the method comprising:
utilizing, by the at least one hardware processor, based on an analysis of the inquiry and by the generated digital persona, another synthetic media file of the plurality of synthetic media files to respond to the inquiry.

13. The method for human centered computing based digital persona generation according to claim 11 , the method comprising:
utilizing, by the at least one hardware processor, based on the real-time emotion of the user and by the generated digital persona, a further synthetic media file of the plurality of synthetic media files to continue or modify a conversation between the generated digital persona and the user.

14. A no

Assignees

• Accenture Global Solutions Ltd

Inventors

• RAMACHANDRA Nisha
• Ahuja Manish
• M Rao Raghotham
• DUBASH Neville
• Podder Sanjay
• Menon Rekha M

Classifications

• G06N3/09

  Supervised learning · CPC title

• G06N3/0475

  Generative networks · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/0455

  Auto-encoder networks; Encoder-decoder networks · CPC title

• G06N3/094

  Adversarial learning · CPC title