Talking paper authoring tools

Patent metadata

Field	Value
Publication number	US-9406340-B2
Application number	US-201213493112-A
Country	US
Kind code	B2
Filing date	Jun 11, 2012
Priority date	Oct 8, 2008
Publication date	Aug 2, 2016
Grant date	Aug 2, 2016

Abstract

A range of unified software authoring tools for creating a talking paper application for integration in an end user platform are described herein. The authoring tools are easy to use and are interoperable to provide an easy and cost-effective method of creating a talking paper application. The authoring tools provide a framework for creating audio content and image content and interactively linking the audio content and the image content. The authoring tools also provide for verifying the interactively linked audio and image content, reviewing the audio content, the image content and the interactive linking on a display device. Finally, the authoring tools provide for saving the audio content, the video content and the interactive linking for publication to a manufacturer for integration in an end user platform or talking paper platform.

First claim

The invention claimed is:

1. A method comprising:
under control of one or more processors configured with executable instructions:
creating an audio component and an image component, the creating comprising:
converting a printed or computer document into audio and images using at least one of optical character recognition, text summarization or text-to-speech technology; and
providing a user interface for a user to customize the audio and the images to create the audio component and the image component;
linking a portion of the audio component with a portion of the image component with a link;
presenting the audio component, the image component and the link on an electronic viewing device for review by the user, the presenting enabling verification of at least one of:
whether the link between the audio component and the image component exists,
whether the link between the audio component and the image component includes an end to avoid infinite looping, or
whether a link path of the link between the audio component and the image component is accessible; and

saving the audio component, the image component and the link in a format to allow for integration into an end user platform, the format being selected from a plurality of formats for presenting the image component in a digital medium or printed medium upon integration in the end user platform and the audio component to be activated upon accessing the portion of the image component in the digital medium or the printed medium, wherein the format is selected from the plurality of formats based at least in part on a determination of whether the image component is to be presented in the digital medium or printed medium.

2. The method as recited in claim 1 , wherein the creating further comprises:
enabling a selection of an audio file from a library of audio content to create the audio component; and
enabling a selection of an image file from a library of image content to create the image component.

3. The method as recited in claim 1 , further comprising adding a number or symbol on the image component to enable playing of the audio component when consuming the image component using a mobile device.

4. The method as recited in claim 1 , wherein the end user platform comprises at least one of an educational talking book, an electronic greeting card or an audio tourbook.

5. One or more storage devices configured with executable instructions that, when executed by one or more processors, configure the one or more processors to perform acts comprising:
converting an electronic or printed document into audio and images using at least one of optical character recognition, text summarization or text-to-speech technology;
interactively linking a portion of the audio component with a portion of the image component with a link; and
saving the audio component, the image component and the link in a format to allow for integration into an end user platform, the format being selected from a plurality of formats for presenting the image component in an electronic medium or a printed medium upon integration in the end user platform and the audio component to be activated upon accessing the portion of the image component in the electronic medium or the printed medium, wherein the format is selected from the plurality of formats based at least in part on a determination of whether the image component is to be presented in the electronic medium or the printed medium.

6. The one or more storage devices as recited in claim 5 , the acts further comprising:
enabling a selection of an audio file from a library of audio content to create the audio component; and
enabling a selection of an image file from a library of image content to create the image component.

7. The one or more storage devices as recited in claim 1 , the acts further comprising providing a user interface for a user to customize the audio and the images to create the audio component and the image component.

8. The one or more storage devices as recited in claim 5 , the acts further comprising presenting the audio component, the image component and the link on an electronic viewing device for review by a user, the presenting enabling verification of whether the link between the audio component and the image component is accurate and/or compatible.

9. The one or more storage devices as recited in claim 8 , wherein the verification of whether the link between the audio component and the image component is accurate and/or compatible comprises verification of at least one of:
whether the link between the audio component and the image component exists;
whether the link between the audio component and the image component includes an end to avoid an infinite looping; or
whether a link path of the link between the audio component and the image component is accessible.

10. The one or more storage devices as recited in claim 8 , the acts further comprising in response to verifying that the link between the audio component and the image component is not accurate and/or compatible, presenting an interface allowing a user to revise some or all of the audio component, the image component and the link on the electronic viewing device.

11. The one or more storage devices as recited in claim 5 , the acts further comprising adding a number or symbol on the image component to enable playing of the audio component when consuming the image component using a mobile device.

12. The one or more storage devices as recited in claim 5 , wherein the end user platform comprises an educational talking book, an electronic greeting card and/or an audio tourbook.

13. A system comprising:
one or more processors;
memory, communicatively coupled to the one or more processors, storing instructions that, when executed by the one or more processors, configure the one or more processors to perform acts comprising:
creating an audio component and an image component, the creating comprising:
providing a first option to allow a user to select an audio file from a library of audio content to create the audio component, and
providing a second option to allow the user to select an image file from a library of image content to create the image component;

linking a portion of the audio component with a portion of the image component with a link;
presenting the audio component, the image component and the link on an electronic viewing device for review by the user; and
saving the audio component, the image component and the link in a format to allow for integration into an end user platform, the format being selected from a plurality of formats for presenting the image component in a digital medium or a printed medium upon integration in the end user platform and the audio component to be activated upon accessing the portion of the image component in the digital medium or the printed medium, wherein the format is selected from the plurality of formats based at least in part on a determination of whether the image component is to be presented in the digital medium or the printed medium.

14. The system as recited in claim 13 , wherein the creating further comprises:
converting a digital or printed document into audio and images using optical character recognition, text summarization and/or text-to-speech technology; and
providing a user interface for the user to customize the audio and the images to create the audio component and the image component.

15. The system as recited in claim 13 , wherein the presenting enables verification of:
whether the link between the audio component and the image component exists,
whether the link between

Assignees

• Toyama Kentaro
• Chu Gerald
• Balakrishnan Ravin
• Microsoft Technology Licensing Llc

Inventors

• Toyama Kentaro
• Chu Gerald
• Balakrishnan Ravin

Classifications

• G06F16/4393

  Multimedia presentations, e.g. slide shows, multimedia albums · CPC title

• G09B5/065

  Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G06F17/30056

  Physics · mapped topic