Visual writing aid tool for a mobile writing device

Patent metadata

Field	Value
Publication number	US-10248652-B1
Application number	US-201715719989-A
Country	US
Kind code	B1
Filing date	Sep 29, 2017
Priority date	Dec 9, 2016
Publication date	Apr 2, 2019
Grant date	Apr 2, 2019

Abstract

Systems, methods, and apparatus of providing a visual writing aid are provided. In one example embodiment, a method includes obtaining data descriptive of a first set of information, wherein the first set of information is presented in a first language. The method includes determining a translation of the first set of information to a second language. The method includes presenting a visual representation of the translation of the first set of information in the second language via a display device. The method includes obtaining data descriptive of a second set of information. The second set of information includes a transcription of at least a portion of the first set of information in the second language generated via a mobile writing device. The method includes determining whether the second set of information corresponds to the visual representation of the translation of the first set of information in the second language.

First claim

What is claimed is:

1. A computer-implemented method of providing a visual writing aid in a second language, comprising:
obtaining, by one or more computing devices, data descriptive of a first set of information, wherein the first set of information is presented in a first language;
determining, by the one or more computing devices, a translation of the first set of information to a second language;
presenting, by the one or more computing devices, a visual representation of the translation of the first set of information in the second language via a display device;
obtaining, by the one or more computing devices, data descriptive of a second set of information, wherein the second set of information comprises a transcription of at least a portion of the translation of the first set of information in the second language, the transcription generated by a user of a mobile writing device via the mobile writing device; and
determining, by the one or more computing devices, whether the second set of information corresponds to the visual representation of the translation of the first set of information in the second language, whereby user aid in transcribing the translation is promoted.

2. The computer-implemented method of claim 1 , further comprising:
providing, by the one of more computing devices, feedback to a user of the mobile writing device indicating whether the second set of information corresponds to the translation of the first set of information.

3. The computer-implemented method of claim 2 , wherein the feedback comprises at least one of visual feedback, audio feedback, and haptic feedback.

4. The computer-implemented method of claim 1 , wherein determining, by the one or more computing devices, whether the second set of information corresponds to the visual representation of the translation of the first set of information in the second language comprises:
obtaining, by the one or more computing devices, data descriptive of a movement of the mobile writing device;
determining, by the one or more computing devices, a trajectory of the mobile writing device based at least in part on the movement of the mobile writing device; and determining, by the one or more computing devices, whether the second set of information corresponds to the visual representation of the translation of the first set of information based at least in part on the trajectory of the mobile writing device.

5. The computer-implemented method of claim 4 , wherein the one or more computing devices obtain the data descriptive of the movement of the mobile writing device while the transcription is being generated via the mobile writing device on a surface.

6. The computer-implemented method of claim 4 , wherein determining, by the one or more computing devices, whether the second set of information corresponds to the visual representation of the translation of the first set of information based at least in part on the trajectory of the mobile writing device comprises:
comparing, by the one or more computing devices, the trajectory of the mobile writing device to the visual representation of the translation of the first set of information in the second language; and
determining, by the one or more computing devices, whether the second set of information corresponds to the translation of the first set of information based at least in part on the comparison of the trajectory of the mobile writing device to the visual representation.

7. The computer-implemented method of claim 1 , wherein the visual representation is presented via a user interface that indicates a progress of the transcription.

8. The computer-implemented method of claim 1 , wherein the first set of information is presented on a surface, and wherein the first set of information is generated via the mobile writing device.

9. The computer-implemented method of claim 8 , wherein the one or more computing devices obtain the data descriptive of the first set of information while the first set of information is generated via the mobile writing device on the surface.

10. A computing system for providing a visual writing aid, the system comprising:
one or more processors;
one or more memory devices, the one or more memory devices storing instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising:
obtaining data descriptive of a first set of information in a first language;
presenting a visual representation of a translation of the first set of information in the second language via a display device;
obtaining data descriptive of a movement of a mobile writing device associated with a second set of information, wherein the second set of information comprises a transcription of at least a portion of the first set of information in the second language generated via the mobile writing device by a user of the mobile writing device; and
determining whether the second set of information corresponds to the translation of the first set of information in the second language based at least in part on the movement of the mobile writing device.

11. The computing system of claim 10 , wherein obtaining data descriptive of the movement of the mobile writing device associated with the second set of information comprises:
obtaining the data descriptive of the movement of the mobile writing device as the mobile writing device generates the transcription.

12. The computing system of claim 10 , wherein determining whether the second set of information corresponds to the translation of the first set of information in the second language based at least in part on the movement of the mobile writing device comprises:
determining a trajectory of the mobile writing device based at least in part on the movement of the mobile writing device; and
determining whether the second set of information corresponds to the translation of the first set of information based at least in part on the trajectory of the mobile writing device.

13. The computing system of claim 10 , wherein the first set of information is presented as written text on a first surface, and wherein the second set of information is presented at written text on a second surface that is different from the first surface.

14. The computing system of claim 10 , wherein the operations further comprise:
obtaining, from the mobile writing device, data descriptive of the translation of the first set of information in the second language.

15. The computing system of claim 10 , wherein the operations further comprise:
adjusting one or more elements of the visual representation to indicate a progress associated with the second set of information as the transcription is generated via the mobile writing device.

16. The computing system of claim 15 , wherein the progress is indicated by a change in one or more colors associated with the visual representation.

17. A user computing device comprising:
one or more display devices;
one or more processors; and
one or more memory devices, the one or more memory devices storing instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising:
obtaining data descriptive of a first set of information in a first language;
presenting a visual representation of a translation of the first set of information in the second language via the one or more display devices;
obtaining data descriptive of a second set of information, wherein the second set of information comprises a transcription of at least a port

Assignees

• Google Inc
• Google Llc

Inventors

• Venkataraman Vinay
• Aboussouan Eric
• Frakes David

Classifications

• G06V30/1423

  the instrument generating sequences of position coordinates corresponding to handwriting (preprocessing or recognising digital ink G06V30/32) · CPC title

• G06F40/51

  Translation evaluation · CPC title

• G06F3/03545 Primary

  Pens or stylus · CPC title

• G06F40/171

  by use of digital ink · CPC title

• G06F40/58

  Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation · CPC title