Systems and methods for incentivizing user feedback for translation processing
US-9665571-B2 · May 30, 2017 · US
US9881007B2 · US · B2
| Field | Value |
|---|---|
| Publication number | US-9881007-B2 |
| Application number | US-201514679224-A |
| Country | US |
| Kind code | B2 |
| Filing date | Apr 6, 2015 |
| Priority date | Feb 8, 2013 |
| Publication date | Jan 30, 2018 |
| Grant date | Jan 30, 2018 |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
Various embodiments described herein facilitate multi-lingual communications. The systems and methods of some embodiments enable multi-lingual communications through different modes of communication including, for example, Internet-based chat, e-mail, text-based mobile phone communications, postings to online forums, postings to online social media services, and the like. Certain embodiments implement communication systems and methods that translate text between two or more languages. Users of the systems and methods may be incentivized to submit corrections for inaccurate or erroneous translations, and may receive a reward for these submissions. Systems and methods for assessing the accuracy of translations are described.
Opening claim text (preview).
What is claimed is: 1. A computer-implemented method comprising: sending each proposal of a plurality of proposals at a different time to a client device of a user, the proposal comprising a respective request for the user to translate a respective text message and a respective incentive for the translation; receiving from the client device a plurality of translations authored by the user, each translation being associated with one of the proposals and being a translation of the text message of the associated proposal; for each proposal, comparing a plurality of features associated with the text message with a respective plurality of features associated with the translation to generate respective feature scores, the features comprising word-based features, language-based features, word alignment features, and combinations thereof, and calculating an accuracy based on a weighted combination of the respective feature scores wherein the weights are derived using a statistical regression to model accuracy of translations; identifying a deviation from a norm in user translation accuracy over a period of time based on the calculated accuracies; updating a confidence score for the user based on the deviation in user translation accuracy; and revoking the translation privileges of the user when the confidence score does not satisfy a threshold value. 2. The method of claim 1 , wherein the user is a participant in an online game, and wherein the respective incentive comprises at least one of a virtual good and a virtual currency for the online game. 3. The method of claim 1 , wherein identifying a deviation in user translation accuracy comprises using item response theory. 4. The method of claim 1 , further comprising: for a first translation of the translations, rewarding the user with the incentive of the proposal associated with the first translation when the first translation is determined to be accurate. 5. The method of claim 1 , wherein the word-based features comprise at least one of a word count, a character count, an emoji, a number, and a punctuation mark. 6. The method of claim 1 , wherein the language-based features comprise at least one of verbs, nouns, adverbs, and adjectives. 7. The method of claim 6 , wherein comparing the plurality of features comprises comparing a number of words having the part of speech in the text message with a number of words having the part of speech in the translation. 8. The method of claim 1 , wherein the word-alignment features comprise an alignment of at least one word in the text message with at least one respective word in the translation. 9. A system comprising: a non-transitory computer readable medium having instructions stored thereon; and at least one processor configured to execute the instructions to perform operations comprising: sending each proposal of a plurality of proposals at a different time to a client device of a user, the proposal comprising a respective request for the user to translate a respective text message and a respective incentive for the translation; receiving from the client device a plurality of translations authored by the user, each translation being associated with one of the proposals and being a translation of the text message of the associated proposal; for each proposal, comparing a plurality of features associated with the text message with a respective plurality of features associated with the translation to generate respective feature scores, the features comprising word-based features, language-based features, word alignment features, and combinations thereof, and calculating an accuracy based on a weighted combination of the respective feature scores wherein the weights are derived using a statistical regression to model accuracy of translations; identifying a deviation from a norm in user translation accuracy over a period of time based on the calculated accuracies; updating a confidence score for the user based on the deviation in user translation accuracy; and revoking the translation privileges of the user when the confidence score does not satisfy a threshold value. 10. The system of claim 9 , wherein the user is a participant in an online game, and wherein the respective incentive comprises at least one of a virtual good and a virtual currency for the online game. 11. The system of claim 9 , wherein identifying a deviation in user translation accuracy comprises using item response theory. 12. The system of claim 9 , further comprising: for a first translation of the translations, rewarding the user with the incentive of the proposal associated with the first translation when the first translation is determined to be accurate. 13. The system of claim 9 , wherein the word-based features comprise at least one of a word count, a character count, an emoji, a number, and a punctuation mark. 14. The system of claim 9 , wherein the language-based features comprise at least one of verbs, nouns, adverbs, and adjectives. 15. The system of claim 14 , wherein comparing the plurality of features comprises comparing a number of words having the part of speech in the text message with a number of words having the part of speech in the translation. 16. The system of claim 9 , wherein the word-alignment features comprise an alignment of at least one word in the text message with at least one respective word in the translation. 17. An article comprising: non-transitory computer readable media comprising executable instructions, the executable instructions being executable by one or more processors to perform operations comprising: sending each proposal of a plurality of proposals at a different time to a client device of a user, the proposal comprising a respective request for the user to translate a respective text message and a respective incentive for the translation; receiving from the client device a plurality of translations authored by the user, each translation being associated with one of the proposals and being a translation of the text message of the associated proposal; for each proposal, comparing a plurality of features associated with the text message with a respective plurality of features associated with the translation to generate feature scores, the features comprising word-based features, language-based features, word alignment features, and combinations thereof, and calculating an accuracy based on a weighted combination of the respective feature scores wherein the weights are derived using a statistical regression to model accuracy of translations; identifying a deviation from a norm in user translation accuracy over a period of time based on the calculated accuracies; updating a confidence score for the user based on the deviation in user translation accuracy; and revoking the translation privileges of the user when the confidence score does not satisfy a threshold value.
Office automation; Time management · CPC title
Computer-aided management of electronic mailing [e-mailing] · CPC title
Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation · CPC title
Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30) · CPC title
involving input on products or services in exchange for incentives or rewards · CPC title
Related publications grouped by family.
Answers are generated from the same data shown on this page.