Translating language characters in media content

Patent metadata

Field	Value
Publication number	US-9251144-B2
Application number	US-201113277109-A
Country	US
Kind code	B2
Filing date	Oct 19, 2011
Priority date	Oct 19, 2011
Publication date	Feb 2, 2016
Grant date	Feb 2, 2016

Abstract

Some implementations disclosed herein provide techniques and arrangements to enable translating language characters in media content. For example, some implementations receive a user selection of a first portion of media content. Some implementations disclosed herein may, based on the first portion, identify a second portion of the media content. The second portion of the media content may include one or more first characters of a first language. Some implementations disclosed herein may create an image that includes the second portion of the media content and may send the image to a server. Some implementations disclosed herein may receive one or more second characters of a second language corresponding to a translation of the one or more first characters of the first language from the server.

First claim

The invention claimed is:

1. A method comprising:
displaying, on a display device, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle relative to an edge of the display device;
receiving, by an input device, a swipe gesture selecting a first portion of the image that includes at least part of the at least one word, wherein the swipe gesture is performed at approximately the non-horizontal angle;
identifying, using edge-based text detection, a second portion of the image based at least in part on the first portion of the image, the second portion of the image including the at least one word;
sending the second portion of the image to a server;
receiving, from the server, one or more translated words in a second language corresponding to a translation of the at least one word of the one or more words in the first language; and
displaying, on the display device, the one or more translated words.

2. The method of claim 1 , further comprising converting the one or more translated words to audio output via a text to speech synthesizer.

3. The method of claim 1 , further comprising displaying search results associated with performing a search based on the one or more translated words in the second language, the search results received from the server.

4. The method of claim 1 , further comprising displaying search results associated with performing a search based on the at least one word of the one or more words in the first language, the search results received from the server.

5. The method of claim 1 , wherein the second portion of the image comprises a second image that is created based at least in part on down-sampling the second portion of the image.

6. The method of claim 1 , further comprising:
displaying a callout window that includes the first portion of the image.

7. The method of claim 6 , further comprising:
receiving one or more corrective gestures to adjust at least one of a height or a width of the callout window.

8. The method of claim 1 , wherein the one or more translated words in the second language comprise a word-for-word translation corresponding to the at least one word of the one or more words in the first language.

9. The method of claim 1 , wherein the one or more translated words in the second language comprise a phrase-based translation corresponding to the at least one word of the one or more words in the first language.

10. The method of claim 1 , wherein the image comprises a frame of a video.

11. A device comprising:
a touchscreen display;
one or more processors; and
computer-readable storage media including instructions executable by the one or more processors to perform operations comprising:
displaying, by the touchscreen display, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle relative to an edge of the touchscreen display;
receiving, by the touchscreen display, a swipe gesture selecting a first portion of the image that includes at least part of the at least one word, wherein the swipe gesture is performed at approximately the non-horizontal angle;
identifying, using edge-based text detection, a second portion of the image based at least in part on the first portion of the image, the second portion of the image including the at least one word;
sending the second portion of the image that includes the at least one word to a server;
receiving, from the server, a translation comprising one or more translated words in a second language, the translation corresponding to the at least one word of the one or more words in the first language; and
displaying the translation by the touchscreen display.

12. The device of claim 11 , the operations further comprising extracting one or more characters from the second portion of the image.

13. The device of claim 11 , the operations further comprising:
receiving, from the server, search results associated with performing a search based on at least one of:
the at least one word of the one or more words in the first language; or
the one or more translated words in the second language; and

displaying the search results.

14. The device of claim 11 , wherein the image comprises a frame of a video.

15. The device of claim 11 , the operations further comprising:
down-sampling the second portion of the image before sending the second portion of the image to the server.

16. The device of claim 11 , the operations further comprising:
displaying a callout window that includes the first portion of the image;
receiving a corrective gesture; and
adjusting at least one of a height or a width of the callout window based at least in part on the corrective gesture.

17. One or more computer-readable storage media including instructions executable by the one or more processors to perform operations comprising:
displaying, on a display device, an image that includes one or more words in a first language, wherein at least one word of the one or more words is displayed at a non-horizontal angle relative to an edge of the display device;
receiving, from an input device, a swipe gesture selecting a first portion of the image that includes at least part of the at least one word of the one or more words, wherein the swipe gesture is at approximately the non-horizontal angle;
identifying, using edge-based text detection, a second portion of the image that includes the at least one word of the one or more words;
sending the second portion of the image to a server;
receiving, from the server, one or more translated words in a second language corresponding to the at least one word of the one or more words in the first language; and
displaying, on the display device, the one or more translated words in the second language.

18. The one or more computer-readable storage media of claim 17 , the operations further comprising:
receiving, from the server, search results associated with performing a search based on at least one of:
the at least one word of the one or more words in the first language; or
the one or more translated words in the second language; and

displaying the search results.

19. The one or more computer-readable storage media of claim 17 , the operations further comprising:
displaying, on the display device, a callout window that includes the first portion of the image;
receiving one or more corrective gestures; and
adjusting at least one of a height or a width of the callout window based at least in part on the one or more corrective gestures.

20. The one or more computer-readable storage media of claim 17 , the operations further comprising:
down-sampling the second portion of the image before sending the second portion of the image to the server.

Assignees

• Du Jun
• Sun Lei
• Sun Jian
• Huo Qiang
• Microsoft Technology Licensing Llc

Inventors

• Du Jun
• Sun Lei
• Sun Jian
• Huo Qiang

Classifications

• G06F40/58 Primary

  Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation · CPC title

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F16/5846

  using extracted text · CPC title

• G06F17/30253

  Physics · mapped topic