Techniques for distributed optical character recognition and distributed machine language translation

Patent metadata

Field	Value
Publication number	US-9514376-B2
Application number	US-201414264296-A
Country	US
Kind code	B2
Filing date	Apr 29, 2014
Priority date	Apr 29, 2014
Publication date	Dec 6, 2016
Grant date	Dec 6, 2016

Abstract

A technique for selectively distributing OCR and/or machine language translation tasks between a mobile computing device and server(s) includes receiving, at the mobile computing device, an image of an object comprising a text. The mobile computing device can determine a degree of optical character recognition (OCR) complexity for obtaining the text from the image. Based on this degree of OCR complexity, the mobile computing device and/or the server(s) can perform OCR to obtain an OCR text. The mobile computing device can then determine a degree of translation complexity for translating the OCR text from its source language to a target language. Based on this degree of translation complexity, the mobile computing device and/or the server(s) can perform machine language translation of the OCR text from the source language to a target language to obtain a translated OCR text. The mobile computing device can then output the translated OCR text.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
during an image capture mode, receiving, at a mobile computing device having one or more processors, an image capture request;
in response to receiving the image capture request:
capturing, at the mobile computing device, an image of an object comprising a text in a source language;
determining, at the mobile computing device, a degree of optical character recognition (OCR) complexity for performing OCR on the image to obtain the text;
when the degree of OCR complexity is less than a first OCR complexity threshold representing a degree of OCR complexity that the mobile computing device is appropriate for performing, performing, at the mobile computing device, OCR on the image to obtain an OCR text; and
when the degree of OCR complexity is greater than the first OCR complexity threshold:
(i) transmitting, from the mobile computing device, at least a portion of the image to a first server, and
(ii) receiving, at the mobile computing device at least a portion of the OCR text from the first server;

in response to receiving the image capture request and obtaining the OCR text, determining, at the mobile computing device, whether to translate the OCR text to a different target language; and
in response to determining to translate the OCR text to the target language:
determining, at the mobile computing device, a degree of translation complexity for translating the OCR text from the source language to the target language;
when the degree of translation complexity is less than a first translation complexity threshold representing a degree of translation complexity that the mobile computing device is appropriate for performing, performing, at the mobile computing device, machine language translation of the OCR text from the source language to the target language to obtain a translated OCR text in the target language;
when the degree of translation complexity is greater than the first translation complexity threshold:
(i) transmitting at least a portion of the OCR text to a second server, and
(ii) receiving at least a portion of the translated OCR text from the second server;

obtaining, at the mobile computing device, a modified image by modifying (i) the image to replace the text with the translated OCR text and (ii) a styling of the translated OCR text such that its styling differs from a styling of the text; and
outputting, at a display of the mobile computing device, the modified image.

2. The computer-implemented method of claim 1 , wherein when the degree of OCR complexity is greater than the first OCR complexity threshold and less than a second OCR complexity threshold:
transmitting, from the mobile computing device, at least the portion of the image to the first server; and
receiving, at the mobile computing device, at least the portion of the OCR text from the first server.

3. The computer-implemented method of claim 2 , wherein the second OCR complexity threshold represents a degree of OCR complexity that the mobile computing device is not appropriate for performing and the first server is appropriate for performing, and wherein when the degree of OCR complexity is greater than the second OCR complexity threshold:
transmitting, from the mobile computing device, all of the image to the first server; and
receiving, at the mobile computing device, all of the OCR text from the first server.

4. The computer-implemented method of claim 1 , wherein when the degree of translation complexity is greater than the first translation complexity threshold and less than a second translation complexity threshold:
transmitting, from the mobile computing device, at least the portion of the OCR text to the second server; and
receiving, at the mobile computing device, at least the portion of the translated OCR text from the second server.

5. The computer-implemented method of claim 4 , wherein the second translation complexity threshold represents a degree of translation complexity that the mobile computing device is not appropriate for performing and the second server is appropriate for performing, and wherein when the degree of OCR complexity is greater than the second translation complexity threshold:
transmitting, from the mobile computing device, all of the OCR text to the second server; and
receiving, at the mobile computing device, all of the translated OCR text from the first server.

6. The computer-implemented method of claim 1 , wherein the translated OCR text includes first and second portions corresponding to machine language translation by the mobile computing device and the second server, respectively, wherein the modified image includes the first portion of the translated OCR text in place of a corresponding portion of the text, and further comprising:
modifying, at the mobile computing device, the modified image to include the second portion of the translated OCR text in place of a corresponding portion of the text to obtain a further modified image; and
outputting, at the display of the mobile computing device, the further modified image.

7. The computer-implemented method of claim 6 , wherein the modified image is displayed while awaiting the second portion of the translated OCR text from the second server and before displaying the further modified image.

8. The computer-implemented method of claim 1 , wherein determining whether to translate the OCR text from the source language to the target language includes determining whether the source language is a preferred language of a user associated with the mobile computing device.

9. The computer-implemented method of claim 1 , wherein the styling of the translated OCR text is italics.

10. The computer-implemented method of claim 1 , wherein the styling of the translated OCR text is outlined or bordered.

11. A mobile computing device having one or more processors configured to perform operations comprising:
during an image capture mode, receiving an image capture request;
in response to receiving the image capture request:
capturing an image of an object comprising a text in a source language;
determining a degree of optical character recognition (OCR) complexity for performing OCR on the image to obtain the text;
when the degree of OCR complexity is less than a first OCR complexity threshold representing a degree of OCR complexity that the mobile computing device is appropriate for performing, performing OCR on the image to obtain an OCR text; and
when the degree of OCR complexity is greater than the first OCR complexity threshold:
(i) transmitting, via a communication device, at least a portion of the image to a first server, and
(ii) receiving, via the communication device, at least a portion of the OCR text from the first server;

in response to receiving the image capture request and obtaining the OCR text, determining whether to translate the OCR text to a different target language; and
in response to determining to translate the OCR text to the target language:
determining a degree of translation complexity for translating the OCR text from the source language to the target language;
when the degree of translation complexity is less than a first translation complexity threshold representing a degree of translation complexity that the mobile computing device is appropriate for performing, performing machine language translation of the OCR text from the source language to a target language to obtain a translated OCR text in the target language;
when the degree of translation complexity is greater than the first translation complexity threshold:
(i) transmitting, via the communication device, at least a portion of the OCR text t

Assignees

• Google Inc

Inventors

• Cuthbert Alexander Jay
• Xu Peng

Classifications

• G06V10/95

  structured as a network, e.g. client-server architectures · CPC title

• G06F40/58 Primary

  Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation · CPC title

• G06V30/10

  Character recognition · CPC title

• G06F17/289

  Physics · mapped topic

• G06K2209/01

  Physics · mapped topic