Translation display device, translation display method, and control program

Patent metadata

Field	Value
Publication number	US-9826158-B2
Application number	US-201415038492-A
Country	US
Kind code	B2
Filing date	Aug 8, 2014
Priority date	Nov 27, 2013
Publication date	Nov 21, 2017
Grant date	Nov 21, 2017

Abstract

A translation display device of the present invention carries out a translation process of translating text extracted from a certain image and displays translated text while a display frame rate is maintained. A translation processing section ( 5 ) carries out the translation process in a case where no image other than the certain image is being subjected to the translation process. An image movement analyzing section ( 7 ) identifies a displacement of a position of an object in a most recent image which has been most recently obtained, the displacement being measured with respect to a reference position of an object in a reference image for which the translation process most recently ended. A generated image in which translated text obtained by translating extracted text extracted from the reference image is displayed so as to be superimposed on the most recent image in accordance with (i) a position of the extracted text and (ii) information on the displacement.

First claim

The invention claimed is:

1. A translation display device comprising:
a processor and an associated memory; wherein
the processor:
sequentially obtains images;
performs a translation process of translating text extracted from any given image, and subjects a certain image to the translation process in a case where the certain image is obtained while no image other than the certain image is being subjected to the translation process; and
identifies movement information indicative of a displacement of a position of an object in a most recent image which has been most recently obtained, the displacement being measured with respect to a reference position of an object in a reference image for which the translation process most recently ended; and

the translation display device further includes a display that displays a generated image in which translated text obtained by translating extracted text extracted from the reference image is superimposed on the most recent image in accordance with (i) a position of the extracted text and (ii) the movement information, and a sensor that detects a movement of a camera, wherein
the processor obtains an image captured by the camera, and
in a case where a value concerning the movement of the camera with respect to a reference state of the camera at a time point at which the reference image was captured by the camera exceeds a predetermined range, (i) the processor does not identify movement information and (ii) the display displays the image obtained by the processor while the image has not been subjected to any process after being obtained.

2. The translation display device as set forth in claim 1 , wherein the value concerning the movement of the camera with respect to the reference state of the camera at the time point at which the reference image was captured is any one of (i) an angle by which the camera has rotated, (ii) a speed at which the camera has moved, and (iii) a distance by which the camera has moved.

3. A method of displaying a translation, comprising the steps of:
(a) sequentially obtaining images;
(b) carrying out a translation process of translating text extracted from any given image, the step (b) being carried out so that a certain image is subjected to the translation process in a case where the certain image is obtained while no image other than the certain image is being subjected to the translation process;
(c) identifying movement information indicative of a displacement of a position of an object in a most recent image which has been most recently obtained in the step (a), the displacement being measured with respect to a reference position of an object in a reference image for which the translation process most recently ended in the step (b);
(d) displaying a generated image in which translated text obtained by translating extracted text extracted from the reference image is superimposed on the most recent image in accordance with (i) a position of the extracted text and (ii) the movement information;
(e) obtaining a movement of a camera detected by a sensor; and
(f) obtaining an image captured by the camera, wherein
in a case that a value concerning the movement of the camera with respect to a reference state of the camera at a time point at which the reference image was captured by the camera exceeds a predetermined range, (i) not identifying any movement information and (ii) displaying the image obtained in the step (f) while the image has not been subjected to any process after being obtained.

Assignees

• Sharp Kk

Inventors

• Mitsunaga Takaaki
• Kishimoto Tatsuo
• Ohtsuka Kiyofumi
• Ishikawa Hirokazu

Classifications

• H04N23/681

  Motion detection · CPC title

• G06F3/14 Primary

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• G09G2320/0261

  in the context of movement of objects on the screen or movement of the observer relative to the screen · CPC title

• G09G2340/12

  Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels · CPC title