Information processing device

Patent metadata

Field	Value
Publication number	US-11068652-B2
Application number	US-201616339990-A
Country	US
Kind code	B2
Filing date	Nov 4, 2016
Priority date	Nov 4, 2016
Publication date	Jul 20, 2021
Grant date	Jul 20, 2021

Abstract

An information processing device (10) includes: a morphological analysis unit (11a, 11b) performing morphological analysis to divide each of an article body text included in an article and a caption of each of images into morphemes; a phrase acquiring unit (12) dividing the article body text into phrases on a basis of a result of the morphological analysis performed by the morphological analysis unit (11b); and a correspondence determining unit (13). The correspondence determining unit (13) determines correspondence between each of the phrases of the article body text and the images by calculating a correlation between the caption and each of the phrases of the article body text on a basis of the result of the morphological analysis performed by the morphological analysis unit (11a).

First claim

The invention claimed is:

1. An information processing device comprising:
a processor to execute a program; and
a memory to store the program which, when executed by the processor, performs processes of,
performing morphological analysis to divide each of an article body text included in an article and a caption of each of images into morphemes;
dividing the article body text into phrases on a basis of a result of the morphological analysis;
generating a caption abstract by abstracting the caption; and
determining correspondence between each of the phrases of the article body text and the images by calculating a correlation between the caption abstract and each of the phrases of the article body text on a basis of the result of the morphological analysis.

2. An information processing device comprising:
a processor to execute a program; and
a memory to store the program which, when executed by the processor, performs processes of,
performing morphological analysis to divide each of an article body text included in an article and a caption of each of images into morphemes;
dividing the article body text into phrases on a basis of a result of the morphological analysis;
dividing the article body text into meaningful chunks by acquiring a dependency relation between the phrases of the article body text; and
determining correspondence between each of the meaningful chunks of the article body text and the images by calculating a correlation between the caption and each of the meaningful chunks of the article body text.

3. The information processing device according to claim 2 , wherein the program, when executed by the processor, further performs processes of:
generating a caption abstract by abstracting the caption; and
determining correspondence between each of the meaningful chunks of the article body text and the images by calculating a correlation between the caption abstract and each of the meaningful chunks of the article body text.

4. An information processing device comprising:
a processor to execute a program; and
a memory to store the program which, when executed by the processor, performs processes of,
performing morphological analysis to divide each of an article body text included in an article and a caption of each of images into morphemes;
dividing the article body text into phrases on a basis of a result of the morphological analysis;
generating an article body text abstract by abstracting the article body text;
generating a caption abstract by abstracting the caption; and determining correspondence between each of the phrases included in the article body text abstract and the image by calculating a correlation between the caption abstract and each of the phrases included in the article body text abstract on a basis of the result of the morphological analysis.

5. The information processing device according to claim 4 , wherein the caption abstract is generated to include the article body text abstract.

6. An information processing device comprising:
a processor to execute a program; and
a memory to store the program which, when executed by the processor, performs processes of,
performing morphological analysis to divide each of an article body text included in an article and a caption of each of images into morphemes;
dividing the article body text into phrases on a basis of a result of the morphological analysis; and
determining correspondence between each of the phrases of the article body text and the images by calculating a correlation between the caption and each of the phrases of the article body text on a basis of the result of the morphological analysis; and
when there are multiple images each having correspondence with a sentence chunk including one or more sentences in the article body text, acquiring a significance degree of each of phrases of the article body text or a significance degree of each of meaningful chunks of the article body text on a basis of word significance degree information showing a significance degree of each word, and determining an image corresponding to a phrase or a meaningful chunk having a highest significance degree in the sentence chunk, as an image having correspondence with the sentence chunk.

Assignees

• Mitsubishi Electric Corp

Inventors

• Saito Tatsuhiko
• Koji Yusuke

Classifications

• G06F16/00

  Information retrieval; Database structures therefor; File system structures therefor · CPC title

• G06F40/205

  Parsing · CPC title

• G06F40/268 Primary

  Morphological analysis · CPC title

• G06F40/211

  Syntactic parsing, e.g. based on context-free grammar [CFG] or unification grammars · CPC title

• G06F16/345

  Summarisation for human users · CPC title