Information processing apparatus and method and non-transitory computer readable medium

Patent metadata

Field	Value
Publication number	US-2018246569-A1
Application number	US-201715688248-A
Country	US
Kind code	A1
Filing date	Aug 28, 2017
Priority date	Feb 27, 2017
Publication date	Aug 30, 2018
Grant date	—

Abstract

An information processing apparatus includes a matching unit and a generator. The matching unit matches a position of eye gaze of a user within a document to voice output from the user viewing the document at the position of eye gaze. The generator generates an annotation to be appended to a portion of the document located at the position of eye gaze. The annotation indicates the content of the voice.

First claim

What is claimed is:

1 . An information processing apparatus comprising:
a matching unit that matches a position of eye gaze of a user within a document to voice output from the user viewing the document at the position of eye gaze; and a generator that generates an annotation to be appended to a portion of the document located at the position of eye gaze, the annotation indicating the content of the voice.

2 . The information processing apparatus according to claim 1 , wherein the generator appends an annotation indicating the content of the voice to an object located at the position of eye gaze.

3 . The information processing apparatus according to claim 1 , wherein the generator generates an annotation indicating the content of a recognition result of the voice.

4 . The information processing apparatus according to claim 3 , wherein the generator changes a predetermined word included in the recognition result.

5 . The information processing apparatus according to claim 1 , wherein the generator generates an annotation from which a chronological change in the position of eye gaze is identifiable.

6 . The information processing apparatus according to claim 2 , wherein the generator generates an annotation from which a chronological change in the position of eye gaze is identifiable.

7 . The information processing apparatus according to claim 3 , wherein the generator generates an annotation from which a chronological change in the position of eye gaze is identifiable.

8 . The information processing apparatus according to claim 4 , wherein the generator generates an annotation from which a chronological change in the position of eye gaze is identifiable.

9 . The information processing apparatus according to claim 1 , wherein the generator generates an annotation to be appended to a portion other than a portion located at the position of eye gaze, the annotation indicating that the portion appended with the annotation is a portion of the document where eye gaze is not focused.

10 . The information processing apparatus according to claim 9 , wherein the generator appends the annotation to an object located at a portion other than a portion located at the position of eye gaze.

11 . An information processing method comprising:
matching a position of eye gaze of a user within a document to voice output from the user viewing the document at the position of eye gaze; and generating an annotation to be appended to a portion of the document located at the position of eye gaze, the annotation indicating the content of the voice.

12 . A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:
matching a position of eye gaze of a user within a document to voice output from the user viewing the document at the position of eye gaze; and generating an annotation to be appended to a portion of the document located at the position of eye gaze, the annotation indicating the content of the voice.

Assignees

• Fuji Xerox Co Ltd

Inventors

• Arakawa Takamasa
• Dai Jiahao

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/18

  using natural language modelling · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title