Operation apparatus having a voice generator,information processing system having the same, and operation method using the same

Patent metadata

Field	Value
Publication number	US-10320996-B2
Application number	US-201715689354-A
Country	US
Kind code	B2
Filing date	Aug 29, 2017
Priority date	Oct 18, 2016
Publication date	Jun 11, 2019
Grant date	Jun 11, 2019

Abstract

An operation apparatus operates an electronic device. The operation apparatus includes a receiver configured to receive a first image from the electronic device; an image generator configured to generate a second image including the first image received by the receiver; a message setter configured to set a message corresponding to a status of the electronic device, with respect to the first image included in the second image; a display configured to display the second image; and a voice sound outputter configured to output, by voice sound, the message set with respect to the first image, in response to a user operating the first image included in the second image being displayed.

First claim

What is claimed is:

1. An operation apparatus for operating an electronic device, the operation apparatus comprising:
a processor that is configured to:
to receive a first image from the electronic device;
generate a second image including the first image received by the processor;
set a message corresponding to a status of the electronic device, with respect to the first image included in the second image;
cause a display to display the second image;
cause a speaker to output, by voice sound, the message set with respect to the first image, in response to a user operating the first image included in the second image being displayed,
request the electronic device to start operating an application, in response to a user operation with respect to an operation screen displayed by the display,
receive, from the electronic device, the first image corresponding to the application that has been requested to start operating, and
set the message reporting that the application will start operating, with respect to the first image included in the second image.

2. The operation apparatus according to claim 1 , wherein
the processor is further to:
generate at least one image element, and generates the second image including the generated at least one image element and the first image received by the processor,
request the electronic device to stop operating the application, in response to a user operation with respect to the at least one image element included in the second image displayed by the display, and
delete the message set with respect to the first image included in the second image, in response to the user operation with respect to the at least one image element.

3. The operation apparatus according to claim 1 , wherein
the processor is further to:
receive, from the electronic device, an error report including the first image corresponding to an error, in response to the error occurring in the electronic device when the operation screen is displayed by the display,
generate the second image including the first image corresponding to the error, in response to the error report,
set the message reporting that the error has occurred, with respect to the first image included in the error report, in response to the error report, and
cause the display to display the second image generated by the image generator, in response to the error report.

4. The operation apparatus according to claim 3 , wherein
the processor is further to:
receive, from the electronic device, an error resolution report indicating that the error has been resolved, in response to the error, which has occurred in the electronic device, being resolved,
delete the message set with respect to the first image included in the second image, in response to the error resolution report, and
cause the display to display the operation screen displayed when the error has occurred, in response to the error resolution report.

5. An information processing system comprising:
an electronic device; and
an operation apparatus for operating the electronic device, the electronic device and the operation apparatus being communicatively coupled to each other, wherein
the electronic device includes:
an acquirer to acquire a first image, and
a transmitter to send the acquired first image to the operation apparatus, and wherein

the operation apparatus includes:
a processor that is to:
to receive the first image from the electronic device;
generate a second image including the first image received by the processor;
set a message corresponding to a status of the electronic device, with respect to the first image included in the second image;
cause a display to display the second image;
cause a speaker to output, by voice sound, the message set with respect to the first image, in response to a user operating the first image included in the second image being displayed,
request the electronic device to start operating an application, in response to a user operation with respect to an operation screen displayed by the display,
receive, from the electronic device, the first image corresponding to the application that has been requested to start operating, and
set the message reporting that the application will start operating, with respect to the first image included in the second image.

6. The information processing system according to claim 5 , wherein
the processor is further to:
generate at least one image element, and generate the second image including the generated at least one image element and the first image received by the processor,
request the electronic device to stop operating the application, in response to a user operation with respect to the at least one image element included in the second image displayed by the display, and
delete the message set with respect to the first image included in the second image, in response to the user operation with respect to the at least one image element.

7. The information processing system according to claim 5 , wherein
the processor is further to:
receive, from the electronic device, an error report including the first image corresponding to an error, in response to the error occurring in the electronic device when the operation screen is displayed by the display,
generate the second image including the first image corresponding to the error, in response to the error report,
set the message reporting that the error has occurred, with respect to the first image included in the error report, in response to the error report, and
cause the display to display the second image generated by the image generator, in response to the error report.

8. The information processing system according to claim 7 , wherein
the processor is further to:
receive, from the electronic device, an error resolution report indicating that the error has been resolved, in response to the error, which has occurred in the electronic device, being resolved,
delete the message set with respect to the first image included in the second image, in response to the error resolution report, and
cause the display to display the operation screen displayed when the error has occurred, in response to the error resolution report.

9. A method executed by a computer for operating an electronic device, the method comprising:
receiving a first image from the electronic device;
generating a second image including the received first image;
setting a message corresponding to a status of the electronic device, with respect to the first image included in the second image;
displaying the second image;
outputting, by voice sound, the message set with respect to the first image, in response to a user operating the first image included in the second image being displayed, and
requesting the electronic device to start operating an application, in response to a user operation with respect to an operation screen being displayed, wherein
the receiving includes receiving, from the electronic device, the first image corresponding to the application that has been requested to start operating, and
the setting includes setting the message reporting that the application will start operating, with respect to the first image included in the second image.

10. The method according to claim 9 , wherein
the generating includes generating at least one image element, and generating the second image including the generated at least one image element and the received first image,
the requesting includes requesting the electronic device to stop operating the application, in response to a user operation with respect to the at least one image element included in the second image being displayed, and
the setting inclu

Assignees

• Kubo Shuko
• Ricoh Co Ltd

Inventors

• Kubo Shuko

Classifications

• H04N1/32582

  Output interface · CPC title

• G06F3/1229

  Printer resources management or printer maintenance, e.g. device status, power levels · CPC title

• H04N1/00384 Primary

  Key input means, e.g. buttons or keypads (electromechanical details of key input means in general H01H13/00) · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G10L13/00

  Speech synthesis; Text to speech systems · CPC title