Image processing apparatus, image processing method, and recording medium

Patent metadata

Field	Value
Publication number	US-10290078-B2
Application number	US-201715642696-A
Country	US
Kind code	B2
Filing date	Jul 6, 2017
Priority date	Jul 14, 2016
Publication date	May 14, 2019
Grant date	May 14, 2019

Abstract

An image processing apparatus includes circuitry that converts user voices that are input into a string of characters reflecting a statement made with the user voices, retrieves one or more items of information related to the string, stores the information being retrieved associated with identification information indicating a retrieval time when the information is retrieved, draws a graphical image including the information being stored on a projection target image to be projected by a projector, and controls the projector to project the projection target image including the graphical image, the graphical image having a size that is determined in accordance with the identification information associated with the information included in the graphical image being projected.

First claim

The invention claimed is:

1. An image processing apparatus, comprising:
circuitry to
convert user voices that are input into a string of characters reflecting a statement made with the user voices;
retrieve information related to the string;
store the information in association with identification information indicating a retrieval time at which the information is retrieved;
draw a graphical image including the information on a projection target image to be projected by a projector; and
control the projector to project the projection target image including the graphical image, the graphical image having a size that is determined based on the identification information indicating the retrieval time of the information included in the graphical image being projected.

2. The image processing apparatus according to claim 1 ,
wherein the circuitry is further configured to control the size of the graphical image being projected, such that a first graphical image including the information whose retrieval time is relatively later is displayed in size smaller than a size of a second graphical image including second information whose retrieval time is relatively earlier.

3. The image processing apparatus according to claim 1 ,
wherein the circuitry is further configured to erase, from the projection target image, the graphical image including the retrieved information before a first time counted from a latest retrieval.

4. The image processing apparatus according to claim 1 ,
wherein the circuitry is further configured to:
detect a user operation performed on a projection surface on which the projection target image is projected; and
enlarge the graphical image displayed near a position where the user operation is detected to a predetermined size.

5. The image processing apparatus according to claim 4 ,
wherein the circuitry is further configured to enlarge the graphical image to the predetermined size, when the graphical image displayed near the position where the user operation is detected includes the information retrieved after a second time counted from a latest retrieval.

6. The image processing apparatus according to claim 4 ,
wherein the circuitry is further configured to maintain a size of the graphical image whose size is the predetermined size regardless of the retrieval time, when the information included in the graphical image is retrieved.

7. The image processing apparatus according to claim 5 ,
wherein the circuitry is further configured to:
maintain a size of the graphical image whose size is the predetermined size regardless of the retrieval time, when the information included in the graphical image is retrieved; and
when the graphical image that includes the information retrieved after the second time counted from the latest retrieval is not near the position where the user operation is detected, determine to draw or erase the graphical image of the predetermined size depending on the retrieval time, when the information included in the graphical image is retrieved.

8. The image processing apparatus according to claim 1 ,
wherein the circuitry is further configured to retrieve an image related to the string as the information related to the string.

9. The image processing apparatus of claim 1 , wherein the circuitry is further configured to retrieve other information related to the string, draw another graphical image including the other information, and control the projector to project the projection target image, which includes the graphical image and the another graphical image, so that the graphical image and the another graphical image have a same size.

10. A method of processing an image performed by an image processing apparatus, the method comprising:
converting user voices that are input into a string of characters reflecting a statement made with the user voices;
retrieving information related to the string;
storing the information in association with identification information indicating a retrieval time at which the information is retrieved;
drawing a graphical image including the information on a projection target image to be projected by a projector; and
controlling the projector to project the projection target image including the graphical image, the graphical image having a size that is determined based on the identification information indicating the retrieval time of the information included in the graphical image being projected.

11. The method of processing an image according to claim 10 , further comprising:
controlling the size of the graphical image being projected, such that a first graphical image including first information whose retrieval time is relatively later is displayed in size smaller than a size of a second graphical image including second information whose retrieval time is relatively earlier.

12. The method of processing an image according to claim 10 , further comprising:
erasing, from the projection target image, the graphical image including the retrieved information before a first time counted from a latest retrieval.

13. The method of processing an image according to claim 10 , further comprising:
detecting a user operation performed on a projection surface on which the projection target image is projected; and
enlarging the graphical image displayed near a position where the user operation is detected to a predetermined size.

14. The method of processing an image according to claim 13 , further comprising:
enlarging the graphical image to the predetermined size, when the graphical image displayed near the position where the user operation is detected includes the information retrieved after a second time counted from a latest retrieval.

15. The method of processing an image according to claim further comprising:
maintaining a size of the graphical image whose size is the predetermined size regardless of the retrieval time, when the information included in the graphical image is retrieved.

16. The method of processing an image according to claim 14 , further comprising:
maintaining a size of the graphical image whose size is the predetermined size regardless of the retrieval time, when the information included in the graphical image is retrieved; and
when the graphical image that includes the information retrieved after the second time counted from the latest retrieval is not near the position where the user operation is detected, determining to draw or erase the graphical image of the predetermined size depending on the retrieval time, when the information included in the graphical image is retrieved.

17. The method of processing an image according to claim 10 , the method further comprising:
retrieving an image related to the string as the information related to the string.

18. A non-transitory computer-readable recording medium storing a program that, when executed by one or more processors of an image processing apparatus, causes the one or more processors to implement a method of processing an image, comprising:
converting user voices that are input into a string of characters reflecting a statement made with the user voices;
retrieving information related to the string;
storing the information in association with identification information indicating a retrieval time at which the information is retrieved;
drawing a graphical image including the information on a projection target image to be projected by a projector; and
controlling the projector to project the projection target image including the graphical image, the graphical image having a s

Assignees

• Fujiyama Ryotaro
• Ishida Takashi
• Tsuruoka Naoto
• Hashimoto Kyoko
• Yamauchi Shin
• Ricoh Co Ltd

Inventors

• Fujiyama Ryotaro
• Ishida Takashi
• Tsuruoka Naoto
• Hashimoto Kyoko
• Yamauchi Shin

Classifications

• G06F2203/04808

  Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen · CPC title

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06T3/40 Primary

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06F3/038 Primary

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title