Communication system, display apparatus, and display control method

Patent metadata

Field	Value
Publication number	US-11978252-B2
Application number	US-202117499935-A
Country	US
Kind code	B2
Filing date	Oct 13, 2021
Priority date	Oct 13, 2020
Publication date	May 7, 2024
Grant date	May 7, 2024

Abstract

A communication system includes circuitry. The circuitry receives an input of language information. The circuitry performs recognition on the input language information. The circuitry displays one or more images corresponding to the input language information on a display, based on a result of the recognition.

First claim

The invention claimed is:

1. A communication system comprising circuitry configured to:
receive an input of language information;
perform recognition on the input language information; and
display one or more first images corresponding to the input language information in a predetermined area on a display, based on a result of the recognition,
wherein the circuitry further displays a second image corresponding to at least one of the first images based on the language information input by the user,
the circuitry recognizes the input language information as character information, and the one or more first images displayed on the display is one or more images corresponding to a keyword included in the character information,
the circuitry selects a particular image from the one or more images displayed on the display, and displays an image corresponding to the selected particular image on the display, and
the circuitry infers an image to be selected next based on a learned model obtained by performing machine learning using the character information and the particular image selected from the displayed one or more images corresponding to the keyword included in the character information as training data, and presents the inferred image to be selected next as an image to be preferentially displayed from among a plurality of images corresponding to the keyword included in the character information.

2. The communication system of claim 1 , wherein
the circuitry changes at least a part of a display appearance of the one or more images that are already displayed, to display another one or more images corresponding to a keyword included in character information recognized based on newly input language information on the display.

3. The communication system of claim 1 , wherein
the selected particular image is a thumbnail image of the image corresponding to the selected particular image.

4. The communication system of claim 1 , further comprising a memory that stores the keyword in association with the one or more images,
wherein the circuitry retrieves a keyword included in the character information, and
wherein the one or more images displayed on the display is one or more image stored in the memory in association with the retrieved keyword.

5. The communication system of claim 1 , wherein the display includes a display of a telepresence robot that is provided in a site and receives control by remote communication from an administrator terminal.

6. The communication system of claim 1 , wherein
the display includes a display of an administrator terminal that controls a telepresence robot by remote communication.

7. The communication system of claim 1 , wherein the displayed one or more images incudes a plurality of images, and
the circuitry selects an image corresponding to an operation by the user of selecting at least one image from the displayed plurality of images.

8. The communication system of claim 1 , wherein the circuitry is further configured to:
select an image corresponding to an operation by a user of selecting at least one image from the displayed one or more images; and
display an image corresponding to the selected image in an area within a display area on the display, the area being a different area from the predetermined area.

9. The communication system of claim 8 , wherein the communication system has a mode in which the image displayed in the different area is editable.

10. The communication system of claim 1 , wherein, in a case that one or more images corresponding to the input language information include a plurality of images, the circuitry determines a priority order in which the plurality of images is to be displayed in the predetermined area, and displays the plurality of images in the predetermined area in the determined priority order.

11. The communication system of claim 1 , wherein the circuitry is further configured to:
display character information corresponding to the input language information; and
display an image corresponding to selection by the user with respect to the displayed character information.

12. A display apparatus comprising circuitry configured to:
receive an input of language information;
perform recognition of the input language information;
display one or more first images corresponding to the input language information in a predetermined area on a display, based on a result of the recognition,
wherein the circuitry further displays a second image corresponding to at least one of the first images based on the language information input by the user,
the circuitry recognizes the input language information as character information, and the one or more first images displayed on the display is one or more images corresponding to a keyword included in the character information,
the circuitry selects a particular image from the one or more images displayed on the display, and displays an image corresponding to the selected particular image on the display, and
the circuitry infers an image to be selected next based on a learned model obtained by performing machine learning using the character information and the particular image selected from the displayed one or more images corresponding to the keyword included in the character information as training data, and presents the inferred image to be selected next as an image to be preferentially displayed from among a plurality of images corresponding to the keyword included in the character information.

13. A method for controlling display on a display apparatus, the method comprising:
receiving an input of language information;
performing recognition on the input language information;
displaying one or more first images corresponding to the input language information in a predetermined area on a display, based on a result of the recognition,
displaying a second image corresponding to at least one of the first images based on the language information input by the user,
recognizing the input language information as character information, wherein the one or more first images displayed on the display is one or more images corresponding to a keyword included in the character information,
selecting a particular image from the one or more images displayed on the display, and displaying an image corresponding to the selected particular image on the display, and
inferring an image to be selected next based on a learned model obtained by performing machine learning using the character information and the particular image selected from the displayed one or more images corresponding to the keyword included in the character information as training data, and presenting the inferred image to be selected next as an image to be preferentially displayed from among a plurality of images corresponding to the keyword included in the character information.

Assignees

• Hori Yuki
• Watanabe Eri
• Yasuda Takuro
• Hagita Kentaroh
• Naitoh Takuroh
• Tanaka Hiroaki
• Koyama Terunori
• Ricoh Co Ltd

Inventors

• Hori Yuki
• Watanabe Eri
• Yasuda Takuro
• Hagita Kentaroh
• Naitoh Takuroh
• Tanaka Hiroaki
• Koyama Terunori

Classifications

• G06V20/20 Primary

  in augmented reality scenes · CPC title

• G06F18/2148

  characterised by the process organisation or structure, e.g. boosting cascade · CPC title

• G06F40/20

  Natural language analysis (semantic analysis of natural language G06F40/30) · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title