System and method for displaying image, image-capturing device, and recording medium

Patent metadata

Field	Value
Publication number	US-11966658-B2
Application number	US-202318110894-A
Country	US
Kind code	B2
Filing date	Feb 17, 2023
Priority date	Mar 9, 2022
Publication date	Apr 23, 2024
Grant date	Apr 23, 2024

Abstract

A system for displaying an image, includes circuitry that: receives a detection of use of a display device by a user; specifies the display device, based on information related to the display device; and displays, on a display, a display device image representing a specific area in an image captured by an image-capturing device, the specific area including at least a part of the display device that is specified.

First claim

The invention claimed is:

1. A system for displaying an image, comprising:
circuitry configured to:
receive a detection of use of a display by a user;
specify the display, based on information related to the display; and
display, on a display, an image representing a specific area in an image captured by an image-capturing device, the specific area including at least a part of the display that is specified;

the image-capturing device;
a terminal apparatus; and
the display including:
a sensor that detects use of the display by the user; and
display circuitry configured to, in response to detection of a start of the use of the display by the sensor, transmit information indicating the start of the use of the display to the terminal apparatus,
wherein:
the sensor detects a touched position on a touch panel of the display,
the display circuitry transmits information indicating the detection of the touched position to the terminal apparatus, and
the circuitry changes the specific area represented by the display image according to the touched position indicated by the information indicating the detection of the touched position.

2. The system of claim 1 , wherein:
the sensor detects the start of use of the display based on at least one of a touch on a touch panel of the display, or detection of an approach of the user to the display.

3. The system of claim 1 , wherein:
the sensor further detects an end of the use of the display,
the display circuitry is configured to transmit information indicating the end of the use of the display to the terminal apparatus, and
the circuitry is configured to end display of the display image, based on image data captured by the image-capturing device in response to receiving the information indicating the end of the use of the display.

4. The system of claim 3 , wherein:
the sensor detects the end of the use of the display based on at least one of: a detection of absence of a touch on a touch panel of the display for a certain period, or a detection that the user is moving away from the display.

5. The system of claim 1 , wherein:
the circuitry is configured to specify the specific area including at least the part of the display based on a designated area in the image captured by the image-capturing device, the designated area being designated at the terminal apparatus.

6. The system of claim 1 , wherein:
the circuitry is configured to specify the specific area including at least the part of the display, based on a specific image displayed by the display device.

7. The system of claim 1 , wherein:
the circuitry is configured to specify the specific area including at least the part of the display device, based on a specific sound output by the display.

8. The system of claim 1 , wherein:
the circuitry is configured to specify the specific area including at least the part of the display, based on a result of applying image processing to the image captured by the image-capturing device.

9. The system of claim 1 , wherein:
the circuitry is configured to generate a speaker image from the image captured by the image-capturing device based on a detected direction of a speaker, the speaker image including an image of the speaker, wherein:
in a case where the speaker is the user,
the circuitry is configured to display the display image representing the specific area in the image captured by the image-capturing device, the specific area including the speaker in addition to the at least part of the display.

10. The system of claim 9 , wherein:
in a case where a direction of the display and the direction of the speaker overlap in a certain amount or greater,
the circuitry is configured to prevent from generating the speaker image.

11. The system of claim 9 , wherein:
in response to a request for preferentially displaying the display image, the circuitry is configured to display the display image in a size larger than the speaker image.

12. The system of claim 1 , further comprising:
an information processing server configured to communicate with the display and the image-capturing device via a network, the information processing server including
a memory that stores the display and the image-capturing device as devices for use in communication by the user, wherein
the display circuitry is configured to transmit the information indicating the detection by the sensor to the terminal apparatus via the information processing server.

13. The system of claim 12 , wherein:
the display is further configured to display an image including device identification information of the display,
the circuitry configured to acquire the device identification information of the display from the image displayed by the display, and
the information processing server further includes
circuitry configured to receive a request for registration of the display and the image-capturing device as devices for use in communication by the user, based on the device identification information of the display and device identification information of the image-capturing device that are received from the terminal apparatus.

14. A method for displaying an image, comprising:
receiving a detection of use of a display by a user;
specifying the display based on information related to the display;
displaying a display image representing a specific area in an image captured by an image-capturing device, the specific area including at least a part of the display;
detecting use of the display by the user;
transmitting, in response to the detecting, information indicating a start of the use of the display to the terminal apparatus,
wherein:
the detecting detects a touched position on a touch panel of the display,
the transmitting transmits information indicating the detection of the touched position to the terminal apparatus, and
the method further comprises changing the specific area represented by the display image according to the touched position indicated by the information indicating the detection of the touched position.

15. A non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, causes the processors to perform a method comprising:
receiving information indicating identification of a display based on information related to the display and information indicating detection of the display being in use by a user;
displaying an image representing a specific area in an image captured by an image-capturing device, the specific area including at least a part of the display;
detecting use of the display by the user;
transmitting, in response to the detecting, information indicating a start of the use of the display to the terminal apparatus,
wherein:
the detecting detects a touched position on a touch panel of the display,
the transmitting transmits information indicating the detection of the touched position to the terminal apparatus, and
the method further comprises changing the specific area represented by the display image according to the touched position indicated by the information indicating the detection of the touched position.

Assignees

• Nakamura Daiki
• Kamekura Takahiro
• Ishii Shigeyuki
• Ricoh Co Ltd

Inventors

• Nakamura Daiki
• Kamekura Takahiro
• Ishii Shigeyuki

Classifications

• G06F3/14 Primary

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G06F3/0412

  Digitisers structurally integrated in a display · CPC title

• H04N7/155 Primary

  involving storage of or access to video conference sessions (tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831) · CPC title

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title