Communication system, communication device, and communication method

Patent metadata

Field	Value
Publication number	US-10079996-B2
Application number	US-201615297558-A
Country	US
Kind code	B2
Filing date	Oct 19, 2016
Priority date	Oct 28, 2015
Publication date	Sep 18, 2018
Grant date	Sep 18, 2018

Abstract

A device performs to: generate second correspondence information indicating a correspondence relation between coordinates of a projection area and coordinates of a captured image based on first correspondence information indicating a size of the projection area indicating an area to which an image is projected by an image projection device, a size of a basic area indicating an area predetermined as the area to which the image is projected, and indicating a correspondence relation between the coordinates of the basic area and the coordinates of the captured image obtained by an imaging unit; transmit coordinate information indicating a range, of the projection area, specified by a user and the second correspondence information to other device; and output, when receiving output information including voice whose directivity is controlled according to an area corresponding to the coordinate information of the captured image from the other device, the received output information.

First claim

What is claimed is:

1. A communication system comprising:
a first communication device, and a second communication device configured to transmit and receive data to and from the first communication device, wherein
the first communication device is configured to include:
a generating unit configured to generate second correspondence information indicating a correspondence relation between coordinates of a projection area and coordinates of a captured image captured by an imaging unit of the second communication device,
the generating unit generating the second correspondence information based on first correspondence information (a) indicating a size of the projection area indicating an area of a projection plane, to which an image is actually projected by an image projection device connected to the first communication device, (b) indicating a size of a basic area of the projection plane, indicating an area predetermined as the area to which the image is to be projected, and (c) indicating a correspondence relation between coordinates of the basic area and the coordinates of the captured image obtained through capturing by the imaging unit of the second communication device;
a first transmission controller configured to perform control to transmit (i) coordinate information indicating a range of the projection area, said range having been specified by a user, and (ii) the second correspondence information, to the second communication device; and
an output controller configured to perform control to output, when the first communication device receives from the second communication device output information including voice whose directivity is controlled according to an area corresponding to coordinate information indicating the coordinates of the captured image, the received output information, and

the second communication device is configured to include:
the imaging unit configured to capture surrounding of the second communication device:
an acquiring unit configured to acquire the captured image obtained through capturing by the imaging unit;
a specifying unit configured to specify, when the second communication device receives the coordinate information and the second correspondence information from the first communication device, the area corresponding to the coordinate information of the captured image acquired by the acquiring unit, based on the received coordinate information and the second correspondence information;
a directivity controller configured to control a directivity of a microphone array including a plurality of microphones so as to direct the directivity to a microphone corresponding to the area specified by the specifying unit among the microphonesinstalled in the second communication device; and
a second transmission controller configured to perform control to transmit the output information including at least voice whose directivity is controlled by the directivity controller to the first communication device.

2. The communication system according to claim 1 , wherein
the second communication device is configured to further include a clipping unit configured to clip an image of the area of the captured image acquired by the acquiring unit, specified by the specifying unit, and
the second transmission controller is configured to perform control to transmit the output information including the clipped image clipped by the clipping unit and the voice whose directivity is controlled by the directivity controller to the first communication device.

3. The communication system according to claim 1 , wherein
the generating unit is configured to perform scale factor conversion according to a difference between the size of the basic area and the size of the projection area to derive coordinates of the captured image corresponding to each coordinates of the projection area, and to generate the second correspondence information.

4. The communication system according to claim 1 , wherein the generating unit is configured to specify the projection area according to an operation of the user.

5. The communication system according to claim 4 , wherein the generating unit is configured to specify the projection area of the projection plane, based on positions corresponding to four vertices of the projection area indicated by the user.

6. The communication system according to claim 5 , wherein the generating unit is configured to acquire information indicating a position of the projection plane, pointed by a pointing device from the pointing device used by the user to indicate a position on the projection plane, as information representing a position indicated by the user.

7. A communication device comprising:
a generating unit configured to generate second correspondence information indicating a correspondence relation between coordinates of a projection area and coordinates of a captured image, the second correspondence information generated based on first correspondence information (a) indicating a size of the projection area indicating an area of a projection plane, to which an image is actually projected by an image projection device connected to the communication device, (b) indicating a size of a basic area of the projection plane, indicating an area predetermined as the area to which the image is projected, and (c) indicating a correspondence relation between the coordinates of the basic area and the coordinates of the captured image obtained through capturing by an imaging unit;
a transmission controller configured to perform control to transmit (i) coordinate information indicating a range of the projection area, said range having been specified by a user, and (ii) the second correspondence information, to another communication device configured to communicate with the communication device; and
an output controller configured to perform control to output, when receiving from said another communication device output information including voice whose directivity is controlled according to an area corresponding to coordinate information of the captured image indicating the coordinates of the captured image, the received output information.

8. A communication method performed by a communication system configured to include a first communication device, and a second communication device configured to transmit and receive data to and from the first communication device, the communication method comprising:
in the first communication device,
(a) generating second correspondence information indicating a correspondence relation between coordinates of a projection area and coordinates of a captured image captured by an imaging unit of the second communication device, the second correspondence information being generated based on first correspondence information (i) indicating a size of the projection area indicating an area of a projection plane, to which an image is actually projected by an image projection device connected to the first communication device, (ii) indicating a size of a basic area of the projection plane, indicating an area predetermined as the area to which the image is projected, and (iii) indicating a correspondence relation between coordinates of the basic area and the coordinates of the captured image obtained through capturing by the imaging unit of the second communication device;
(b) performing control to transmit coordinate information indicating a range of the projection area, said range having been specified by a user and the second correspondence information to the second communication device; and
(c) performing control to output, when receiving from the second communication device output information including voice whose directivity is controlled according to an area corresponding to coordinate information of the

Assignees

• Takahashi Masato
• Kuwata Koji
• Igarashi Kiyoto
• Goto Tomoyuki
• Kitazawa Kazuki
• Gingawa Nobumasa
• Hakamatani Miku
• Ricoh Co Ltd

Inventors

• Takahashi Masato
• Kuwata Koji
• Igarashi Kiyoto
• Goto Tomoyuki
• Kitazawa Kazuki
• Gingawa Nobumasa
• Hakamatani Miku

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04R1/406

  microphones · CPC title

• H04R2201/401

  2D or 3D arrays of transducers · CPC title

• H04N9/3188

  Scale or resolution adjustment (scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391) · CPC title

• H04N9/3194

  including sensor feedback · CPC title