Information processing device and information processing method

Patent metadata

Field	Value
Publication number	US-11082660-B2
Application number	US-201716315398-A
Country	US
Kind code	B2
Filing date	Apr 25, 2017
Priority date	Aug 1, 2016
Publication date	Aug 3, 2021
Grant date	Aug 3, 2021

Abstract

There is provided an information processing device and an information processing method capable of giving a sense of realism as if a partner connected in video communication is present in one's sight. The information processing device including a communication unit configured to transmit and receive an image to and from a communication connection destination. Further, a control unit is configured to control a display range and a position of the image, on the basis of a display size and installation position information of a display device that displays the image and distance information of a subject appearing in the image that is acquired from the image.

First claim

The invention claimed is:

1. An information processing device, comprising:
communication circuitry configured to transmit and receive an image to and from a communication connection destination; and
control circuitry configured to:
estimate a distance between a camera and a subject that appears in the image, wherein
the estimated distance is based on a relationship between a size of a face of the subject and at least one of an age or a sex of the subject, and
the camera is associated with the communication connection destination;

calculate an actual height from a ground to the face of the subject based on spec information of the camera and the estimated distance from the camera to the subject, wherein the spec information includes first angle-of-view information of the camera in a direction horizontal to the ground and second angle-of-view information of the camera in a direction perpendicular to the ground; and
control a display range of the image and a position of the image based on installation position information of a display device that displays the image, a display size of the display device, the calculated actual height, and

the estimated distance of the subject.

2. The information processing device according to claim 1 , wherein
the installation position information includes height information of the display device from the ground,
the control circuitry is further configured to
control execution of a life-size display of the subject based on a standing position of the subject, and

the standing position is a same position as a position of the display device.

3. The information processing device according to claim 2 , wherein
the control circuitry is further configured to determine the display range of the image based on the standing position of the subject and the face of the subject,
the face of the subject is at the actual height, and
the standing position is the same position as the position of the display device.

4. The information processing device according to claim 2 , wherein the control circuitry is further configured to
estimate the distance based on the size of the face and the age of the subject.

5. The information processing device according to claim 4 , wherein the distance between the camera and the subject is based on at least one of the age or the sex of the subject.

6. The information processing device according to claim 3 , wherein based on the face is outside the determined display range, the control circuitry is further configured to notify the communication connection destination that the face of the subject is outside the determined display range.

7. The information processing device according to claim 6 , wherein
the control circuitry is further configured to output the notification to guide the communication connection destination in a manner that the face enters the determined display range.

8. The information processing device according to claim 3 , wherein based on the determined display range includes a portion that lacks in image information, the control circuitry is further configured to control complement of the image information of the portion.

9. An information processing method, comprising:
transmitting and receiving an image to and from a communication connection destination;
estimating a distance between a camera and a subject that appears in the image, wherein
the estimated distance is based on a relationship between a size of a face of the subject and at least one of an age or a sex of the subject, and
the camera is associated with the communication connection destination;

calculating an actual height from a ground to the face of the subject based on spec information of the camera and the estimated distance from the camera to the subject, wherein the spec information includes first angle-of-view information of the camera in a direction horizontal to the ground and second angle-of-view information of the camera in a direction perpendicular to the ground; and
controlling a display range of the image and a position of the image based on installation position information of a display device that displays the image, a display size of the display device, the calculated actual height, and the estimated distance of the subject.

10. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:
transmitting and receiving an image to and from a communication connection destination;
estimating a distance between a camera and a subject that appears in the image, wherein
the estimated distance is based on a relationship between a size of a face of the subject and at least one of an age or a sex of the subject, and
the camera is associated with the communication connection destination;

calculating an actual height from a ground to the face of the subject based on spec information of the camera and the estimated distance from the camera to the subject, wherein the spec information includes first angle-of-view information of the camera in a direction horizontal to the ground and second angle-of-view information of the camera in a direction perpendicular to the ground; and
controlling a display range of the image and a position of the image based on installation position information of a display device that displays the image, a display size of the display device, the calculated actual height, and the estimated distance of the subject.

11. The information processing device according to claim 1 , wherein the spec information further includes a first number of pixels of the image in a direction horizontal to the ground and a second number of pixels of the image in a direction perpendicular to the ground.

Assignees

• Sony Corp

Inventors

• Miki Daisuke
• Izumihara Atsushi
• Sakai Yusuke

Classifications

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• H04N7/147 Primary

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• G01B11/25

  by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50}) · CPC title