Information processing device, information processing method, and program

Patent metadata

Field	Value
Publication number	US-2016284048-A1
Application number	US-201615176577-A
Country	US
Kind code	A1
Filing date	Jun 8, 2016
Priority date	Feb 17, 2014
Publication date	Sep 29, 2016
Grant date	—

Abstract

To provide an information processing device, an information processing method, and a program capable of sharing a space while maintaining the degree of freedom of a visual line. An information processing device according to the present disclosure includes: a control unit configured to perform control in a manner that a display image generated based on image information which is generated through imaging of an imaging device mounted on a moving object moving in a space, imaging-device posture information which is information regarding a posture of the imaging device, and user view information which is obtained from a user manipulation device manipulated by a user and specifies a region that the user desires to view is displayed in a display region viewed by the user.

First claim

1 . An information processing device comprising:
circuitry configured to
control displaying of a display image generated based on image information which is generated through an imaging device, first information obtained from a viewer device that specifies a region that a viewer of the viewer device desires to view, and
perform correction on the image information so as to suppress a change in the image information resulting from a change of a spatial state of the imaging device,
wherein the correction is controlled according to correction information obtained from the viewer device.

2 . The information processing device according to claim 1 , wherein
the circuitry is further configured to control displaying of the display image generated based on second information regarding the spatial state of the imaging device, and the correction on the image information is performed based on the second information.

3 . The information processing device according to claim 2 , wherein
the second information includes information indicating posture of the imaging device.

4 . The information processing device according to claim 1 , wherein
the correction information includes information indicating degree of the correction.

5 . The information processing device according to claim 4 , wherein
the correction information further includes information indicating turning off the correction.

6 . The information processing device according to claim 1 , wherein
the imaging device is configured to be attached onto a part of a body of a person who is different from the viewer.

7 . The information processing device according to claim 1 , wherein the circuitry is further configured to
generate circumferential captured image which are captured in circumference of a position at which the imaging device is present based on the image information, and select a captured image corresponding to the first information among the circumferential captured images as the display image based on the first information and the circumferential captured image.

8 . The information processing device according to claim 1 , wherein the correction is performed when the orientation of the imaging device is changed.

9 . The information processing device according to claim 4 ,
wherein the degree to which the correction is performed is controlled for each rotation coordinate axes mutually independently defined with respect to the imaging device according to the correction application information.

10 . The information processing device according to claim 7 ,
wherein the correction is performed in a manner such that the circumferential captured image after a change in orientation of the imaging device is reversely rotated according to a magnitude of a rotation angle accompanying the change in orientation of the imaging device.

11 . The information processing device according to claim 1 ,
wherein the correction is performed so that local feature amounts match before and after the change of the spatial state of the imaging device.

12 . The information processing device according to claim 7 ,
wherein the circuitry generates, as the circumferential captured image, omnidirectional images at positions at which the imaging device is present or converted images obtained by converting the omnidirectional images into rectangular images.

13 . The information processing device according to claim 2 , wherein the circuitry is further configured to
generate visual line information indicating the spatial state of the imaging device based on the second information, and initiate display of an object indicating the spatial state of the imaging device indicated with the visual line information along with the display image using the visual line information.

14 . The information processing device according to claim 2 , wherein the circuitry is further configured to
generate posture information in which a change in a posture of the imaging device is visualized using rotation information regarding rotation accompanying a change in the spatial state of the imaging device and calculated based on the second information, and perform control in a manner such that the display image is displayed in a display region viewed by the viewer with the generated posture information superimposed on the display image.

15 . The information processing device according to claim 7 , wherein the circuitry is further configured to
perform correction on the circumferential captured image in a manner such that a change in the circumferential captured image accompanying a change in the spatial state of the imaging device is suppressed when the spatial state of the imaging device is changed without a change in a position of the imaging device, and initiate display of superimposing an object indicating the spatial state on at least one of the corrected circumferential captured image.

16 . The information processing device according to claim 15 ,
wherein at least one of an object that is rotated with a rotation movement accompanying the change in the spatial state of the imaging device and an object that is not rotated on the display image, is superimposed.

17 . The information processing device according to claim 14 ,
wherein the change in the posture of the imaging device is visualized using the rotation information by fixing a motion of a coordinate system fixed to the space in which the imaging device is present and by changing the coordinate system fixed to the imaging device or by changing the motion of the coordinate system fixed to the space in which the imaging device is present and fixing the motion of the coordinate system fixed to the imaging device.

18 . The information processing device according to claim 17 ,
wherein the display image is generated corresponding to a case in which the space is virtually viewed from a different position from a center of the coordinate system fixed to the space, when visualizing the change in the posture of the imaging device using the rotation information.

19 . The information processing device according to claim 1 ,
wherein the circuitry is further configured to associate an annotation with a correspondence spot of a specific position of the display image in a coordinate system fixed to the space in which the imaging device is present when the annotation is requested to be added to the specific position from the viewer device.

20 . The information processing device according to claim 14 ,
wherein, according to the rotation information, the circuitry controls at least one of a reproduction speed or a display field angle when the display image is displayed in the display region viewed by the viewer.

21 . The information processing device according to claim 1 ,
wherein the circuitry initiates generation of a display image in a case of virtual viewing of the space from an arbitrary position designated from the viewer device, centering on the designated arbitrary position.

22 . The information processing device according to claim 14 ,
wherein the circuitry changes setting for the performed correction and setting for the superimposition of the posture information based on a manipulation performed on at least one of the imaging device and the viewer device.

23 . The information processing device according to claim 1 ,
wherein the viewer device is a wearable device mounted on the viewer, and wherein the first information is generated according to

Assignees

• Sony Corp

Inventors

• Rekimoto Junichi
• Kasahara Shunichi

Classifications

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N7/185 Primary

  from a mobile camera, e.g. for remote control · CPC title

• G06T15/205

  Image-based rendering · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title