Information processing device, information processing method, and program for generating circumferential captured images

Patent metadata

Field	Value
Publication number	US-9787895-B2
Application number	US-201414906967-A
Country	US
Kind code	B2
Filing date	Dec 25, 2014
Priority date	Feb 17, 2014
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

To provide an information processing device, an information processing method, and a program capable of sharing a space while maintaining the degree of freedom of a visual line. An information processing device according to the present disclosure includes: a control unit configured to perform control in a manner that a display image generated based on image information which is generated through imaging of an imaging device mounted on a moving object moving in a space, imaging-device posture information which is information regarding a posture of the imaging device, and user view information which is obtained from a user manipulation device manipulated by a user and specifies a region that the user desires to view is displayed in a display region viewed by the user.

First claim

The invention claimed is:

1. An information processing device comprising:
a control unit configured to perform control in a manner that a display image generated based on image information which is generated through imaging of an imaging device mounted on a moving object moving in a space, imaging-device posture information, and user view information which is obtained from a user manipulation device manipulated by a user and specifies a region that the user desires to view, is displayed in a display region viewed by the user;
an image generation unit configured to generate circumferential captured images which are captured in circumference of a position at which the moving object is present using captured images included in the image information;
an image selection unit configured to select a captured image corresponding to the user view information among the circumferential captured images as a user view image based on the user view information and the circumferential captured images generated by the image generation unit; and
an image correction unit configured to perform correction on the circumferential captured image in a manner that a change in the circumferential captured image accompanying a change in a visual line direction of the imaging device is suppressed, based on the imaging-device posture information, when the visual line direction of the imaging device is changed,
wherein the image correction unit controls a degree to which the correction is performed according to correction application information obtained from the user manipulation device, and
wherein the control unit, the image generation unit, the image selection unit, and the image correction unit are each implemented via at least one processor.

2. The information processing device according to claim 1 ,
wherein the image correction unit controls the degree to which the correction is performed for each of rotation coordinate axes mutually independently defined with respect to the imaging device according to the correction application information.

3. An information processing device comprising:
a control unit configured to perform control in a manner that a display image generated based on image information which is generated through imaging of an imaging device mounted on a moving object moving in a space, imaging-device posture information, and user view information which is obtained from a user manipulation device manipulated by a user and specifies a region that the user desires to view, is displayed in a display region viewed by the user;
an image generation unit configured to generate circumferential captured images which are captured in circumference of a position at which the moving object is present using captured images included in the image information;
an image selection unit configured to select a captured image corresponding to the user view information among the circumferential captured images as a user view image based on the user view information and the circumferential captured images generated by the image generation unit; and
a visual line information generation unit configured to generate visual line information indicating a visual line direction of the imaging device based on the imaging-device posture information,
wherein the control unit displays an object along with the user view image, the object indicating the visual line direction of the imaging device, and
wherein the control unit, the image generation unit, the image selection unit, and the visual line information generation unit are each implemented via at least one processor.

4. An information processing device comprising:
a control unit configured to perform control in a manner that a display image generated based on image information which is generated through imaging of an imaging device mounted on a moving object moving in a space, imaging-device posture information, and user view information which is obtained from a user manipulation device manipulated by a user and specifies a region that the user desires to view, is displayed in a display region viewed by the user;
an image generation unit configured to generate circumferential captured images which are captured in circumference of a position at which the moving object is present using captured images included in the image information; and
an image selection unit configured to select a captured image corresponding to the user view information among the circumferential captured images as a user view image based on the user view information and the circumferential captured images generated by the image generation unit,
wherein the image generation unit generates, as the circumferential captured image, an omnidirectional image at the position at which the moving object is present or a converted image obtained by converting the omnidirectional image into a rectangular image,
wherein the control unit
generates posture information in which a change in the posture of the imaging device is visualized using rotation information associated with a change in a visual line direction of the imaging device and calculated based on the imaging-device posture information, and
performs control in a manner that the display image is displayed in the display region viewed by the user with the generated posture information superimposed on the display image, and

wherein the control unit, the image generation unit, and the image selection unit are each implemented via at least one processor.

5. The information processing device according to claim 4 , further comprising:
an image correction unit configured to perform correction on the circumferential captured image in a manner that a change in the circumferential captured image accompanying the change in the visual line direction of the imaging device is suppressed when the visual line direction of the imaging device is changed without a change in a position of the imaging device,
wherein the control unit superimposes an object indicating the posture information on the circumferential captured image corrected by the image correction unit, and
wherein the image correction unit is implemented via at least one processor.

6. The information processing device according to claim 5 ,
wherein the control unit superimposes at least one of an object that is rotated with a rotation movement accompanying the change in the visual line direction of the imaging device and an object that is not rotated on the display image.

7. The information processing device according to claim 4 ,
wherein the control unit visualizes the change in the posture of the imaging device using the rotation information, by fixing a motion of a coordinate system fixed to the space in which the imaging device is present and changing the coordinate system fixed to the imaging device, or by changing the motion of the coordinate system fixed to the space in which the imaging device is present and fixing the motion of the coordinate system fixed to the imaging device.

8. The information processing device according to claim 7 ,
wherein the control unit generates the display image corresponding to a case in which the space is virtually viewed from a different position from a center of the coordinate system fixed to the space, when visualizing the change in the posture of the imaging device using the rotation information.

9. The information processing device according to claim 4 ,
wherein the control unit associates an annotation with a correspondence spot of a specific position of the display image in a coordinate system fixed to the space in which the imaging device is present when the annotation is requested to be added to the specific position from the user manipulation device.

10. The information

Assignees

• Sony Corp

Inventors

• Rekimoto Junichi
• Kasahara Shunichi

Classifications

• H04N7/185 Primary

  from a mobile camera, e.g. for remote control · CPC title

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06T3/60

  Rotation of whole images or parts thereof · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06T15/205

  Image-based rendering · CPC title