Image processing device, image processing method, program for image processing device, recording medium, and image display device

Patent metadata

Field	Value
Publication number	US-9269124-B2
Application number	US-201214366005-A
Country	US
Kind code	B2
Filing date	Dec 18, 2012
Priority date	Dec 19, 2011
Publication date	Feb 23, 2016
Grant date	Feb 23, 2016

Abstract

A distorted image (S) is acquired through a photographing operation using a wide-angle lens or an omnidirectional mirror. A cutting reference point (P) for cutting a partial cut region from the distorted image is set. The cut region is set according to the cutting reference point. An eye vector (n) corresponding to the cutting reference point is set with a photographing viewpoint of the distorted image as a base point. The cut region is shifted by a predetermined distance from the cutting reference point. The shifted cut region is transformed through image transformation to transform the distorted image into a planar regular image (T′) according to the eye vector. The shifted cut region (E′) is transformed.

First claim

The invention claimed is:

1. An image processing device comprising:
a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;
a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;
a cut region setting unit that sets the cut region according to the cutting reference point;
an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;
an offset unit that shifts the cut region by a predetermined distance from the cutting reference point; and
an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

2. The image processing device according to claim 1 , further comprising:
a virtual spherical surface setting unit that sets a virtual spherical surface with the center of the distorted image as a center, wherein the eye vector setting unit sets an eye vector facing an intersection between the virtual spherical surface and a straight line orthogonal to a plane including the distorted image and passing through the cutting reference point from the center of the virtual spherical surface.

3. The image processing device according to claim 1 , wherein
the eye vector setting unit receives a parameter to specify the eye vector and sets the eye vector,
the cut region setting unit sets a region of the planar regular image corresponding to the cut region within a surface orthogonal to the eye vector at an intersection therebetween in the direction of the eye vector,
the offset unit shifts the set region of the planar regular image within the surface orthogonal to the eye vector, and
the image transforming unit finds a pixel value of the distorted image corresponding to each point of the shifted region of the planar regular image according to the eye vector, and sets the found pixel value of the distorted image to a pixel value of the planar regular image.

4. The image processing device according to claim 3 , wherein
the surface orthogonal to the eye vector comprises a surface of a cylinder.

5. The image processing device according to claim 1 , wherein
the eye vector setting unit sets a plurality of eye vectors,
the cut region setting unit sets a cut region according to each of the eye vectors,
the image transforming unit transforms the cut region into a planar regular image, and
the planar regular image found by the image transforming unit is displayed on a single displaying unit.

6. An image processing method, which is performed by an image processing device to process an image, the image processing method comprising:
a step of acquiring a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;
a step of setting a cutting reference point for cutting a partial cut region from the distorted image;
a step of setting the cut region according to the cutting reference point;
a step of setting an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;
a step of shifting the cut region by a predetermined distance from the cutting reference point; and
a step of transforming the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

7. A non-transitory recording medium having stored therein a computer-readable program for an image processing device, which causes a computer to function as:
a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;
a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;
a cut region setting unit that sets the cut region according to the cutting reference point;
an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;
an offset unit that shifts the cut region by a predetermined distance from the cutting reference point; and
an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

8. An image display device comprising:
a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;
a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;
a cut region setting unit that sets the cut region according to the cutting reference point;
an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;
an offset unit that shifts the cut region by a predetermined distance from the cutting reference point;
an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector; and
a displaying unit that displays the planar regular image acquired through the image transforming unit.

9. The image processing device according to claim 2 , wherein
the eye vector setting unit receives a parameter to specify the eye vector and sets the eye vector,
the cut region setting unit sets a region of the planar regular image corresponding to the cut region within a surface orthogonal to the eye vector at an intersection therebetween in the direction of the eye vector,
the offset unit shifts the set region of the planar regular image within the surface orthogonal to the eye vector, and
the image transforming unit finds a pixel value of the distorted image corresponding to each point of the shifted region of the planar regular image according to the eye vector, and sets the found pixel value of the distorted image to a pixel value of the planar regular image.

10. The image processing device according to any one of claim 2 , wherein
the eye vector setting unit sets a plurality of eye vectors,
the cut region setting unit sets a cut region according to each of the eye vectors,
the image transforming unit transforms the cut region into a planar regular image, and
the planar regular image found by the image transforming unit is displayed on a single displaying unit.

11. The image processing device according to any one of claim 3 , wherein
the eye vector setting unit sets a plurality of eye vectors,
the cut region setting unit sets a cut region according to each of the eye vectors,
the image transforming unit transforms the cut region into a planar regular image, and
the planar regular image found by the image transforming unit is displayed on a single displaying unit.

12. The image processing device according to any one of claim 4 , wherein
the eye vector setting unit sets a plurality of eye vectors,
the cut region setting unit sets a cut region according to each of the eye vectors,
the image transforming unit transforms the cut region into a planar regular image, and
the planar regular image found by the image transforming unit is displayed on a single displaying unit.

13. The image processing device according to any one of claim 9

Assignees

• Dainippon Printing Co Ltd

Inventors

• Yagi Takuya
• Yoshino Kyoji
• Inagaki Koji

Classifications

• H04N23/58

  Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors · CPC title

• H04N23/81

  for suppressing or minimising disturbance in the image signal generation · CPC title

• H04N1/3878 Primary

  Skew detection or correction · CPC title

• G06T3/0018 Primary

  Physics · mapped topic

• H04N5/2259

  Electricity · mapped topic