Panoramic expansion image display device and method of displaying panoramic expansion image

Patent metadata

Field	Value
Publication number	US-9374528-B2
Application number	US-201113697635-A
Country	US
Kind code	B2
Filing date	May 16, 2011
Priority date	May 17, 2010
Publication date	Jun 21, 2016
Grant date	Jun 21, 2016

Abstract

A panoramic image display device divides a panoramic expansion image into at least two panoramic images and displays the panoramic images. The panoramic expansion image display device including: a clipping reference position setting unit that sets a clipping reference position for the panoramic expansion image; an object detection unit that detects an object as a display target from the panoramic expansion image; a clipping position determination unit that determines a clipping position of the panoramic image according to a relationship between a detected object position and the clipping reference position; and a display image generation unit that displays the panoramic image clipped from the panoramic expansion image at the clipping position.

First claim

The invention claimed is:

1. A display device, comprising:
an image processor that:
sets a clipping reference position in a panoramic expansion image;
detects an object as a display target from the panoramic expansion image;
determines a first clipping position, that is at a different position from the clipping reference position, as a determined clipping position when the display target is within a reference distance from intersecting with the clipping reference position, and determines a second clipping position, that is at a same position as the clipping reference position, as the determined clipping position when the display target is out of the reference distance from intersecting with the clipping reference position;
clips the panoramic expansion image at one of the first clipping position or the second clipping position to obtain at least two panoramic images from the panoramic expansion image, each of the at least two panoramic images including a different part of the panoramic expansion image; and
generates the at least two panoramic images to be displayed separately on a display,
wherein the at least two panoramic images display all image information displayed on the panoramic expansion image, and
wherein a panoramic image of the at least two panoramic images clipped at the first clipping position is expanded to increase width.

2. The display device according to claim 1 ,
wherein the panoramic expansion image is an expanded moving image, and
wherein the image processor determines the first clipping position such that a total body of the object is contained in at least one of the panoramic images when a position of the object approaches the clipping reference position.

3. The display device according to claim 1 , wherein the display displays the at least two panoramic images in a display area,
wherein, when the first clipping position is determined, the image processor changes a size of at least one of the panoramic images according to the display area and the display displays at least one of the panoramic images after the size is changed.

4. The display device according to claim 1 , wherein the image processor further extracts a background image feature of a background from the panoramic expansion image, and
determines the clipping reference position based on the background image feature.

5. The display device according to claim 4 ,
wherein the background image feature is extracted from the panoramic expansion image using color information.

6. The display device according to claim 4 ,
wherein the background image feature is extracted from the panoramic expansion image using character information.

7. The display device according to claim 4 ,
wherein the background image feature is extracted from the panoramic expansion image using texture information.

8. The display device according to claim 4 ,
wherein the background image feature is extracted from the panoramic expansion image using detection frequency information on the object.

9. The display device according to claim 1 ,
wherein the image processor makes the determination such that the ends of the panoramic images overlap with each other.

10. A display device, comprising:
an image processor that:
sets a clipping reference position in a panoramic expansion image;
detects an object as a display target from the panoramic expansion image;
determines a first clipping position, that is at a different position from the clipping reference position, as a determined clipping position when the display target is within a reference distance from intersecting with the clipping reference position, and determines a second clipping position, that is at a same position as the clipping reference position, as the determined clipping position when the display target is out of the reference distance from intersecting with the clipping reference position;
clips the panoramic expansion image at one of the first clipping position or the second clipping position to obtain at least two panoramic images from the panoramic expansion image, each of the at least two panoramic images including a different part of the panoramic expansion image;
determines a degree of 3D protrusion of each of the at least two panoramic images, such that the object protrudes with substantially the same 3D degree in each of the at least two panoramic images; and
creates a 3D image in which the object protrudes, according to the determined degree of 3D protrusion,
wherein the at least two panoramic images display all image information displayed on the panoramic expansion image, and
wherein a panoramic image of the at least two panoramic images clipped at the first clipping position is expanded to increase width.

11. A display device, comprising:
an image processor that:
sets a clipping reference position in a panoramic expansion image;
detects an object as a display target from the panoramic expansion image;
divides the panoramic expansion image into a first panoramic image having a first end and a second panoramic image having a second end, the first end and the second end being connected to each other;
determines a degree of 3D protrusion of each of the first and the second panoramic images, such that the first end and the second end protrude with substantially the same degree; and
creates a 3D image in which the object protrudes, according to the determined degree of 3D protrusion,
wherein the panoramic expansion image is divided along a first clipping position, that is at a different position from the clipping reference position, as a determined clipping position when the display target is within a reference distance from intersecting with the clipping reference position, and divides the panoramic expansion image along a second clipping position, that is at a same position as the clipping reference position, as the determined clipping position when the display target is out of the reference distance from intersecting with the clipping reference position,
wherein the first panoramic image and the second panoramic image display all image information displayed on the panoramic expansion image, and
wherein one of the first panoramic image or the second panoramic image divided at the first clipping position is expanded to increase width.

12. A method, comprising:
setting a clipping reference position in a panoramic expansion image;
detecting an object as a display target from the panoramic expansion image;
determining a first clipping position, that is at a different position from the clipping reference position, as a determined clipping position when the display target is within a reference distance from intersecting with the clipping reference position, and determines a second clipping position, that is at a same position as the clipping reference position, as the determined clipping position when the display target is out of the reference distance from intersecting with the clipping reference position;
clipping the panoramic expansion image at the determined clipping position to obtain at least two panoramic images from the panoramic expansion image, each of the at least two panoramic images including a different part of the panoramic expansion image; and
generating the at least two panoramic images to be displayed separately,
wherein the at least two panoramic images display all image information displayed on the panoramic expansion image, and
wherein a panoramic image of the at least two panoramic images clipped at the first clipping position is expanded to increase width.

13. The display device according to claim 1 , wherein, the image processor determines,
when the distance betwe

Assignees

• Watanabe Takeshi
• Yokomitsu Sumio
• Fujii Hirofumi
• Fujimatsu Takeshi
• Matsumoto Yuichi
• Miwa Michio
• Sugiura Masataka
• Morioka Mikio
• Panasonic Ip Man Co Ltd

Inventors

• Watanabe Takeshi
• Yokomitsu Sumio
• Fujii Hirofumi
• Fujimatsu Takeshi
• Matsumoto Yuichi
• Miwa Michio
• Sugiura Masataka
• Morioka Mikio

Classifications

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06T3/4038 Primary

  Image mosaicing, e.g. composing plane images from plane sub-images · CPC title

• H04N5/23238 Primary

  Electricity · mapped topic

• G03B15/10

  using back-projection, i.e. blending artificial background with real foreground · CPC title