Communication terminal, image management apparatus, image processing system, method for controlling display, and computer program product

Patent metadata

Field	Value
Publication number	US-10277836-B2
Application number	US-201715449528-A
Country	US
Kind code	B2
Filing date	Mar 3, 2017
Priority date	Mar 7, 2016
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

A communication terminal includes circuitry. The circuitry is configured to calculate, for each of a plurality of captured-image data items that are obtained by continuous image capturing, a center point of an object detection area of the captured-image data item. The circuitry is further configured to render a heat map image having a gradation of color, the gradation of color of the heat map image being determined based on weighting of colors of the heat map image with the calculated center points of the captured-image data items. The circuitry is further configured to map the heat map image on a captured-image represented by one of the plurality of captured-image data items. The circuitry is further configured to display the captured-image on which the heat map image is mapped.

First claim

What is claimed is:

1. A communication terminal comprising:
circuitry to:
calculate, for each of a plurality of captured-image data items that are obtained by continuous image capturing, a center point of an object detection area of the captured-image data item;
render a heat map image having a gradation of color, the gradation of color of the heat map image being determined based on weighting of colors of the heat map image with the calculated center points of the captured-image data items;
map the heat map image on a captured-image represented by one of the plurality of captured-image data items; and
display the captured-image on which the heat map image is mapped.

2. The communication terminal of claim 1 , wherein
the captured-image is a full-spherical panoramic image, and
the circuitry is further configured to control the display of full-spherical panoramic image such that the heat map image is placed on a front side of the full-spherical panoramic image and a back surface of the heat map image is displayed.

3. The communication terminal of claim 1 , further comprising:
a memory to store a score table associating each of a plurality of types of the center point with a score,
wherein the circuitry is further configured to calculate the center point based on the score table, and determine weighting of the colors of the heat map image such that the center point with a higher score is assigned with a darker color in the heat map image.

4. The communication terminal of claim 3 , wherein
the plurality of types of the center point includes each one of the center points, a first average center point indicating a center point among a plurality of the center points, a second average center point indicating a center point among a plurality of the first average center points,
the score table associates the second average center point with a highest score,
the score table associates the first average center point with a second highest score, and
the score table associates the center point with a lowest score.

5. The communication terminal of claim 3 , wherein
in a case in which a plurality of center points of the center points of the plurality of captured-image data items are present in a predetermined range, the circuitry is further configured to:
integrate the plurality of center points in the predetermined range into a single integrated center point;
determine a sum of the scores of the plurality of center points as a score of the single integrated center point; and
weight the colors of the heat map image using the single integrated center point and the sum of the scores.

6. The communication terminal of claim 1 , wherein the circuitry is further configured to define the object detection area by an object position and an object area, the object position indicating a position of an arbitrary corner of a rectangle containing an object, and the object area indicating a width and a height of the rectangle.

7. The communication terminal of claim 1 , wherein the communication terminal is one of a personal computer, a smart phone, a tablet, and a smartwatch.

8. An image communication system comprising:
the communication terminal of claim 1 ; and
an image management apparatus that manages the plurality of captured-image data items, wherein
the communication terminal further includes a receiver to receive the plurality of captured-image data items from the image management apparatus.

9. A method for controlling display of captured images, comprising:
calculating, for each of a plurality of captured-image data items that are obtained by continuous image capturing, a center point of an object detection area of the captured-image data item;
rendering a heat map image having a gradation of color, the gradation of color of the heat map image being determined based on weighting of colors of the heat map image with the calculated center points of the captured-image data items;
mapping the heat map image on a captured-image represented by one of the plurality of captured-image data items; and
displaying the captured-image on which the heat map image is mapped.

10. A non-transitory computer-readable medium including a computer-readable program, wherein the computer-readable program when executed on a computer causes the computer to perform a method, the method comprising:
calculating, for each of a plurality of captured-image data items that are obtained by continuous image capturing, a center point of an object detection area of the captured-image data item;
rendering a heat map image having a gradation of color, the gradation of color of the heat map image being determined based on weighting of colors of the heat map with the calculated center points;
mapping the heat map image on a captured-image represented by one of the plurality of captured-image data items; and
displaying the captured-image on which the heat map image is mapped.

Assignees

• Mitsui Satoshi
• Nishihara Yoshito
• Nagafuchi Tatsuya
• Ricoh Co Ltd

Inventors

• Mitsui Satoshi
• Nishihara Yoshito
• Nagafuchi Tatsuya

Classifications

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• G06V10/42

  Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation · CPC title