Communication terminal, image management apparatus, image processing system, method for controlling display, and computer program product

Patent metadata

Field	Value
Publication number	US-10827133-B2
Application number	US-201916283456-A
Country	US
Kind code	B2
Filing date	Feb 22, 2019
Priority date	Mar 7, 2016
Publication date	Nov 3, 2020
Grant date	Nov 3, 2020

Abstract

A communication terminal includes circuitry. The circuitry is configured to calculate, for each of a plurality of captured-image data items that are obtained by continuous image capturing, a center point of an object detection area of the captured-image data item. The circuitry is further configured to render a heat map image having a gradation of color, the gradation of color of the heat map image being determined based on weighting of colors of the heat map image with the calculated center points of the captured-image data items. The circuitry is further configured to map the heat map image on a captured-image represented by one of the plurality of captured-image data items. The circuitry is further configured to display the captured-image on which the heat map image is mapped.

First claim

What is claimed is:

1. An image management system for managing captured image data to be transmitted to a communication terminal, the image management system comprising:
circuitry configured to:
detect a head of a particular person in the captured image data;
in response to detection of the head of the particular person the captured image data, calculate, based on (1) a size of the head of the person, (2) and predetermined average size, and (3) a position of the detected head of the particular person in the captured image data, a position of a foot of the particular person; and
transmit, to the communication terminal, foot position information indicating the calculated position of the foot of the particular person.

2. The image management system of claim 1 , wherein the circuitry is further configured to calculate the size of the detected head based on a top of the head and a bottom of the detected head in the captured image data.

3. The image management system of claim 2 , wherein the circuitry is further configured to:
calculate a distance between a center of the head and the foot of the particular person, based on the calculated size of the detected head and the predetermined average size of the body; and
calculate the position of the foot of the predetermined person in the captured image data to be a position that is away from a position of the detected head by the calculated distance.

4. The image management system of claim 1 , further comprising:
a memory to store the foot position information indicating the calculated position of the foot in association with image identification information identifying the captured image data containing an image of the foot, wherein
the circuitry is further configured to transmit, to the communication terminal, the captured image data, particular image identification information identifying the captured image data, and the foot position information associated with the particular image identification information.

5. The image management system of claim 1 , wherein the captured image data is spherical panoramic image data.

6. An image communication system, comprising:
the image management system of claim 1 ; and
the communication terminal, wherein
the circuitry of the image management system is further configured to transmit, to the communication terminal, a plurality of foot position information items, each item indicating the position of the foot of the particular person in each corresponding image of a plurality of images that are obtained by continuous image capturing,
the communication terminal comprises other circuitry configured to:
generate a heat map image indicating a track of the particular person based on the plurality of foot position information items;
map the generated heat map image onto one image of the plurality of images; and
cause a display to display the one image on which the heat map image is mapped.

7. The image communication system of claim 6 , wherein the communication terminal is one of a personal computer, a smartphone, a tablet, and a smartwatch.

8. A method for transmitting an image performed by an image management system that manages captured image data to be transmitted to a communication terminal, the method comprising:
detecting a head of a particular person in the captured image data;
in response to detection of the head of the particular person in the captured image data, calculating, based on (1) a size of the detected head of the particular person, (2) a predetermined average size of a body, and (3) a position of the detected head of the particular person in the captured image data, a position of a foot of the particular person; and
transmitting, to the communication terminal, foot position information indicating the cella dated position of the foot of the particular person.

9. A method for controlling display of an image, performed by an image management system that manages captured image data, the method comprising:
detecting a head of a particular person in the captured image data;
in response to detection of the head of the particular person in the captured image data, calculating, based on (1) a size of the detected head of the particular person, (2) a size of a body, and (3) a position of the detected head of the particular person in the captured image data, a position of a foot of the particular person;
generating a head map image based on the calculated position of the foot of the particular person;
mapping the heat map image onto the captured image data; and
causing a display to display the captured image data on which the heat map image is mapped.

10. A non-transitory computer-readable medium storing a computer-readable program that causes a computer to execute the method of claim 9 .

Assignees

• Mitsui Satoshi
• Nishihara Yoshito
• Nagafuchi Tatsuya
• Ricoh Co Ltd

Inventors

• Mitsui Satoshi
• Nishihara Yoshito
• Nagafuchi Tatsuya

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• G06V10/42

  Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation · CPC title