System, apparatus, method, and computer readable storage medium for extracting information

Patent metadata

Field	Value
Publication number	US-2016379079-A1
Application number	US-201615131800-A
Country	US
Kind code	A1
Filing date	Apr 18, 2016
Priority date	Jun 26, 2015
Publication date	Dec 29, 2016
Grant date	—

Abstract

An information extracting system, an information extracting apparatus, a method for extracting information, and a non-transitory computer readable recording medium are provided. The information extracting system according to an embodiment includes a plurality of photographing apparatuses, an information extracting apparatus configured to extract information on objects included in a plurality of single images photographed by the plurality of photographing apparatuses, and a server configured to receive and store feature information on the objects from the information extracting apparatus. The information extracting apparatus generates a composite image by compositing the plurality of single images received from the plurality of photographing apparatuses, detects the objects included in the plurality of single images, extracts feature information on each of the objects, tracks a position of each of the objects in the composite image, and generates object information on the objects by using the feature information and the position of each of the objects.

First claim

What is claimed is:

1 . An information extracting system comprising:
a plurality of photographing apparatuses; an information extracting apparatus configured to extract information on objects included in a plurality of single images respectively photographed by the plurality of photographing apparatuses; and a server configured to receive and store feature information on the objects from the information extracting apparatus, wherein the information extracting apparatus is configured to generate a composite image by compositing the plurality of single images received from the plurality of photographing apparatuses, detect the objects included in the plurality of single images, extract feature information on each of the objects, track a position of the each of the objects in the composite image, and generate object information on the objects by using the feature information and the position of the each of the objects.

2 . An information extracting apparatus comprising:
a communicator configured to receive a plurality of single images; an image compositor configured to generate a composite image by compositing the plurality of single images; an object detector configured to detect objects included in the plurality of single images and extract feature information on the objects; an object tracker configured to track, in the composite image, respective positions of the objects; and an information generator configured to generate object information on the objects by using the feature information and the respective positions of the objects.

3 . The apparatus as claimed in claim 2 , wherein the image compositor is further configured to generate a mapping table for storing a corresponding relation between a first pixel position in the plurality of single images and a second pixel position in the composite image.

4 . The apparatus as claimed in claim 2 , wherein the image compositor is further configured to generate a mapping table configured to convert a group of pixels associated with each of the objects into a pixel area, the mapping table storing a corresponding relation between a first pixel area in the plurality of single images and a second pixel area in the composite image.

5 . The apparatus as claimed in claim 3 , wherein the object tracker is further configured to convert first position information on the objects detected in the plurality of single images into second position information on the objects in the composite image by using the mapping table, and track the objects by using the second position information.

6 . The apparatus as claimed in claim 3 , wherein the object detector is further configured to obtain current positions of the objects in the plurality of single images by converting, via the mapping table, the respective positions of the objects in the composite image, and
wherein the object tracker is further configured to correct position information of the objects in the composite image by using the current positions of the objects in the plurality of single images and the mapping table.

7 . The apparatus as claimed in claim 6 , wherein the object tracker corrects the position information in the composite image at predetermined time intervals.

8 . The apparatus as claimed in claim 3 , wherein the object detector is further configured to convert first position information on the objects being tracked in the composite image into second position information in the plurality of single images by using the mapping table, and extract feature information on the objects by using the second position information.

9 . The apparatus as claimed in claim 2 , wherein the feature information comprises at least one of a gaze direction, an age, a gender, a race, an ethnicity, an emotion, a shape, a color, a size, and a speed of the objects.

10 . The apparatus as claimed in claim 2 , wherein the communicator is further configured to transmit the object information to an external apparatus at predetermined time intervals.

11 . A method comprising:
receiving a plurality of single images; generating a composite image by compositing the plurality of single images; detecting an object included in the plurality of single images; tracking a position of the object in the composite image; extracting feature information on the object from the plurality of single images; and generating object information on the object by using the feature information and the position of the object.

12 . The method as claimed in claim 11 , further comprising:
generating a mapping table for storing a corresponding relation between a first pixel position in the plurality of single images and a second pixel position in the composite image.

13 . The method as claimed in claim 12 , wherein the mapping table converts a group of pixels associated with the object into a pixel area, the mapping table storing a corresponding relation between a first pixel area in the plurality of single images and a second pixel area in the composite image.

14 . The method as claimed in claim 12 , wherein the tracking comprises:
converting first position information of the object in the plurality of single images into second position information in the composite image by using the mapping table; and tracking the object by using the second position information.

15 . The method as claimed in claim 12 , further comprising:
detecting a current position of the object in the plurality of single images by converting, via the mapping table, position information of the object in the composite image; and correcting the position information in the composite image by using the current position of the object in the plurality of single images and the mapping table.

16 . The method as claimed in claim 15 , wherein the correcting comprises correcting the position information in the composite image at predetermined time intervals.

17 . The method as claimed in claim 12 , wherein the extracting comprises:
converting first position information on the object in the composite image into second position information in the plurality of single images by using the mapping table; and extracting feature information on the object by using the second position information.

18 . The method as claimed in claim 11 , wherein the feature information comprises at least one of a gaze direction, an age, a gender, a race, an ethnicity, an emotion, a shape, a color, a size, and a speed of the object.

19 . The method as claimed in claim 11 , further comprising:
transmitting the object information to an external apparatus at predetermined time intervals.

20 . The method as claimed in claim 11 , wherein the plurality of single images are received from a plurality of photographing apparatuses that are tilted towards each other and create overlapping fields of view.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Han Jeong-Ho

Classifications

• G06V40/166 Primary

  using acquisition arrangements · CPC title

• G06V10/16

  using multiple overlapping images; Image stitching · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title

• G06K9/4609 Primary

  Physics · mapped topic

• G06F17/30914

  Physics · mapped topic