Apparatus and method for processing information of multiple cameras

Patent metadata

Field	Value
Publication number	US-10692262-B2
Application number	US-201815868534-A
Country	US
Kind code	B2
Filing date	Jan 11, 2018
Priority date	Jan 12, 2017
Publication date	Jun 23, 2020
Grant date	Jun 23, 2020

Abstract

Disclosed is an apparatus and method for processing information of multiple cameras. The apparatus for processing information of multiple cameras according to an embodiment of the present disclosure includes: multiple cameras obtaining an image containing at least one object; a location information identification unit identifying location information between the at least one object and one of the multiple cameras, the location information identification unit being provided in each of the multiple cameras, wherein the location information comprises a device identifier identifying the location information identification unit and a location data between the at least one object and one of the multiple cameras; and an image processor processing image information obtained from the multiple cameras by using the location information received from the location information identification unit and converting the device identifier received from the location information identification unit into an object identifier identifying the at least one object.

First claim

What is claimed is:

1. An apparatus for processing information of multiple cameras, the apparatus comprising:
multiple cameras obtaining an image containing at least one object;
a location information identification unit identifying relative location information between the at least one object and one of the multiple cameras, the location information identification unit being provided in each of the multiple cameras, wherein the relative location information comprises a device identifier identifying the location information identification unit and a location data between the at least one object and one of the multiple cameras; and
an image processor processing image information obtained from the multiple cameras by using the relative location information received from the location information identification unit and converting the device identifier received from the location information identification unit into an object identifier identifying the at least one object.

2. The apparatus of claim 1 , wherein the location information identification unit includes a depth camera obtaining a depth image of the image containing the at least one object.

3. The apparatus of claim 2 , wherein the image processor provides the depth image of the image as the location information.

4. A method of processing information of multiple cameras, the method comprising:
obtaining an image containing at least one object by using multiple cameras;
determining relative location information from each of the multiple cameras to the at least one object, wherein the relative location information comprises a device identifier identifying the location information identification unit and a location data between the at least one object and one of the multiple cameras; and
processing, by using the relative location information, image information obtained from the multiple cameras,
wherein the processing of the relative image information comprises:
determining the device identifier and the location data; and
converting the device identifier into an object identifier identifying the at least one object.

5. The method of claim 4 , wherein the determining of the relative location information comprises:
obtaining a depth image of the image containing the at least one object from a depth camera provided at a location corresponding to each of the multiple cameras.

6. The method of claim 5 , wherein the processing of the image information comprises:
providing the depth image of the image as the location information.

7. A method of providing a synthetic image, which is a combination of multiple images, using multiple cameras, the method comprising:
receiving multiple images obtained from multiple cameras;
receiving multiple pieces of relative location information provided from multiple location information identification units respectively provided at locations corresponding to the multiple cameras;
matching an original pixel included in each of the multiple images with a synthetic pixel included in a synthetic image in consideration of the relative location information corresponding to the multiple cameras and a relation between the multiple images and the synthetic image;
identifying a value of the original pixel for each of the multiple images and applying the value of the original pixel to a value of the synthetic pixel; and
generating the synthetic image by combining values of synthetic pixels.

8. The method of claim 7 , wherein the matching of the original pixel with the synthetic pixel comprises:
identifying a number of the multiple images constituting the synthetic image; and
identifying both the synthetic pixel to which the original pixel is applied and a weighting from a predetermined weighting table in consideration of the number of the multiple images.

9. The method of claim 8 , wherein the applying of the value of the original pixel to the value of the synthetic pixel comprises:
applying the weighting to the value of the original pixel, and applying the value of the original pixel to which the weighting is applied to the value of the synthetic pixel.

10. The apparatus of claim 1 , wherein the location information identification unit includes distance meters measuring distances between a subject photographed respectively by the multiple cameras and the multiple cameras.

11. The apparatus of claim 1 , wherein the image processor determines at least one relative position between the multiple cameras.

12. The apparatus of claim 11 , wherein the image processor determines at least one relative rotation angle between the multiple cameras.

13. The method of claim 4 , wherein determining relative location information includes measuring distances between a subject photographed respectively by the multiple cameras and the multiple cameras.

14. The method of claim 4 , wherein processing image information includes determining at least one relative position between the multiple cameras.

15. The method of claim 13 , wherein processing image information includes determining at least one relative rotation angle between the multiple cameras.

16. The method of claim 7 , wherein the relative location information comprises distances between a subject photographed respectively by the multiple cameras and the multiple cameras.

17. The method of claim 7 , wherein matching the original pixel with the synthetic pixel includes determining at least one relative position between the multiple cameras.

18. The method of claim 17 , wherein matching the original pixel with the synthetic pixel includes determining at least one relative rotation angle between the multiple cameras.

19. The method of claim 17 , wherein matching the original pixel with the synthetic pixel includes calibrating the multiple cameras using at least one relative position between the multiple cameras.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Lim Seong Yong
• Cho Yong Ju
• Seo Jeong Il
• Seok Joo Myoung

Classifications

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06T7/593 Primary

  from stereo images · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2207/10012

  Stereo images · CPC title