System controller, multi-camera view system and a method of processing images

Patent metadata

Field	Value
Publication number	US-2016150164-A1
Application number	US-201414551615-A
Country	US
Kind code	A1
Filing date	Nov 24, 2014
Priority date	Nov 24, 2014
Publication date	May 26, 2016
Grant date	—

Abstract

A system controller controls a multi-camera view system for displaying an output image on a display. The output image is a view from a selected viewpoint. The system controller comprises an image resizing unit, a memory, and a processing unit. The image resizing unit receives the at least two input images captured by at least two cameras and is arranged to output to the memory at least two resized images, corresponding to the at least two input images, respectively. The image resizing unit resizes the at least two input images based on the selected viewpoint. The memory stores the two resized images. The processing unit is coupled to the memory and generates the output image from the at least two resized images.

First claim

1 . A system controller for controlling a multi-camera view system for displaying an output image on a display, the output image being a view from a selected viewpoint, the system controller comprising:
an image resizing unit for receiving the at least two input images captured by at least two cameras, the image resizing unit being arranged to output at least two resized images corresponding to the at least two input images, respectively, the image resizing unit being arranged to resize the at least two input images based on the selected viewpoint, a memory coupled to the image resizing unit for storing the at least two resized images, a processing unit coupled to the memory for generating the output image from the at least two resized images.

2 . A system controller according to claim 1 , the processing unit being arranged to generate at least one resizing factor, the image resizing unit being coupled to the processing unit for receiving from the processing unit the at least one resizing factor to resize the at least two input images.

3 . A system controller according to claim 1 , the display being coupled to a controlling unit for selecting the viewpoint, the controlling unit being arranged to generate at least one resizing factor based on the selected viewpoint, the image resizing unit being coupled to the controlling unit for receiving the at least one resizing factor from the controlling unit to resize the at least two input images.

4 . A system controller according to claim 1 , the processing unit being arranged to merge the at least two resized images in the view.

5 . A system controller according to claim 1 , the processing unit comprising a graphic processing unit and a central processing unit, the graphic processing unit being coupled to the memory for generating the output image from the at least two resized images, the central processing unit being coupled to the graphic processing unit, the image resizing unit and/or the at least two cameras for controlling the graphic processing unit, the image resizing unit and/or the at least two cameras.

6 . A system controller according to claim 2 , the graphic processing unit being arranged to generate the at least one resizing factor, the central processing unit being arranged to output the at least one resizing factor to the image resizing unit.

7 . A system controller according to claim 6 , the graphic processing unit being arranged to generate the at least one resizing factor based on the stored resized images resulting from the selected viewpoint.

8 . A multi-camera view system comprising:
the system controller as claimed in claim 1 , at least two cameras for capturing the at least two input images, respectively, a controlling unit coupled to the memory of the system controller, a display coupled to the controlling unit, the image resizing unit being coupled to the at least two cameras for receiving the at least two input images from the at least two cameras.

9 . A multi-camera view system according to claim 8 , the at least two cameras being arranged to view from at least two different adjacent views.

10 . A multi-camera view system according to claim 8 , further comprising a human machine interface coupled to the central processing unit for selecting the viewpoint.

11 . A multi-camera view system according to claim 8 , the output image being a two dimension, or a three dimension image, or a 360 degree surround image.

12 . A multi-camera view system according to claim 8 , the display being arranged to view real-time video resulting from real-time captured at least two input images.

13 . An automotive vehicle comprising the system controller as claimed in claim 1 .

14 . A method of processing at least two input images for displaying an output image on a display, the output image being a view from a selected viewpoint, the method comprising:
receiving the at least two input images, resizing the at least two input images to obtained corresponding at least two resized images based on the selected viewpoint, storing the at least two resized images, generating the output image from the at least two resized images.

15 . A method as claimed in claim 14 , further comprising selecting the selected viewpoint.

16 . A method as claimed in claim 14 , the generating comprising merging the at least two resized images in the view.

17 . A method as claimed in claim 14 , further comprising outputting the output image to the display.

18 . A computer program product comprising instructions for causing a programmable apparatus to perform a method of processing at least two images for displaying an output image as claimed in claim 14 .

19 . A non-transitory tangible computer readable storage medium comprising data loadable in a programmable apparatus, the data representing instructions executable by the programmable apparatus, said instructions comprising:
one or more receive instructions for receiving the at least two input images, one or more resize instructions for resizing the at least two input images to obtain corresponding at least two resized images based on the selected viewpoint, one or more store instructions for storing the at least two resized images, one or more generate instructions for generating the output image from the at least two resized images.

20 . An automotive vehicle comprising the multi-camera view system as claimed in claim 8 .

Assignees

• Staudenmaier Michael Andreas
• Herrmann Stephan
• Krutsch Robert Cristian
• Freescale Semiconductor Inc

Inventors

• Staudenmaier Michael Andreas
• Herrmann Stephan
• Krutsch Robert Cristian

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/951

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title

• H04N5/265

  Mixing · CPC title