Method and digital video camera for forming a combined image frame of a combined video stream

Patent metadata

Field	Value
Publication number	US-11722697-B2
Application number	US-202117530739-A
Country	US
Kind code	B2
Filing date	Nov 19, 2021
Priority date	Dec 17, 2020
Publication date	Aug 8, 2023
Grant date	Aug 8, 2023

Abstract

A method for forming a combined image frame of a combined video stream comprises: capturing image frames of first and second video streams; encoding image data of the image frames of the first and second video streams, wherein each image frame of the first and second video streams are respectively encoded into first and second encoded data comprising a plurality of rows wherein each row has a height of a single coding unit and a width equal to a width of the image frame and is encoded as one or more slices; and combining the first and second encoded data into combined encoded data by interleaving rows of the first and second encoded data. The combined encoded data representing the combined image frame of the combined video stream.

First claim

The invention claimed is:

1. A digital video camera comprising:
a first image sensor configured to capture image frames of a first video stream;

a second image sensor configured to capture image frames of a second video stream;
a first encoder configured to encode image data of the image frames of the first video stream, wherein each image frame of the first video stream is encoded into first encoded data comprising a plurality of rows wherein each row has a height of a single coding unit and a width equal to a width of the image frame and is encoded as one or more slices;
a second encoder configured to encode image data of the image frames of the second video stream, wherein each image frame of the second video stream is encoded into second encoded data comprising a plurality of rows wherein each row has a height of a single coding unit and a width equal to a width of the image frame and is encoded as one or more slices;
a data combining unit configured to combine first encoded data of an image frame of the first video stream and second encoded data of an image frame of the second video stream into combined encoded data by interleaving rows of the first encoded data of the image frame of the first video stream and rows of the second encoded data of the image frame of the second video stream, the combined encoded data representing a combined image frame of a combined video stream,
wherein the data combining unit is configured to check if two or more directly subsequent slices in the combined encoded data comprises only skip encoded coding units, and if so replacing the two or more directly subsequent slices comprising only skip encoded coding units with a new slice comprising skip encoded coding units having a length of the two or more directly subsequent slices comprising only skip encoded coding units.

2. The video digital camera according to claim 1 , wherein a row in the combined encoded data comprises a single row of the first encoded data and a single row of the second encoded data.

3. The digital video camera according to claim 1 , wherein the first and second encoders are configured to encode image data of the first and second video streams in parallel.

4. The digital video camera according to claim 1 , wherein the first and second images sensors are configured to capture the first and second video streams synchronously.

5. The digital video camera according to claim 1 , wherein the data combining unit is configured to output the combined encoded data as a bit stream.

6. The digital video camera according to claim 1 , wherein the first and second encoders are configured to encode image data of the first and second image frames such that each row comprises a plurality of slices, wherein each slice has a height of one single coding unit.

7. The digital video camera according to claim 1 , wherein the first and second encoders are configured to encode image data of the first and second image frames such that each row constitutes a single slice.

8. The digital video camera according to claim 1 , wherein the combined image frame represents a panoramic image.

9. A method for forming a combined image frame of a combined video stream, the method comprising:
capturing, by a first image sensor of a multi-sensor camera, image frames of a first video stream;
capturing, by a second image sensor of the multi-sensor camera, image frames of a second video stream;
encoding, by a first encoder of the multi-sensor camera, image data of the image frames of the first video stream, wherein each image frame of the first video stream is encoded into first encoded data comprising a plurality of rows wherein each row has a height of a single coding unit and a width equal to a width of the image frame and is encoded as one or more slices;
encoding, by a second encoder of the multi-sensor camera, image data of the image frames of the second video stream, wherein each image frame of the second video stream is encoded into second encoded data comprising a plurality of rows wherein each row has a height of a single coding unit and a width equal to a width of the image frame and is encoded as one or more slices;
combining, by a data combining unit, the first encoded data of an image frame of the first video stream and second encoded data of an image frame of the second video stream into combined encoded data by interleaving rows of the first encoded data of the image frame of the first video stream and rows of the second encoded data of the image frame of the second video stream, the combined encoded data representing the combined image frame of the combined video stream; and
checking if two or more directly subsequent slices in the combined encoded data comprises only skip encoded coding units, and if so replacing the two or more directly subsequent slices comprising only skip encoded coding units with a new slice comprising skip encoded coding units and having a length of the two or more directly subsequent skip comprising only skip encoded coding units.

10. The method according to claim 9 , wherein the combining is made such that a row in the combined encoded data comprises a single row of the first encoded data and a single row of the second encoded data.

11. The method according to claim 9 , wherein the encoding of the image data of the first video stream and the image data of the second video stream is performed in parallel.

12. The method according to claim 9 , wherein capturing of the first and second video streams are performed synchronously.

13. A non-transitory computer-readable storage medium having stored thereon instructions for implementing the method according to claim 9 , when executed on a device having processing capabilities.

Assignees

• Axis Ab

Inventors

• Edpalm Viktor
• Toresson Alexander
• Palmaeus Johan
• Cremon Jonas

Classifications

• H04N19/597 Primary

  specially adapted for multi-view video sequence encoding · CPC title

• H04N5/04

  Synchronising (for television systems using pulse code modulation H04N7/56) · CPC title

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/88

  involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks · CPC title