Method and apparatus for determining an orientation of a video

Patent metadata

Field	Value
Publication number	US-10147199-B2
Application number	US-201515122167-A
Country	US
Kind code	B2
Filing date	Feb 23, 2015
Priority date	Feb 27, 2014
Publication date	Dec 4, 2018
Grant date	Dec 4, 2018

Abstract

A method and an apparatus for determining an orientation of a video are suggested. The method comprises the steps of: estimating a motion of the video; extracting translation-based parameters from the estimated motion of the video; and computing at least one feature giving the evolution of the horizontal translation over time against the evolution of the vertical translation according to the translation based parameters, the feature being used for determining the orientation of the video.

First claim

The invention claimed is:

1. A method for presenting video frames of a video, each video frame relates to one of a landscape (0°, 180°) orientation and a portrait orientation (90°, −90°), comprising:
extracting translation-based parameters including a horizontal translation and a vertical translation from an estimated motion of the video frames;
computing at least one feature representing an integrated value of the horizontal translation and the vertical translation over a time period, wherein when the integrated value is positive, it is the landscape (0°, 180°) orientation; when the integrated value is negative, it is the portrait orientation (90°, −90°); and
presenting the video frames within the time period in an orientation based on said at least one feature.

2. The method according to claim 1 , further comprising:
extracting rotation-based parameters from the estimated motion of the video;
splitting the video into at least one segment separated by the rotations detected according to the rotation-based parameters; and
determining the orientation of the video as a function of an integration of said at least one feature over each of said at least one segment.

3. The method according to claim 1 , wherein the estimation comprise estimating a dominant motion of the video.

4. The method according to claim 1 , wherein the estimation comprises computing, at each instant, a parametric approximation of the motion of the video.

5. The method according to claim 2 , wherein the splitting comprises a thresholding of the extracted rotation-based parameters.

6. The method according to claim 2 , wherein the determination comprises computing the orientation of each segment before and after rotations by integrating said at least one feature for all frames of the segment to get one representative single value of said at least one feature per segment.

7. The method according to claim 1 , further comprising smoothing said at least one feature over a sliding time window.

8. The method according to claim 2 , further comprising:
determining the orientation of the video frames from the determined result according to the rotation angle of said rotation-based parameters.

9. The method according to claim 8 , wherein the rotation angle is determined according to the sinus of the rotation-based parameters.

10. The method according to claim 8 , wherein the landscape (0°, 180°) orientation further includes a 0° landscape orientation and a 180° landscape orientation, and a portrait orientation (90°, −90°) further includes a 90° portrait orientation and a −90° portrait orientation.

11. An apparatus for presenting video frames of a video, each video frame relates to one of a landscape (0°, 180°) orientation and a portrait orientation (90°, −90°), comprising a processor configured to:
extract translation-based parameters including a horizontal translation and a vertical translation from an estimated motion of the video frames;
compute at least one feature representing an integrated value of the horizontal translation and the vertical translation over a time period, wherein when the integrated value is positive, it is the landscape (0°, 180°) orientation; when the integrated value is negative, it is the portrait orientation (90°, −90°); and
present the video frames within the time period in an orientation based on said at least one feature.

12. A computer program product recorded on a non-transitory medium readable by computer and executable by a processor, comprising program code instructions for implementing the method according to claim 1 .

13. A non-transitory computer-readable medium comprising a computer program product recorded thereon and capable of being run by a processor, including program code instructions for implementing the method according to claim 1 .

14. The apparatus according to claim 11 , wherein the processor is further configured to:
extract rotation-based parameters from the estimated motion of the video;
split the video into at least one segment separated by the rotations detected according to the rotation-based parameters; and
determine the orientation of the video as a function of an integration of said at least one feature over each of said at least one segment.

15. The apparatus according to claim 11 , wherein the estimation comprises estimating a dominant motion of the video.

16. The apparatus according to claim 11 , wherein the estimation comprises computing, at each instant, a parametric approximation of the motion of the video.

17. The apparatus according to claim 14 , wherein the splitting comprises a thresholding of the extracted rotation-based parameters.

18. The apparatus according to claim 14 , wherein the determination comprises computing the orientation of each segment before and after rotations by integrating said at least one feature for all frames of the segment to get one representative single value of said at least one feature per segment.

19. The apparatus according to claim 11 , wherein the processor is further configured to smooth said at least one feature over a sliding time window.

20. The apparatus according to claim 11 , wherein the processor is further configured to determine the orientation of the video frames from the determined result according to the rotation angle of said rotation-based parameters.

21. The apparatus according to claim 20 , wherein the rotation angle is determined according to the sinus of the rotation-based parameters.

22. The apparatus according to claim 20 , wherein the landscape (0°, 180°) orientation further includes a 0° landscape orientation and a 180° Iandscape orientation, and a portrait orientation (90°, −90°) further includes a 90° portrait orientation and a −90° portrait orientation.

Assignees

• Thomson Licensing
• Interdigital Ce Patent Holdings

Inventors

• Demarty Claire-Helene
• Oisel Lionel
• Perez Patrick

Classifications

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T7/70 Primary

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G06T2219/2016

  Rotation, translation, scaling · CPC title