Systems and methods for stabilizing views of videos

Patent metadata

Field	Value
Publication number	US-2023412788-A1
Application number	US-202318460390-A
Country	US
Kind code	A1
Filing date	Sep 1, 2023
Priority date	Jul 27, 2018
Publication date	Dec 21, 2023
Grant date	—

Abstract

A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

First claim

What is claimed is:

1 . A method of stabilized viewing of video content, comprising:
obtaining a video having a progress length; obtaining a trajectory of viewing direction for the video, the trajectory of viewing direction including viewing directions for moments within the progress length of the video, the viewing directions characterized by rotations about different axes; stabilizing the trajectory of viewing direction for the video to generate a stabilized trajectory of viewing direction for the video, wherein the stabilized trajectory of viewing direction for the video includes the trajectory of viewing direction for the video that is differently stabilized for the different axes of rotation for the viewing directions; and generating a stabilized video based on the stabilized viewing trajectory of viewing direction for the video.

2 . The method of claim 1 , wherein the trajectory of viewing direction is identified by a user as a function of progress through the progress length of the video.

3 . The method of claim 2 , wherein the trajectory of viewing direction is identified by the user via user interaction with a touchscreen display.

4 . The method of claim 2 , wherein the trajectory of viewing direction is identified by the user via user rotation of a mobile device.

5 . The method of claim 1 , wherein the stabilized trajectory of viewing direction is generated by smoothing jerkiness or shakiness in the trajectory of viewing direction.

6 . The method of claim 1 , wherein the different axes of rotation for the viewing directions include a yaw axis, a pitch axis, and a roll axis.

7 . The method of claim 6 , wherein the trajectory of viewing direction for the video being differently stabilized for the different axes of rotation for the viewing directions includes stabilization of the trajectory of viewing direction for the video about one of the yaw axis, the pitch axis, or the roll axis being different from stabilization of the trajectory of viewing direction for the video about another of the yaw axis, the pitch axis, and the roll axis.

8 . The method of claim 7 , wherein the stabilized trajectory of viewing direction for the video is generated further based on a viewing size constraint.

9 . The method of claim 8 , wherein the viewing size constraint limits deviation of a viewing size associated with the stabilized trajectory of viewing direction from a viewing size associated with the trajectory of viewing direction.

10 . A system for stabilizing viewing of video content, comprising:
one or more physical processors configured by machine-readable instructions to:
obtain a video having a progress length;
obtain a trajectory of viewing direction for the video, the trajectory of viewing direction including viewing directions for moments within the progress length of the video, the viewing directions characterized by rotations about different axes;
stabilize the trajectory of viewing direction for the video to generate a stabilized trajectory of viewing direction for the video, wherein the stabilized trajectory of viewing direction for the video includes the trajectory of viewing direction for the video that is differently stabilized for the different axes of rotation for the viewing directions; and
generate a stabilized video based on the stabilized viewing trajectory of viewing direction for the video.

11 . The system of claim 10 , wherein the trajectory of viewing direction is identified by a user as a function of progress through the progress length of the video.

12 . The system of claim 11 , wherein the trajectory of viewing direction is identified by the user via user interaction with a touchscreen display.

13 . The system of claim 11 , wherein the trajectory of viewing direction is identified by the user via user rotation of a mobile device.

14 . The system of claim 10 , wherein the stabilized trajectory of viewing direction is generated by smoothing jerkiness or shakiness in the trajectory of viewing direction.

15 . The system of claim 10 , wherein the different axes of rotation for the viewing directions include a yaw axis, a pitch axis, and a roll axis.

16 . The system of claim 15 , wherein the trajectory of viewing direction for the video being differently stabilized for the different axes of rotation for the viewing directions includes stabilization of the trajectory of viewing direction for the video about one of the yaw axis, the pitch axis, or the roll axis being different from stabilization of the trajectory of viewing direction for the video about another of the yaw axis, the pitch axis, and the roll axis.

17 . The system of claim 16 , wherein the stabilized trajectory of viewing direction for the video is generated further based on a viewing size constraint.

18 . The system of claim 17 , wherein the viewing size constraint limits deviation of a viewing size associated with the stabilized trajectory of viewing direction from a viewing size associated with the trajectory of viewing direction.

19 . A system for stabilizing viewing of video content, comprising:
one or more physical processors configured by machine-readable instructions to:
obtain a video having a progress length;
obtain a trajectory of viewing direction for the video, the trajectory of viewing direction including viewing directions for moments within the progress length of the video, the viewing directions characterized by rotations about different axes, wherein the different axes of rotation for the viewing directions include a yaw axis, a pitch axis, and a roll axis;
stabilize the trajectory of viewing direction for the video by smoothing jerkiness or shakiness in the trajectory of viewing direction to generate a stabilized trajectory of viewing direction for the video, wherein the stabilized trajectory of viewing direction for the video includes the trajectory of viewing direction for the video that is differently stabilized for the different axes of rotation for the viewing directions, wherein the trajectory of viewing direction for the video being differently stabilized for the different axes of rotation for the viewing directions includes stabilization of the trajectory of viewing direction for the video about one of the yaw axis, the pitch axis, or the roll axis being different from stabilization of the trajectory of viewing direction for the video about another of the yaw axis, the pitch axis, and the roll axis; and
generate a stabilized video based on the stabilized viewing trajectory of viewing direction for the video.

20 . The system of claim 19 , wherein the trajectory of viewing direction is identified by a user as a function of progress through the progress length of the video via user interaction with a touchscreen display or user rotation of a mobile device.

Assignees

• Gopro Inc

Inventors

• Stimm Daryl
• Macdonald William Edward
• Schwartz Kyler William

Classifications

• H04N13/167 Primary

  Synchronising or controlling image signals · CPC title

• H04N13/117

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N5/2624 Primary

  for obtaining an image which is composed of whole input images, e.g. splitscreen · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• H04N23/689

  Motion occurring during a rolling shutter mode · CPC title