Systems and methods for stabilizing views of videos

Patent metadata

Field	Value
Publication number	US-12519917-B2
Application number	US-202318460390-A
Country	US
Kind code	B2
Filing date	Sep 1, 2023
Priority date	Jul 27, 2018
Publication date	Jan 6, 2026
Grant date	Jan 6, 2026

Abstract

A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

First claim

What is claimed is:

1 . A method of stabilized viewing of video content, comprising:
obtaining a video having a progress length, wherein the video has been previously captured; obtaining a trajectory of viewing direction of a viewing window for the video, the trajectory of viewing direction of the viewing window including viewing directions of the viewing window for moments within the progress length of the video, the viewing directions of the viewing window characterized by rotations about different axes; stabilizing the trajectory of viewing direction of the viewing window for the video to generate a stabilized trajectory of viewing direction of the viewing window for the video, wherein the stabilized trajectory of viewing direction of the viewing window for the video includes the trajectory of viewing direction of the viewing window for the video that is differently stabilized for the different axes of rotation for the viewing directions of the viewing window; and generating a stabilized video based on the stabilized viewing trajectory of viewing direction of the viewing window for the video.

2 . The method of claim 1 , wherein the trajectory of viewing direction of the viewing window is identified by a user as a function of progress through the progress length of the video.

3 . The method of claim 2 , wherein the trajectory of viewing direction of the viewing window is identified by the user via user interaction with a touchscreen display.

4 . The method of claim 2 , wherein the trajectory of viewing direction of the viewing window is identified by the user via user rotation of a mobile device.

5 . The method of claim 1 , wherein the stabilized trajectory of viewing direction of the viewing window is generated by smoothing jerkiness or shakiness in the trajectory of viewing direction of the viewing window.

6 . The method of claim 1 , wherein the different axes of rotation for the viewing directions of the viewing window include a yaw axis, a pitch axis, and a roll axis.

7 . The method of claim 6 , wherein the trajectory of viewing direction of the viewing window for the video being differently stabilized for the different axes of rotation for the viewing directions of the viewing window includes stabilization of the trajectory of viewing direction of the viewing window for the video about one of the yaw axis, the pitch axis, or the roll axis being different from stabilization of the trajectory of viewing direction of the viewing window for the video about another of the yaw axis, the pitch axis, and the roll axis.

8 . The method of claim 7 , wherein the stabilized trajectory of viewing direction of the viewing window for the video is generated further based on a viewing size constraint of the viewing window.

9 . The method of claim 8 , wherein the viewing size constraint of the viewing window limits deviation of a viewing size of the viewing window associated with the stabilized trajectory of viewing direction of the viewing window from a viewing size of the viewing window associated with the trajectory of viewing direction of the viewing window.

10 . A system for stabilizing viewing of video content, comprising:
one or more physical processors configured by machine-readable instructions to:
obtain a video having a progress length, wherein the video has been previously captured;
obtain a trajectory of viewing direction of a viewing window for the video, the trajectory of viewing direction of the viewing window including viewing directions of the viewing window for moments within the progress length of the video, the viewing directions of the viewing window characterized by rotations about different axes;
stabilize the trajectory of viewing direction of the viewing window for the video to generate a stabilized trajectory of viewing direction of the viewing window for the video, wherein the stabilized trajectory of viewing direction of the viewing window for the video includes the trajectory of viewing direction of the viewing window for the video that is differently stabilized for the different axes of rotation for the viewing directions of the viewing window; and
generate a stabilized video based on the stabilized viewing trajectory of viewing direction of the viewing window for the video.

11 . The system of claim 10 , wherein the trajectory of viewing direction of the viewing window is identified by a user as a function of progress through the progress length of the video.

12 . The system of claim 11 , wherein the trajectory of viewing direction of the viewing window is identified by the user via user interaction with a touchscreen display.

13 . The system of claim 11 , wherein the trajectory of viewing direction of the viewing window is identified by the user via user rotation of a mobile device.

14 . The system of claim 10 , wherein the stabilized trajectory of viewing direction of the viewing window is generated by smoothing jerkiness or shakiness in the trajectory of viewing direction of the viewing window.

15 . The system of claim 10 , wherein the different axes of rotation for the viewing directions of the viewing window include a yaw axis, a pitch axis, and a roll axis.

16 . The system of claim 15 , wherein the trajectory of viewing direction of the viewing window for the video being differently stabilized for the different axes of rotation for the viewing directions of the viewing window includes stabilization of the trajectory of viewing direction of the viewing window for the video about one of the yaw axis, the pitch axis, or the roll axis being different from stabilization of the trajectory of viewing direction of the viewing window for the video about another of the yaw axis, the pitch axis, and the roll axis.

17 . The system of claim 16 , wherein the stabilized trajectory of viewing direction of the viewing window for the video is generated further based on a viewing size constraint of the viewing window.

18 . The system of claim 17 , wherein the viewing size constraint of the viewing window limits deviation of a viewing size of the viewing window associated with the stabilized trajectory of viewing direction of the viewing window from a viewing size of the viewing window associated with the trajectory of viewing direction of the viewing window.

19 . A system for stabilizing viewing of video content, comprising:
one or more physical processors configured by machine-readable instructions to:
obtain a video having a progress length, wherein the video has been previously captured;
obtain a trajectory of viewing direction of a viewing window for the video, the trajectory of viewing direction of the viewing window including viewing directions of the viewing window for moments within the progress length of the video, the viewing directions of the viewing window characterized by rotations about different axes, wherein the different axes of rotation for the viewing directions of the viewing window include a yaw axis, a pitch axis, and a roll axis;
stabilize the trajectory of viewing direction of the viewing window for the video by smoothing jerkiness or shakiness in the trajectory of viewing direction of the viewing window to generate a stabilized trajectory of viewing direction of the viewing window for the video, wherein the stabilized trajectory of viewing direction of the viewing window for the video includes the trajectory of viewing direction of the viewing window for the video that is differently stabilized for the different axes of rotation for the viewing directions of the viewing w

Assignees

• Gopro Inc

Inventors

• Stimm Daryl
• Macdonald William Edward
• Schwartz Kyler William

Classifications

• H04N13/117

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N23/689

  Motion occurring during a rolling shutter mode · CPC title

• H04N23/683

  performed by a processor, e.g. controlling the readout of an image memory · CPC title

• H04N13/167 Primary

  Synchronising or controlling image signals · CPC title