Systems and methods for determining viewing paths through videos

Patent metadata

Field	Value
Publication number	US-11683440-B2
Application number	US-202217965452-A
Country	US
Kind code	B2
Filing date	Oct 13, 2022
Priority date	Aug 30, 2019
Publication date	Jun 20, 2023
Grant date	Jun 20, 2023

Abstract

Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.

First claim

What is claimed is:

1. A system for determining viewing paths through videos, the system comprising:
one or more physical processors configured by machine-readable instructions to:
obtain video information defining a video, the video including video content having a progress length, the video content including visual content viewable as a function of progress through the progress length, the visual content having a field of view;
obtain framing information for the video based on analysis of the video, the framing information defining separate framings of the visual content at separate moments within the progress length, an individual framing of the visual content defining a positioning of a viewing window within the field of view of the visual content at a corresponding moment within the progress length;
determine a viewing path for the video based on the framing information, the viewing path defining the positioning of the viewing window within the field of view of the visual content as the function of progress through the progress length, wherein determination of the viewing path for the video based on the framing information includes determination of changes in the positioning of the viewing window within the field of view of the visual content based on the separate framings of the visual content at the separate moments within the progress length; and
generate a presentation of the video content based on the viewing path, the presentation of the video content including extents of the visual content within the viewing window.

2. The system of claim 1 , wherein the individual framing of the visual content defines the positioning of the viewing window within the field of view of the visual content based on a viewing direction, a viewing size, and a viewing rotation.

3. The system of claim 2 , wherein the individual framing of the visual content further defines a viewing projection of the visual content within the viewing window.

4. The system of claim 3 , wherein the framing information is obtained further based on a user's interaction with a user interface, the user interface enabling the user to set one or more of the viewing direction, the viewing size, the viewing rotation, and/or the viewing projection.

5. The system of claim 1 , wherein at least one of the separate framings include a moment-to-duration framing, the moment-to-duration framing extending a moment within the progress length to a duration longer than the moment within the presentation of the video content, the moment-to-duration framing including multiple sub-framings within the duration.

6. The system of claim 1 , wherein the video includes a spherical video and the visual content is viewable from a point of view as the function of progress through the progress length.

7. The system of claim 1 , wherein the analysis of the video includes visual content detection and/or audio content detection.

8. The system of claim 1 , wherein the framing information is extracted from the video information.

9. The system of claim 1 , wherein:
the viewing path includes viewing path segments for individual pairs of adjacent framings;
the viewing path includes a first viewing path segment for a pair of a first framing of the visual content at a first moment within the progress length and a second framing of the visual content at a second moment within the progress length; and
the first viewing path segment defines changes in the positioning of the viewing window within the field of view of the visual content from a first positioning at the first moment to a second positioning at the second moment.

10. A method for determining viewing paths through videos, the method performed by a computing system including one or more processors, the method comprising:
obtaining, by the computing system, video information defining a video, the video including video content having a progress length, the video content including visual content viewable as a function of progress through the progress length, the visual content having a field of view;
obtaining, by the computing system, framing information for the video based on analysis of the video, the framing information defining separate framings of the visual content at separate moments within the progress length, an individual framing of the visual content defining a positioning of a viewing window within the field of view of the visual content at a corresponding moment within the progress length;
determining, by the computing system, a viewing path for the video based on the framing information, the viewing path defining the positioning of the viewing window within the field of view of the visual content as the function of progress through the progress length, wherein determining the viewing path for the video based on the framing information includes determining changes in the positioning of the viewing window within the field of view of the visual content based on the separate framings of the visual content at the separate moments within the progress length; and
generating, by the computing system, a presentation of the video content based on the viewing path, the presentation of the video content including extents of the visual content within the viewing window.

11. The method of claim 10 , wherein the individual framing of the visual content defines the positioning of the viewing window within the field of view of the visual content based on a viewing direction, a viewing size, and a viewing rotation.

12. The method of claim 11 , wherein the individual framing of the visual content further defines a viewing projection of the visual content within the viewing window.

13. The method of claim 12 , wherein the framing information is obtained further based on a user's interaction with a user interface, the user interface enabling the user to set one or more of the viewing direction, the viewing size, the viewing rotation, and/or the viewing projection.

14. The method of claim 10 , wherein at least one of the separate framings include a moment-to-duration framing, the moment-to-duration framing extending a moment within the progress length to a duration longer than the moment within the presentation of the video content, the moment-to-duration framing including multiple sub-framings within the duration.

15. The method of claim 10 , wherein the video includes a spherical video and the visual content is viewable from a point of view as the function of progress through the progress length.

16. The method of claim 10 , wherein the analysis of the video includes visual content detection and/or audio content detection.

17. The method of claim 10 , wherein the framing information is extracted from the video information.

18. The method of claim 10 , wherein:
the viewing path includes viewing path segments for individual pairs of adjacent framings;
the viewing path includes a first viewing path segment for a pair of a first framing of the visual content at a first moment within the progress length and a second framing of the visual content at a second moment within the progress length; and
the first viewing path segment defines changes in the positioning of the viewing window within the field of view of the visual content from a first positioning at the first moment to a second positioning at the second moment.

19. A system for determining viewing paths through videos, the system comprising:
one or more physical processors configured by machine-readable instructions to:
obtain video information defining a video, the video including video content having a

Assignees

• Gopro Inc

Inventors

• Stimm Daryl
• Schwartz Kyler William
• Macdonald William Edward

Classifications

• H04N5/2628 Primary

  Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N13/117

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title