Spherical video editing

Patent metadata

Field	Value
Publication number	US-11037601-B2
Application number	US-202016798028-A
Country	US
Kind code	B2
Filing date	Feb 21, 2020
Priority date	Dec 15, 2017
Publication date	Jun 15, 2021
Grant date	Jun 15, 2021

Abstract

Systems and methods provide for editing of spherical video data. In one example, a computing device can receive a spherical video (or a video associated with an angular field of view greater than an angular field of view associated with a display screen of the computing device), such as by a built-in spherical video capturing system or acquiring the video data from another device. The computing device can display the spherical video data. While the spherical video data is displayed, the computing device can track the movement of an object (e.g., the computing device, a user, a real or virtual object represented in the spherical video data, etc.) to change the position of the viewport into the spherical video. The computing device can generate a new video from the new positions of the viewport.

First claim

What is claimed is:

1. A method comprising:
accessing, by one or more processors of a machine, a spherical video that includes spherical frames;
detecting, by one or more processors of the machine, a path of motion indicated as an editing input;
determining, by one or more processors of the machine, portions of the spherical frames based on the path of motion, each portion being determined from a different corresponding spherical frame among the spherical frames based on a different corresponding position along the path of motion indicated as the editing input; and
generating, by one or more processors of the machine, an output video that represents the path of motion and includes output frames generated based on the determined portions of the spherical frames.

2. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes capturing motion sensor data that indicates device movement along at least a portion of the path of motion indicated at the editing input.

3. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes capturing position sensor data that indicates device movement along at least a portion of the path of motion indicated at the editing input.

4. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes capturing optical sensor data that indicates device movement along at least a portion of the path of motion indicated at the editing input.

5. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes detecting the path of motion during activation of a control element that corresponds to maintenance of an editing mode of a device.

6. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes detecting the path of motion in response to activation of a control element that corresponds to entering an editing mode of a device.

7. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes detecting that the path of motion is selected as the editing input.

8. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of an object depicted in the spherical video, the path of motion indicated as the editing input being defined by the tracked movement of the object depicted in the spherical video.

9. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of an object detected by a sensor of a device, the path of motion indicated as the editing input being defined by the tracked movement of the object detected by the sensor of the device.

10. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of an eye of a user of a device, the eye being detected by a sensor of the device, the path of motion indicated as the editing input being defined by the tracked movement of the eye of the user.

11. The method of claim 1 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of a head a user of a device, the head being detected by a sensor of the device, the path of motion indicated as the editing input being defined by the tracked movement of the head of the user.

12. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
accessing a spherical video that includes spherical frames;
detecting a path of motion indicated as an editing input;
determining portions of the spherical frames based on the path of motion, each portion being determined from a different corresponding spherical frame among the spherical frames based on a different corresponding position along the path of motion indicated as the editing input; and
generating an output video that represents the path of motion and includes output frames generated based on the determined portions of the spherical frames.

13. The non-transitory machine-readable storage medium of claim 12 , wherein:
the detecting of the path of motion indicated as the editing input includes capturing motion sensor data that indicates device movement along at least a portion of the path of motion indicated at the editing input.

14. The non-transitory machine-readable storage medium of claim 12 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of an object depicted in the spherical video, the path of motion indicated as the editing input being defined by the tracked movement of the object depicted in the spherical video.

15. The non-transitory machine-readable storage medium of claim 12 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of an object detected by a sensor of a device, the path of motion indicated as the editing input being defined by the tracked movement of the object detected by the sensor of the device.

16. A system comprising:
one or more processors; and
a memory storing instructions that, when executed by at least one processor among the one or more processors, cause the system to perform operations comprising:
accessing a spherical video that includes spherical frames;
detecting a path of motion indicated as an editing input;
determining portions of the spherical frames based on the path of motion, each portion being determined from a different corresponding spherical frame among the spherical frames based on a different corresponding position along the path of motion indicated as the editing input; and
generating an output video that represents the path of motion and includes output frames generated based on the determined portions of the spherical frames.

17. The system of claim 16 , wherein:
the detecting of the path of motion indicated as the editing input includes capturing motion sensor data that indicates device movement along at least a portion of the path of motion indicated at the editing input.

18. The system of claim 16 , wherein:
the detecting of the path of motion indicated as the editing input includes detecting the path of motion during activation of a control element that corresponds to maintenance of an editing mode of a device.

19. The system of claim 16 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of an object depicted in the spherical video, the path of motion indicated as the editing input being defined by the tracked movement of the object depicted in the spherical video.

20. The system of claim 16 , wherein:
the detecting of the path of motion indicated as the editing input includes tracking movement of an object detected by a sensor of a device, the path of motion indicated as the editing input being defined by the tracked movement of the object detected by the sensor of the device.

Assignees

• Snap Inc

Inventors

• Huang Justin

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N21/845

  Structuring of content, e.g. decomposing content into time segments · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title