Spherical video editing

Patent metadata

Field	Value
Publication number	US-2022301593-A1
Application number	US-202217831986-A
Country	US
Kind code	A1
Filing date	Jun 3, 2022
Priority date	Dec 15, 2017
Publication date	Sep 22, 2022
Grant date	—

Abstract

Systems and methods provide for editing of spherical video data. In one example, a computing device can receive a spherical video (or a video associated with an angular field of view greater than an angular field of view associated with a display screen of the computing device), such as by a built-in spherical video capturing system or acquiring the video data from another device. The computing device can display the spherical video data. While the spherical video data is displayed, the computing device can track the movement of an object (e.g., the computing device, a user, a real or virtual object represented in the spherical video data, etc.) to change the position of the viewport into the spherical video. The computing device can generate a new video from the new positions of the viewport.

First claim

What is claimed is:

1 . A method comprising:
accessing, by one or more processors, a set of one or more spherical frames; determining, by the one or more processors, a corresponding portion of each spherical frame in the set based on a corresponding position along a path of motion; and generating, by the one or more processors, a video based on one or more of the determined corresponding portions.

2 . The method of claim 1 , further comprising:
detecting the path of motion based on motion sensor data that indicates device movement along at least a portion of the path of motion; and wherein: the determining of the corresponding portion of each spherical frame includes determining a first portion of a first spherical frame among the set of one or more spherical frames based on the portion of the path of motion along which the device movement is indicated by the motion sensor data.

3 . The method of claim 1 , further comprising:
detecting the path of motion based on position sensor data that indicates device movement along at least a portion of the path of motion; and wherein: the determining of the corresponding portion of each spherical frame includes determining a first portion of a first spherical frame among the set of one or more spherical frames based on the portion of the path of motion along which the device movement is indicated by the position sensor data.

4 . The method of claim 1 , further comprising:
detecting the path of motion based on optical sensor data that indicates device movement along at least a portion of the path of motion; and wherein: the determining of the corresponding portion of each spherical frame includes determining a first portion of a first spherical frame among the set of one or more spherical frames based on the portion of the path of motion along which the device movement is indicated by the optical sensor data.

5 . The method of claim 1 , wherein:
the path of motion is indicated as an editing input; and the determining of the corresponding portion of each spherical frame is based on the path of motion indicated as the editing input.

6 . The method of claim 1 , further comprising:
detecting the path of motion during activation of a control element that corresponds to an editing mode of a device, the activation of the control element indicating that the path of motion is an editing input.

7 . The method of claim 1 , wherein:
the set of one or more spherical frames is included in a spherical video; and the method further comprises: detecting the path of motion in response to a designation of the path as an editing input to edit the spherical video.

8 . The method of claim 1 , wherein:
the set of one or more spherical frames is included in a spherical video; and the method further comprises: detecting the path of motion by tracking movement of an object depicted in the spherical video, the path of motion being defined by the tracked movement of the object depicted in the spherical video.

9 . The method of claim 1 , further comprising:
detecting the path of motion based on tracked movement of an object detected by a sensor of a device, the path of motion being defined by the tracked movement of the object detected by the sensor of the device.

10 . The method of claim 1 , further comprising:
detecting the path of motion based on tracked movement of an eye of a user of a device, the eye being detected by a sensor of the device, the path of motion being defined by the tracked movement of the eye of the user.

11 . The method of claim 1 , further comprising:
detecting the path of motion based on tracked movement of a head a user of a device, the head being detected by a sensor of the device, the path of motion being defined by the tracked movement of the head of the user.

12 . A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
accessing a set of one or more spherical frames; determining a corresponding portion of each spherical frame in the set based on a corresponding position along a path of motion; and generating a video based on one or more of the determined corresponding portions.

13 . The non-transitory machine-readable storage medium of claim 12 , wherein:
the path of motion is indicated as an editing input; and the determining of the corresponding portion of each spherical frame is based on the path of motion indicated as the editing input.

14 . The non-transitory machine-readable storage medium of claim 12 , wherein:
detecting the path of motion during activation of a control element that corresponds to an editing mode of a device, the activation of the control element indicating that the path of motion is an editing input.

15 . The non-transitory machine-readable storage medium of claim 12 , wherein:
the set of one or more spherical frames is included in a spherical video; and the operations further comprise: detecting the path of motion in response to a designation of the path as an editing input to edit the spherical video.

16 . A system comprising:
one or more processors; and a memory storing instructions that, when executed by at least one processor among the one or more processors, cause the system to perform operations comprising: accessing a set of one or more spherical frames; determining a corresponding portion of each spherical frame in the set based on a corresponding position along a path of motion; and generating a video based on one or more of the determined corresponding portions.

17 . The system of claim 16 , wherein:
the path of motion is indicated as an editing input; and the determining of the corresponding portion of each spherical frame is based on the path of motion indicated as the editing input.

18 . The system of claim 16 , wherein:
detecting the path of motion during activation of a control element that corresponds to an editing mode of a device, the activation of the control element indicating that the path of motion is an editing input.

19 . The system of claim 16 , wherein:
the set of one or more spherical frames is included in a spherical video; and the operations further comprise: detecting the path of motion in response to a designation of the path as an editing input to edit the spherical video.

20 . The system of claim 16 , wherein:
the set of one or more spherical frames is included in a spherical video; and the operations further comprise: detecting the path of motion by tracking movement of an object depicted in the spherical video, the path of motion being defined by the tracked movement of the object depicted in the spherical video.

Assignees

• Snap Inc

Inventors

• Huang Justin

Classifications

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N9/8042

  involving data reduction · CPC title

• H04N9/8205

  involving the multiplexing of an additional signal and the colour video signal · CPC title