Facilitating editing of spherical panorama videos using a virtual-reality headset

Patent metadata

Field	Value
Publication number	US-11216170-B2
Application number	US-202016944902-A
Country	US
Kind code	B2
Filing date	Jul 31, 2020
Priority date	Oct 28, 2016
Publication date	Jan 4, 2022
Grant date	Jan 4, 2022

Abstract

The present disclosure is directed toward systems and methods that enable simultaneous viewing and editing of audio-visual content within a virtual-reality environment (i.e., while wearing a virtual-reality device). For example, the virtual-reality editing system allows for editing of audio-visual content while viewing the audio-visual content via a virtual-reality device. In particular, the virtual-reality editing system provides an editing interface over a display of audio-visual content provided via a virtual-reality device (e.g., a virtual-reality headset) that allows for editing of the audio-visual content.

First claim

What is claimed is:

1. A computer-implemented method for facilitating editing of audio visual content in a virtual-reality environment, the computer-implemented method comprising:
providing a display of a spherical panorama video via a virtual-reality device, the spherical panorama video comprising greater than 180 degrees of a horizontal field of view;
providing an interactive editing interface via the virtual-reality device over a portion of the display of the spherical panorama video, the interactive editing interface comprising:
a plurality of controls for implementing and previewing edits to the spherical panorama video, and
a video layer timeline displaying an order of a plurality of spherical panorama video clips forming the spherical panorama video;

detecting, via the virtual-reality device, a user interaction with the interactive editing interface provided over the portion of the display of the spherical panorama video displayed by the virtual-reality device;
performing a modification, in real-time in response to the user interaction with the interactive editing interface, to the spherical panorama video by shifting the order of at least one of the plurality of spherical panorama video clips, inserting an additional spherical panorama video clip, removing a spherical panorama video clip from the spherical panorama video, trimming a spherical panorama video clip, or rotationally aligning a default orientation of a spherical panorama video clip; and
providing a preview of the spherical panorama video with the modification via the virtual-reality device.

2. The computer-implemented method of claim 1 , wherein providing the display of the spherical panorama video comprises displaying a portion of the spherical panorama video aligned to a field of view and not displaying a peripheral portion of the spherical panorama video.

3. The computer-implemented method of claim 2 , further comprising:
modifying the display of the spherical panorama video to include a view of the portion of the spherical panorama video aligned to the field of view and the peripheral portion of the spherical panorama video; and
providing a visual indication of one or more of the portion of the spherical panorama video aligned to the field of view or the peripheral portion of the spherical panorama video.

4. The computer-implemented method of claim 3 , wherein providing the visual indication of one or more of the portion of the spherical panorama video aligned to the field of view of the virtual-reality device or the peripheral portion of the spherical panorama video comprises applying a color filter to one or more of the portion of the spherical panorama video aligned to the field of view of the virtual-reality device or the peripheral portion.

5. The computer-implemented method of claim 3 , wherein performing the modification, in real-time in response to the user interaction with the video layer timeline, to the spherical panorama video comprises horizontally rotating the spherical panorama video to realign the spherical panorama video relative to the field of view so that a portion of the spherical panorama video is re-aligned relative to the field of view comprises at least a section of the peripheral portion of the spherical panorama video.

6. The computer-implemented method of claim 5 , wherein:
the virtual-reality device is a headset;
detecting the user interaction with the interactive editing interface comprises detecting selection of a spherical panorama video clip; and
rotating the spherical panorama video is in response to movement of the headset.

7. The computer-implemented method of claim 1 , wherein:
detecting the user interaction with the interactive editing interface comprises detecting a dragging of a front or back handle of a spherical panorama video clip within the video layer timeline; and
performing the modification, in real-time in response to the user interaction with the interactive editing interface, to the spherical panorama video comprises trimming the spherical panorama video clip based on movement of the front or back handle.

8. The computer-implemented method of claim 1 , further comprising:
receiving a confirmation of the modification after providing the preview; and
generating a revised spherical panorama video including the modification.

9. The computer-implemented method of claim 1 , wherein:
further comprising detecting a scrolling action; and
narrowing a field of view of the display based on a scrolling speed of the detected scrolling action.

10. The computer-implemented method of claim 1 , wherein:
detecting the user interaction with the interactive editing interface comprises detecting a selection and movement of a spherical panorama video clip within the video layer timeline; and
performing the modification, in real-time in response to the user interaction with the interactive editing interface, to the spherical panorama video comprises shifting the order of the at least one of the plurality of spherical panorama video clips based on the movement.

11. A system comprising:
memory comprising a virtual-reality content item;
a virtual-reality headset device; and
a computing device configured to cause the system to:
provide a display of a spherical panorama video via the virtual-reality headset device, the spherical panorama video comprising greater than 180 degrees of a horizontal field of view;
provide an interactive editing interface via the virtual-reality headset device over a portion of the display of the spherical panorama video, the interactive editing interface comprising:
a plurality of controls for implementing and previewing edits to the spherical panorama video, and
a video layer timeline displaying an order of a plurality of spherical panorama video clips forming the spherical panorama video;

detect, via the virtual-reality headset device, a user interaction with the interactive editing interface provided over the portion of the display of the spherical panorama video displayed by the virtual-reality headset device;
perform a modification to, in real-time in response to the user interaction with the interactive editing interface, the spherical panorama video by shifting the order of at least one of the plurality of spherical panorama video clips, inserting an additional spherical panorama video clip, removing a spherical panorama video clip from the spherical panorama video, trimming a spherical panorama video clip, or rotationally aligning a default orientation of a spherical panorama video clip; and
provide a preview of the spherical panorama video with the modification via the virtual-reality headset device.

12. The system of claim 11 , wherein the computing device is configured to cause the system to cause the system to perform the modification to the spherical panorama video by:
provide a frame of a first spherical panorama video clip positioned above a frame of a second spherical panorama video clip;
visually indicate an orientation of the frame of the first spherical panorama video clip, the orientation of the frame of the first spherical panorama video clip dictating a field of view of the first spherical panorama video clip to be shown by default when viewing the first spherical panorama video clip;
visually indicate an orientation of the frame of the second spherical panorama video clip, the orientation of the frame of the second spherical panorama video clip dictating a field of view of the second spherical panorama video clip to be shown by default when viewing the second spherical panorama video clip; and
rotate, in response the user interaction, the orientation of one or more of the frame of the fi

Assignees

• Adobe Inc

Inventors

• Diverdi Stephen
• Hertzmann Aaron
• Nguyen Cuong

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• H04N5/262

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title