Facilitating editing of virtual-reality content using a virtual-reality headset

Patent metadata

Field	Value
Publication number	US-10754529-B2
Application number	US-201615337457-A
Country	US
Kind code	B2
Filing date	Oct 28, 2016
Priority date	Oct 28, 2016
Publication date	Aug 25, 2020
Grant date	Aug 25, 2020

Abstract

The present disclosure is directed toward systems and methods that enable simultaneous viewing and editing of audio-visual content within a virtual-reality environment (i.e., while wearing a virtual-reality device). For example, the virtual-reality editing system allows for editing of audio-visual content while viewing the audio-visual content via a virtual-reality device. In particular, the virtual-reality editing system provides an editing interface over a display of audio-visual content provided via a virtual-reality device (e.g., a virtual-reality headset) that allows for editing of the audio-visual content.

First claim

What is claimed is:

1. In a digital medium environment for viewing and revising virtual-reality audio visual content, a computer-implemented method for facilitating editing of the virtual-reality audio visual content in a virtual-reality environment, the method comprising:
providing a virtual-reality display of a virtual-reality content item via a virtual-reality device;
providing an editing interface over a portion of the virtual-reality display of the virtual-reality content item, the editing interface comprising a plurality of controls for implementing and previewing edits to the virtual-reality content item;
detecting a selection of a control from the plurality of controls from the editing interface;
modifying, in real-time, the virtual-reality display of the virtual-reality content item in response to detecting the selection of the control by providing a first preview of a first video clip and a second preview of a second video clip;
receiving a confirmation of an edit to perform to the virtual-reality content item by receiving user input with respect to the first preview indicating a rotation of the first video clip relative to the second video clip, wherein receiving the user input with respect to the first preview comprises detecting a horizontal rotation of the virtual-reality device while the first preview is selected; and
generating a revised virtual-reality content item in response to receiving the confirmation of the edit by reorienting a true north of the first video clip with respect to the second video clip so as to change an orientation of a last frame for the first video clip.

2. The method of claim 1 , wherein providing the virtual-reality display of the virtual-reality content item comprises providing a displayed portion of the virtual-reality content item within a field of view of the virtual-reality device and a peripheral portion of the virtual-reality content item outside the field of view of the virtual-reality device.

3. The method of claim 2 , wherein the peripheral portion of the virtual-reality content item is viewable via movement of the virtual-reality device.

4. The method of claim 1 , wherein providing the editing interface over the portion of the virtual-reality display comprises providing the editing interface within a field of view of the virtual-reality device irrespective of movement or an orientation of the virtual-reality device.

5. The method of claim 4 , further comprising, in response to detecting movement of the virtual-reality device, modifying the portion of the virtual-reality content item in the field of view of the virtual-reality device without modifying a position of the editing interface within the field of view of the virtual-reality device.

6. The method of claim 1 , wherein detecting the selection of the control comprises detecting a selection of an alignment control to align a last frame of a first video clip with a first frame of a second video clip at a transition from the first video clip to the second video clip.

7. The method of claim 6 , further comprising displaying the first preview of the first video clip and the second preview of the second video clip within a field of view of the virtual-reality device with an indication of an orientation of the last frame and an orientation of the first frame at the transition.

8. The method of claim 1 , wherein:
detecting the selection of the control from the plurality of controls comprises detecting a scrolling action; and
modifying the virtual-reality display of the virtual-reality content item comprises narrowing a field of view of the virtual-reality display.

9. The method of claim 8 , wherein narrowing the field of view comprises narrowing the field of view based on a scrolling speed of the detected scrolling action.

10. The method of claim 8 , wherein narrowing the field of view comprises narrowing the field of view based on detected movement of one or more objects within the virtual-reality display.

11. The method of claim 8 , wherein narrowing the field of view comprises displaying a background that obstructs an outer portion of the virtual-reality display.

12. The method of claim 1 , wherein:
detecting the selection of the control from the plurality controls comprises detecting an addition of a graphic to the virtual-reality display; and
modifying the virtual-reality display of the virtual-reality content item comprises displaying the graphic over a portion of the virtual-reality display.

13. A non-transitory computer-readable storage medium comprising instructions that, when executed by at least one processor, cause a computer system to:
provide a virtual-reality display of virtual-reality content via a virtual-reality device;
provide an editing interface over a portion of the virtual-reality display of the virtual-reality content, the editing interface comprising a plurality of controls for implementing and previewing edits to the virtual-reality content;
detect a selection of a control from the plurality of controls from the editing interface;
determine a motion of one or more objects within the virtual-reality display of the virtual-reality content;
determine a scroll rate of a scrolling action, wherein the scrolling action comprises scrubbing through the virtual-reality content by moving in time through a sequence of events corresponding to the motion of the one or more objects in the virtual-reality display; and
narrow a field of view of the virtual-reality display of the virtual-reality content based on the determined motion of one or more objects and the determined scroll rate.

14. The non-transitory computer readable storage medium of claim 13 , further comprising instructions that, when executed by the at least one processor, cause the computing system to:
detect a user input with respect to a first preview of a first video clip indicating a rotation of the first video clip relative to a second video clip; and
generate a revised virtual-reality content item comprising a reoriented portion of the virtual-reality content corresponding to the first video clip.

15. The non-transitory computer readable storage medium of claim 13 , wherein narrowing the field of view comprises providing a uniform background over outer portions of the field of view.

16. The non-transitory computer readable storage medium of claim 13 , further comprising scrubbing through the virtual-reality content based on user input modifying a position of a position icon within the virtual-reality display.

17. A system comprising:
memory comprising a virtual-reality content item;
a virtual-reality device; and
a computing device comprising instructions thereon that, when executed by the computing device, cause the system to:
provide the virtual-reality content item for display via the virtual-reality device;
cause the virtual-reality device to display an editing interface over a portion of
a virtual-reality display of the virtual-reality content item, the editing interface comprising a plurality of controls for implementing and previewing edits to the virtual-reality content item;
detect a selection of a control from the plurality of controls from the editing interface;
modify, in real-time, the virtual-reality display of the virtual-reality content item in response to detecting the selection of the control by providing a first preview of a first video clip and a second preview of a second video clip;
receive a confirmation of an edit to perform to the virtual-reality content item by receiving user input with respect to the first preview indicating a rotation of the fir

Assignees

• Adobe Inc

Inventors

• Diverdi Stephen
• Hertzmann Aaron
• Nguyen Cuong

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N5/262

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title