Device, method and computer program product for creating viewable content on an interactive display using gesture inputs indicating desired effects

Patent metadata

Field	Value
Publication number	US-10817167-B2
Application number	US-201615267113-A
Country	US
Kind code	B2
Filing date	Sep 15, 2016
Priority date	Sep 15, 2016
Publication date	Oct 27, 2020
Grant date	Oct 27, 2020

Abstract

A device, method and computer program product for creating viewable content on an interactive display is provided. The method includes providing a user interface on a device for creating viewable content from a collection comprising at least one multimedia content. The method includes causing the user interface, by a processor, to present an interactive display to the user. The method includes presenting the collection on the interactive display. Further, the method includes receiving one or more gesture inputs by the user on the collection, wherein each gesture input indicates at least one of a desired effect to be performed and a region to be displayed on a viewport of the device. Furthermore, the method includes creating a viewable content from the at least one multimedia content of the collection based on the one or more gesture inputs.

First claim

The invention claimed is:

1. A method, comprising:
providing a user interface on a device for creating viewable content from a collection comprising a plurality of multimedia content;
causing the user interface, by a processor, to present an interactive display to a user;
presenting the collection on the interactive display;
associating gesture inputs to be recognized with corresponding effects to be performed on the plurality of multimedia content, including recognizing at least a line, a spiral pattern, and a closed loop;
receiving gesture inputs from the user on the collection, wherein the gesture inputs indicate desired effects to be performed, as determined by the associating, and a region to be displayed on a viewport of the device, wherein the gesture inputs are received along a trace on the user interface that defines a sequence of the effects to be performed based on (i) the gesture inputs received on, between, and around each multimedia content of the plurality of multimedia content and (ii) movements to or from each multimedia content of the plurality of multimedia content; and
creating, from the plurality of multimedia content of the collection based on the gesture inputs and the trace, a viewable content including the desired effects that are to be displayed during playback of the viewable content, the desired effects applied (i) individually to the multimedia content, (ii) when switching between multimedia content, and (iii) collectively to the plurality of multimedia content in response to the inputs received on, between, and around the multimedia content as the closed loop, respectively, wherein the closed loop completely surrounds the plurality of media content and a same one of the desired effects is applied to all of the media content of the plurality of media content within the closed loop at a same time, the closed loop being a portion of the trace having a starting point and an ending point at a same location with the plurality of media content encircled within the closed loop.

2. The method of claim 1 , further comprising storing at least one of the gesture inputs and the viewable content in a memory, wherein an initial user contact on the user interface defines a starting point for the playback of the viewable content and removing the user contact from the use interface defines an end point for the playback of the viewable content, the gesture inputs performed from the initial user contact to the removing of user contact along the trace defining the desired effects, the sequence of the desired effects, and a timing of the desired effects to be performed on the plurality of multimedia content to be displayed as the viewable content in the viewport, the plurality of multimedia content comprising multiple images or multiple video.

3. The method of claim 2 , wherein storing the gesture inputs comprise storing information associated with one or more of the gesture inputs, and the trace is a single continuous user trace on the user interface.

4. The method of claim 2 , further comprising performing a playback of the viewable content based on the gesture inputs stored in the memory, wherein a characteristic of the trace between multimedia content defines the desired effect when switching between the multimedia content during playback.

5. The method of claim 4 , wherein a speed of the playback of the viewable content is based on a speed of receipt of the gesture inputs from the user on the collection.

6. The method of claim 2 , further comprising editing the viewable content based on editing at least one gesture input of the gesture inputs that are stored.

7. The method of claim 1 , wherein the plurality of multimedia content comprises at least one of a still image, a video clip, a living image and a three dimensional object, and wherein the gesture input received around the plurality of multimedia content defines a desired effect to the plurality of multimedia content within the viewport.

8. The method of claim 1 , wherein the spiral pattern comprises at least one of a spiral-in pattern and a spiral-out pattern.

9. The method of claim 1 , wherein the desired effect includes at least one of a pan, a zoom in, and a zoom out transition between multimedia contents of the collection.

10. The method of claim 8 , wherein when a gesture input of the gesture inputs comprises the spiral-in pattern on a region of a multimedia content, the spiral-in pattern starting outside the region of the multimedia content and extending circularly inward to inside of the region of the multimedia content to cover the multimedia content, at least a plurality of spirals being within the region and on top of the multimedia content, the desired effect performed in the viewable content comprises zooming in the region of the multimedia content during playback of the viewable content.

11. The method of claim 8 , wherein when a gesture input of the gesture inputs comprises the spiral-out pattern on a region of a multimedia content, the spiral-out pattern starting within the region of the multimedia content and extending circularly outward to outside of the region of the multimedia content to cover the multimedia content, at least a plurality of spirals being within the region and on top of the multimedia content, the desired effect performed in the viewable content comprises zooming out the region of the multimedia content during playback of the viewable content.

12. The method of claim 1 , wherein when a gesture input comprises the line, the desired effect performed in the viewable content includes panning the viewable content in a direction corresponding to the line during playback of the viewable content.

13. A device, comprising:
a user interface;
a memory comprising computer program code for image processing;
and a processor configured to execute the computer program code to cause the device to at least perform:
presenting an interactive display to a user on the user interface;
presenting a collection comprising a plurality of multimedia content on the interactive display;
associating gesture inputs to be recognized with corresponding effects to be performed on the plurality of multimedia content, including recognizing at least a line, a spiral pattern, and a closed loop;
receiving gesture inputs from the user on the collection, wherein the gesture inputs indicate desired effects to be performed, as determined by the associating, and a region to be displayed on a viewport of the device, wherein the gesture inputs are received along a trace on the user interface that defines a sequence of the effects to be performed based on (i) the gesture inputs received on, between, and around each multimedia content of the plurality of multimedia content and (ii) movements to or from each multimedia content of the plurality of multimedia content; and
creating, from the plurality of multimedia content of the collection based on the gesture inputs and the trace, a viewable content including the desired effects that are to be displayed during playback of the viewable content, the desired effects applied (i) individually to the multimedia content, (ii) when switching between multimedia content, and (iii) collectively to the plurality of multimedia content in response to the inputs received on, between, and around the multimedia content, as the closed loop, respectively, wherein the closed loop completely surrounds the plurality of media content and a same one of the desired effects is applied to all of the media content of the plurality of media content within the closed loop at a same time, the closed loop being a portion of the trace having a starting point and an ending point at a same l

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Cheng Shirui
• Tran To

Classifications

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06T3/20

  Linear translation of whole images or parts thereof, e.g. panning · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title