Operations on dynamic data associated with cells in spreadsheets

Patent metadata

Field	Value
Publication number	US-11157689-B2
Application number	US-201615282114-A
Country	US
Kind code	B2
Filing date	Sep 30, 2016
Priority date	Nov 2, 2015
Publication date	Oct 26, 2021
Grant date	Oct 26, 2021

Abstract

Systems for performing operations on dynamic data associated with cells of a spreadsheet are provided. Both dynamic data and static data may be associated with a single cell of the spreadsheet. Upon association, parameters (including stream attributes, video attributes, image attributes and audio attributes) may be manipulated by a user, providing dynamic data processing functionality within a spreadsheet. Controls may be provided for playing the dynamic data and/or playing the dynamic data in response to spreadsheet data satisfying a condition. Operations for inserting text transcriptions (e.g., speech-to-text) of an audio track associated with dynamic data as subtitles may further be provided. Spreadsheet operations (e.g., sort and/or filter operations) may also be performed on a range of cells based on parameters of associated dynamic data.

First claim

What is claimed is:

1. A system comprising:
a processing unit; and
memory storing computer executable instructions that, when executed by the processing unit, cause the system to perform steps comprising:
receiving a selection of a first spreadsheet cell associated with a video;
shredding the video into a plurality of frames;
analyzing the plurality of frames to identify a type of objects associated with an action at a specific time and determine a parameter for each frame based on the identified objects;
associating each frame of the plurality of frames with a different spreadsheet cell of a range of spreadsheet cells;
extracting, using an attribute component of a spreadsheet application, a data value for the parameter of each frame from each spreadsheet cell of the range of spreadsheet cells;
receiving a selection of a spreadsheet operation; and
based on the data value extracted for the parameter of each frame from each spreadsheet cell of the range of spreadsheet cells, performing a selected spreadsheet operation on the range of spreadsheet cells.

2. The system of claim 1 , wherein the video comprises one or more of:
streaming video; and
streaming audio.

3. The system of claim 2 , wherein the parameter comprises one or more of:
a frame rate;
an aspect ratio;
a duration;
a resolution; or
a video size.

4. The system of claim 2 , wherein the video comprises streaming audio, the parameter comprising:
a volume;
a pitch;
a speed;
a channel; or
a resolution.

5. The system of claim 1 , wherein the memory stores the computer executable instructions that, when executed by the processing unit, cause the system to further perform the step of providing a user interface (UI) displaying controls for performing the selected spreadsheet operation.

6. The system of claim 1 , wherein the memory stores the computer executable instructions that, when executed by the processing unit, cause the system to further perform the step of providing a user interface for viewing each of the plurality of frames.

7. The system of claim 1 , wherein each frame of the plurality of frames is associated with an array of pixel values, and the memory stores the computer executable instructions that, when executed by the processing unit, cause the system to further perform the step of providing a user interface (UI) for viewing and manipulating each array of pixel values.

8. The system of claim 1 , wherein the spreadsheet operation comprises a sorting operation that sorts the range of cells or a filtering operation that filters the range of cells.

9. A method for performing one or more operations on a video file within a spreadsheet, the method comprising:
receiving a selection of a first spreadsheet cell associated with a video;
shredding the video into a plurality of frames including a first frame and a second frame;
analyzing the plurality of frames to identify a type of objects associated with an action at a specific time and determine a parameter for each frame based on the identified objects;
associating the first frame with a second spreadsheet cell and the second frame with a third spreadsheet cell;
extracting, using an attribute component of a spreadsheet application, a first data value for the parameter from the first frame and a second data value for the parameter from the second frame;
receiving a selection of a spreadsheet operation; and
based on the first data value and the second data value, performing a selected spreadsheet operation on the second spreadsheet cell and the third spreadsheet cell.

10. The method of claim 9 , wherein the parameter is associated with the video.

11. The method of claim 9 , wherein the parameter comprises one or more of:
a frame rate;
an aspect ratio;
a duration;
a resolution; and
a video size.

12. The method of claim 9 , further comprising providing a user interface for viewing each of the plurality of frames.

13. The method of claim 9 , wherein each frame of the plurality of frames is associated with an array of pixel values, and the method further comprising providing a user interface (UI) for viewing and manipulating the array of pixel values.

14. A non-transitory computer-readable storage medium storing computer executable instructions that, when executed by at least one processing unit, cause a computing device to:
receive a selection of a first spreadsheet cell associated with a video;
shred the video into a plurality of frames;
analyze the plurality of frames to identify a type of objects associated with an action at a specific time and determine a parameter for each frame based on the identified objects;
associate each frame of the plurality of frames with a different spreadsheet cell of a range of spreadsheet cells;
extract, using an attribute component of a spreadsheet application, a data value for the parameter of each frame from each spreadsheet cell of the range of spreadsheet cells;
receive a selection of a spreadsheet operation; and
based on the data value extracted for the parameter of each frame from each spreadsheet cell of the range of spreadsheet cells, perform a selected spreadsheet operation on the range of spreadsheet cells.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the selected spreadsheet operation reorders the range of spreadsheet cells and moves the frame associated with each of the reordered spreadsheet cells.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the video comprises one or more of:
streaming video; and
streaming audio.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the selected spreadsheet operation comprises one of:
sorting the range of spreadsheet cells based at least in part on the data value for the parameter of each frame of the plurality of frames;
filtering the range of spreadsheet cells based at least in part on the data value for the parameter of each frame of the plurality of frames; or
performing conditional formatting on the range of spreadsheet cells based at least in part on the data value associated with the parameter of each frame of the plurality of frames.

18. The non-transitory computer-readable storage medium of claim 14 , wherein the parameter comprises one or more of:
a frame rate;
an aspect ratio;
a duration;
a resolution; or
a video size.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the video includes streaming audio, and the parameter comprises one or more of:
a volume;
a pitch;
a speed;
a channel; or
a resolution.

20. The non-transitory computer-readable storage medium of claim 14 , wherein the computer executable instructions that, when executed by at least one processing unit, cause the computing device to further provide a user interface for viewing each of the plurality of frames.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Campbell John
• Otero Carlos Augusto
• Canton Christian
• Fichtner Matthew Hart
• Radakovitz Samuel C
• Rampson Benjamin Edward

Classifications

• G06T11/26

  Drawing of charts or graphs · CPC title

• H04L65/70

  Media network packetisation · CPC title

• H04L65/65

  Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] · CPC title

• G06F40/18 Primary

  of spreadsheets (form-filling G06F40/174) · CPC title

• H04L43/045

  for graphical visualisation of monitoring data · CPC title