Generating visual data stories

Patent metadata

Field	Value
Publication number	US-11775582-B2
Application number	US-202218069561-A
Country	US
Kind code	B2
Filing date	Dec 21, 2022
Priority date	Jan 28, 2021
Publication date	Oct 3, 2023
Grant date	Oct 3, 2023

Abstract

This disclosure describes one or more embodiments of systems, non-transitory computer-readable media, and methods that intelligently and automatically analyze input data and generate visual data stories depicting graphical visualizations from data insights determined from the input data. For example, the disclosed systems automatically extract data insights utilizing an in-depth statistical analysis of dataset groups from data-attribute categories within the input data. Based on the data insights, the disclosed systems can automatically generate exportable visual data stories to visualize the data insights, provide textual or audio-based natural language summaries of the data insights, and animate such data insights in videos. In some embodiments, the disclosed systems generate a visual-data-story graph comprising nodes representing visual data stories and edges representing similarities between the visual data stories. Based on the visual-data-story graph, the disclosed systems can select a relevant visual data story to display on a graphical user interface.

First claim

What is claimed is:

1. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
determining data insights across different dataset groups of a dataset utilizing a statistical analysis that compares data-attribute values corresponding to the dataset groups;
generating visual data stories comprising graphical visualizations and natural language summaries of the data insights;
determining aggregate pairwise distances between data-story properties of visual-data-story pairs from the visual data stories by combining data-attribute distances, grouping-attribute distances, group-name distances, and group-insight distances between the visual-data-story pairs; and
generating a stitched-visual-data story from a combination of visual data stories selected based on the aggregate pairwise distances.

2. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise determining the data insights by determining a first data trend between a first dataset group and a second dataset group and a second data trend between the first dataset group and a third dataset group.

3. The non-transitory computer-readable medium of claim 2 , wherein the operations further comprise determining the data insights by determining that the first data trend and the second data trend follow a similar pattern or a dissimilar pattern.

4. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise generating the stitched-visual-data story as an exportable video file.

5. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise exporting the stitched-visual-data story to a website.

6. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise:
providing, for display within a first graphical user interface of a client device, the stitched-visual-data story; and
providing, for display within a second graphical user interface of the client device, one or more recommended visual data stories based on interest levels of a user of the client device with the recommended visual data stories.

7. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise providing, for display within a graphical user interface of a client device, the stitched-visual-data story as an animated video depicting changing data over time and audio data for a natural language summary of the stitched-visual-data story.

8. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise providing, for display within a graphical user interface of a client device, the stitched-visual-data story comprising a highlighted portion associated with a time segment of a visual data story indicating a specific data insight corresponding to a particular portion of a natural language summary.

9. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise:
generating a visual-data-story graph comprising nodes for the visual data stories and edges representing the aggregate pairwise distances between the data-story properties of the visual-data-story pairs; and
generating the stitched-visual-data story by combining the combination of visual data stories utilizing a minimum spanning tree algorithm with the visual-data-story graph.

10. A system comprising:
a memory component comprising data insights across different dataset groups of tabular data; and
a processing device coupled to the memory component, the processing device to perform operations comprising:
generating visual data stories comprising graphical visualizations and natural language summaries from the data insights corresponding to the different dataset groups of the tabular data;
determining aggregate pairwise distances between data-story properties of visual-data-story pairs from the visual data stories by combining data-attribute distances, grouping-attribute distances, group-name distances, and group-insight distances between the visual-data-story pairs; and
generating a stitched-visual-data story from a set of visual data stories selected based on the aggregate pairwise distances.

11. The system of claim 10 , wherein the operations further comprise:
determining the data-attribute distances by determining distances between particular data-attribute values for the dataset groups in the visual-data-story pairs;
determining the grouping-attribute distances by determining distances between particular data-attribute categories for the dataset groups in the visual-data-story pairs;
determining the group-name distances by determining distances among group names for the dataset groups in the visual-data-story pairs; or
determining the group-insight distances by determining distances between particular data insights for the dataset groups in the visual-data-story pairs.

12. The system of claim 10 , wherein the operations further comprise providing, for display within a graphical user interface of a client device, the stitched-visual-data story comprising a particular visual data story depicting a data-attribute category name, one or more dataset group insights, or data insight comparisons.

13. The system of claim 10 , wherein the operations further comprise:
receiving, from a client device, a user interaction to edit a particular visual data story within the stitched-visual-data story; and
in response to the user interaction, modifying graphical visualizations or natural language summaries of the particular visual data story.

14. The system of claim 10 , wherein the operations further comprise:
receiving, from a client device, a keyword for a search request; and
in response to receiving the keyword for the search request:
identifying one or more visual data stories based on the keyword; and
providing, for display within the client device, the one or more visual data stories.

15. The system of claim 10 , wherein the operations further comprise providing, for display within a graphical user interface of a client device, the stitched-visual-data story comprising a highlighted portion associated with a time segment indicating a specific data insight corresponding to the time segment.

16. A computer-implemented method comprising:
determining data insights across different dataset groups of a dataset utilizing a statistical analysis;
generating visual data stories comprising graphical visualizations and natural language summaries of the data insights;
determining aggregate pairwise distances between data-story properties of visual-data-story pairs from the visual data stories by combining data-attribute distances, grouping-attribute distances, group-name distances, and group-insight distances between the visual-data-story pairs; and
generating a stitched-visual-data story from a combination of visual data stories selected from a visual-data-story graph based on the aggregate pairwise distances.

17. The computer-implemented method of claim 16 , further comprising receiving, from a client device, a spreadsheet file as the dataset.

18. The computer-implemented method of claim 16 , further comprising generating the stitched-visual-data story as an exportable video file or a portable document format (PDF) file.

19. The computer-implemented method of claim 16 , further comprising providing, for display within a graphical user interface of a client device, the stitched-visual-data story

Assignees

• Adobe Inc

Inventors

• Xu Shenyu
• Koh Eunyee
• Du Fan
• Lee Tak Yeon
• Lee Sana Malik
• Rossi Ryan

Classifications

• G06T11/26

  Drawing of charts or graphs · CPC title

• G06F16/739 Primary

  in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames · CPC title

• G06F16/345

  Summarisation for human users · CPC title

• G06F16/44

  Browsing; Visualisation therefor · CPC title

• G06F16/7834

  using audio features · CPC title