Automatic grouping of document objects for reflowed layout

Patent metadata

Field	Value
Publication number	US-10031892-B2
Application number	US-201514673514-A
Country	US
Kind code	B2
Filing date	Mar 30, 2015
Priority date	Mar 30, 2015
Publication date	Jul 24, 2018
Grant date	Jul 24, 2018

Abstract

A method for arranging graphical objects in an electronic document displayed on a screen of a computing device includes calculating a plurality of positions of the graphical objects displayed on a display area of the screen, grouping the graphical objects whose calculated positions are located within a predetermined area of the display area, calculating a reference point of the group based on each position of the grouped graphical objects, reflowing the grouped graphical objects in response to a variation in display of the electronic document, calculating potential energies for the reflowed graphical objects, and displaying the electronic document with the reflowed graphical objects in a layout having the minimum potential energy among the calculated potential energies.

First claim

What is claimed is:

1. A method for arranging graphical objects in an electronic document (ED) displayed on a screen of a computing device following a variation in display of the ED, the method comprising:
calculating a plurality of initial positions for the graphical objects on a display area of the screen of the computing device, wherein the graphical objects comprise a first graphical object and a second graphical object;
grouping the graphical objects whose calculated initial positions are located within a predetermined area of the display area;
calculating a reference point of the group in an area of the ED between the first graphical object and the second graphical object based on a center-of-mass of each initial position of the grouped graphical objects;
determining, in response to the variation in display of the ED, a first arrangement comprising a first plurality of new positions for the grouped graphical objects,
wherein the first graphical object and the second graphical object are separated by a first distance in the first arrangement;
calculating, for the first arrangement, a first sum of a first plurality of potential energies stored in a first plurality of virtual springs stretched between the plurality of initial positions and the first plurality of new positions;
determining, in response to the variation in the display of the ED, a second arrangement comprising a second plurality of new positions for the grouped graphical objects,
wherein the first graphical object and the second graphical object are separated by a second distance in the second arrangement that is different than the first distance;
calculating, for the second arrangement, a second sum of a second plurality of potential energies stored in a second plurality of virtual springs stretched between the plurality of initial positions and the second plurality of new positions;
comparing the first sum of the first plurality of potential energies with the second sum of the second plurality of potential energies; and
displaying, in response to the second sum being less than the first sum, the ED with the grouped graphical objects in the second arrangement comprising the second plurality of new positions on the screen of the computing device,
wherein the graphical objects are not displayed in the first arrangement comprising the first plurality of new positions prior to comparing the first sum with the second sum,
wherein the variation in display of the ED is a change in a length and width of the display, and
wherein the first sum and the second sum are further calculated based on the reference point.

2. The method of claim 1 , wherein
the grouping further comprises grouping the graphical objects that are within a predetermined distance from each other.

3. The method of claim 2 , wherein
the grouping of the graphical objects that are located within the predetermined distance further comprises grouping the graphical objects that have no breaks therebetween.

4. The method of claim 1 , wherein
the reference point is a center of a bounding box that contains all of the grouped graphical objects.

5. The method of claim 1 , further comprising:
when a dimension of the ED is shrunk with respect to a font size of a text stream in the ED and at least one of the grouped graphical objects is clipped by a right-hand margin or a left-hand margin, squeezing all of the grouped graphical objects closer to each other.

6. The method of claim 5 , further comprising:
when two of the grouped graphical objects horizontally overlap, displacing a right-hand graphical object of the two grouped graphical objects downward with respect to a left-hand graphical object of the two grouped graphical objects for a language having a left-to-right text direction, and displacing the left-hand graphical object downward with respect to the left-hand graphical object for a language having a right-to-left text direction.

7. The method of claim 5 , further comprising:
when two of the grouped graphical objects vertically overlap, displacing an upper graphical object of the two grouped graphical objects leftward with respect to a lower graphical object of the two grouped graphical objects for a language having a left-to-right text direction, and displacing the upper graphical object rightward with respect to the lower graphical object for a language having a right-to-left text direction.

8. The method of claim 1 , further comprising:
returning the graphical objects to the plurality of initial positions after displaying the grouped graphical objects in the second arrangement.

9. A system for displaying objects in an electronic document (ED) on a screen following a variation in display of the ED, the system comprising:
a memory that stores the ED, wherein the graphical objects comprise a first graphical object and a second graphical object;
a grouping unit that calculates a plurality of initial positions of the graphical objects on a display area of the screen, and groups the graphical objects whose calculated initial positions are located within a predetermined area of the display area;
a calculator that calculates a reference point of the group in an area of the ED between the first graphical object and the second graphical object based on a center-of-mass of each initial position of the grouped graphical objects;
a controller that:
determines a first arrangement for the grouped graphical objects in response to the variation in display of the ED, wherein the grouped graphical objects are located at a first plurality of new positions in the first arrangement,
wherein the first graphical object and the second graphical object are separated by a first distance in the first arrangement;
instructs the calculator to calculate a first sum of a first plurality of potential energies stored in a first plurality of virtual springs stretched between the plurality of initial positions and the first plurality of new positions for the grouped graphical objects;
determines a second arrangement for the grouped graphical objects in response to the variation in display of the ED, where the grouped graphical objects are located at a second plurality of new positions in the second arrangement,
wherein the first graphical object and the second graphical object are separated by a second distance in the second arrangement that is difference than the first distance;
instructs the calculator to calculate a second sum of a second plurality of potential energies stored in a second plurality of virtual springs stretched between the plurality of initial positions and the second plurality of new positions for the grouped graphical objects;
compares the first sum of the first plurality of potential energies with the second sum of the second plurality of potential energies; and

a display that displays, in response to the second sum being less than the first sum, the ED with the grouped graphical objects in the second plurality of new positions on the screen,
wherein the graphical objects are not displayed in the first arrangement comprising the first plurality of new positions prior to comparing the first sum with the second sum,
wherein the variation in display of the ED is a change in a length and width of the display,
wherein the first sum and the second sum are further calculated based on the reference point.

10. The system of claim 9 , wherein
the grouping unit groups the graphical objects that are within a predetermined distance from each other.

11. The system of claim 10 , wherein
the grouping unit groups the graphical objects that have no breaks therebetween.

12. The system of claim 9 , wherein
the reference point is a

Assignees

• Konica Minolta Laboratory Usa Inc

Inventors

• Briggs William John
• Guarnieri Stuart

Classifications

• G06F40/103 Primary

  Formatting, i.e. changing of presentation of documents (automatic justification G06F40/189; automatic line break hyphenation G06F40/191) · CPC title

• G06F40/106 Primary

  Display of layout of documents; Previewing · CPC title

• G06F17/211

  Physics · mapped topic

• G06F17/212 Primary

  Physics · mapped topic