Systems and methods for automatic identification of potential material facts in documents

Patent metadata

Field	Value
Publication number	US-2016140210-A1
Application number	US-201514944692-A
Country	US
Kind code	A1
Filing date	Nov 18, 2015
Priority date	Nov 19, 2014
Publication date	May 19, 2016
Grant date	—

Abstract

Systems and methods to identify potential material fact sentences in electronic legal documents obtained from electronic repositories are disclosed. A system includes a processing device and a storage medium in communication with the processing device. The storage medium includes programming instructions that cause the processing device to obtain a document and parse text within the document to determine whether each paragraph in the document is a fact paragraph, a discussion paragraph, or an outcome paragraph based on at least one of a heading associated with the paragraph and features of the paragraph. The storage medium further includes programming instructions that cause the processing device to extract each sentence in the fact paragraph, direct a trained sentence classifier to determine whether each sentence is a potential material fact sentence or a non-material fact sentence based on features of the sentence, and identify potential material fact sentences.

First claim

1 . A system to identify potential material fact sentences in electronic legal documents obtained from electronic repositories, the system comprising:
a processing device; and a non-transitory, processor-readable storage medium in communication with the processing device, the non-transitory, processor-readable storage medium comprising one or more programming instructions that, when executed, cause the processing device to:
obtain an electronic legal document from a repository,
parse text within the electronic legal document to determine whether each one of one or more paragraphs in the legal document is a fact paragraph, a discussion paragraph, or an outcome paragraph based on at least one of a heading associated with the paragraph and one or more features of the paragraph, and
for each one of the one or more paragraphs that is a fact paragraph:
extract each one of one or more sentences in the fact paragraph,
direct a trained sentence classifier to determine whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence based on one or more features of the sentence, and
identify one or more potential material fact sentences from the one or more sentences based on the determination.

2 . The system of claim 1 , wherein the one or more features of the sentence is selected from a group consisting of a number of noun phrases, a number of verb phrases, a number of dates, a number of time stamps, a number of monetary values, a number of lower court actions, a number of present court actions, a number of plaintiff actions, a number of legal phrases, a number of legal concepts, a number of non-material fact words, and a number of non-material fact phrases.

3 . The system of claim 1 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by running a natural language parser on each one of the one or more sentences to determine the one or more features of the sentence.

4 . The system of claim 1 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated by a support vector machine algorithm from training data.

5 . The system of claim 1 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated by a decision tree algorithm from training data.

6 . The system of claim 1 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated by a naïve Bayes algorithm from training data.

7 . The system of claim 1 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated from a stacking committee of classifiers algorithm from training data and data outputted from one or more base classifiers.

8 . The system of claim 1 , wherein the heading is a facts heading, a discussion heading, or a outcome heading.

9 . The system of claim 1 , wherein the one or more features of the paragraph is selected from a group consisting of a position of the paragraph, a number of cases, a number of statutes, a number of past tense verbs, a number of present court words, a number of lower court words, a number of legal phrases, a number of defendant words, a number of plaintiff words, a number of dates, a number of signal words, and a number of footnotes.

10 . A method to identify potential material fact sentences in electronic legal documents obtained from electronic repositories, the method comprising:
obtaining, by a processing device, an electronic legal document from a repository; parsing, by the processing device, text within the electronic legal document to determine whether each one of one or more paragraphs in the legal document is a fact paragraph, a discussion paragraph, or an outcome paragraph based on at least one of a heading associated with the paragraph and one or more features of the paragraph; and for each one of the one or more paragraphs that is a fact paragraph:
extracting, by the processing device, each one of one or more sentences in the fact paragraph,
directing, by the processing device, a trained sentence classifier to determine whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence based on one or more features of the sentence, and
identifying, by the processing device, one or more potential material fact sentences from the one or more sentences based on the determination.

11 . The method of claim 10 , wherein the one or more features of the sentence is selected from a group consisting of a number of noun phrases, a number of verb phrases, a number of dates, a number of time stamps, a number of monetary values, a number of lower court actions, a number of present court actions, a number of plaintiff actions, a number of legal phrases, a number of legal concepts, a number of non-material fact words, and a number of non-material fact phrases.

12 . The method of claim 10 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by running a natural language parser on each one of the one or more sentences to determine the one or more features of the sentence.

13 . The method of claim 10 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated by a support vector machine algorithm from training data.

14 . The method of claim 10 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated by a decision tree algorithm from training data.

15 . The method of claim 10 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated by a naïve Bayes algorithm from training data.

16 . The method of claim 10 , wherein the trained sentence classifier determines whether each one of the one or more sentences is a potential material fact sentence or a non-material fact sentence by scoring the one or more features based on a trained model generated from a stacking committee of classifiers algorithm from training data and data outputted from one or more base classifiers.

17 . The method of claim 10 , wherein the heading is a facts heading, a discussion heading, or a outcome heading.

18 . The method of claim 10 , wherein the one or more features of the paragraph is selected from a group consisting of a position of the paragraph, a number of cases, a number of statutes, a number of past tense verbs, a number of

Assignees

• Lexisnexis Division Of Reed Elsevier Inc

Inventors

• Pendyala Mahesh
• Osgood Gene
• Myers Jacob Aaron

Classifications

• G06F40/279

  Recognition of textual entities · CPC title

• G06F40/205 Primary

  Parsing · CPC title

• G06Q50/18

  Legal services · CPC title

• G06F16/93

  Document management systems · CPC title

• G06F16/35 Primary

  Clustering; Classification · CPC title