Review statistics

In the Review Summary section, you'll see four tabs: Prioritized Review, Coverage Review, Elusion Test, and Manually-Selected.

This page contains the following information:

Prioritized Review

The Prioritized Review tab shows the effectiveness of the Prioritized Review queue’s ability to locate relevant documents by reporting the review field breakdown and relevance rate each 200 documents.

The Prioritized Review chart contains the following columns:

  • Prioritized Review
  • # of Reviewers
  • Coded on the Positive Choice Review Field
  • Coded on the Negative Choice Review Field
  • Skipped
  • Relevance Rate

For every 200 documents that are coded, a new row in the Prioritized Review table will appear.

Coverage Review

The Coverage Review tab shows the progress of the Coverage Review by reporting the review field breakdown every 200 documents.

The Coverage Review chart contains the following columns:

  • Coverage Review
  • # of Reviewers
  • Coded on the Positive Choice Review Field
  • Coded on the Negative Choice Review Field
  • Skipped

Elusion Test

Use the Elusion Test tab to monitor the progress to completing the Active Learning project. A new row is created when an Elusion Test starts and is populated with the available information about the Elusion Test. The last four columns populate as documents are coded and appear upon page refresh. If an Elusion Test is stopped before completion, the last four columns display values for what was coded.

The Elusion Test tab contains the following columns:

  • Review - each review is called Elusion Test plus a numeral. For example, the first Elusion Test is "Elusion Test 1" and it will increase by one each sequential Elusion Test.
  • Start Date - the UTC date and time the Elusion Test was started.
  • Rank Cutoff - user input when turning on the Elusion Test.
  • Discard Pile Size - Number of documents below the rank cutoff that are not coded.
  • Sample Size - number of documents in the Elusion Test. This number is computed when the Elusion Test is started.
  • Skipped - number of documents served up to reviewers but not coded in the Elusion Test.
  • Pending Document Count - number of documents with coding changes, including documents coded in the Elusion Test (not skipped documents in Elusion Test) and manually selected documents not contributing to the model's learning.
  • Confidence Level - user input or calculated when turning on the Elusion Test.
  • Margin of Error - user input when turning on the Elusion Test. Margin of error can change if documents were skipped in Elusion Test.
  • Coded [Positive choice] - the number of documents coded with the positive designation on the review field.
  • Coded [Negative choice] - the number of documents that were coded on the positive choice designation field outside of the project.
  • Elusion Rate Range - the Elusion Rate Range measured in percent. Please note this value is rounded to the nearest percent.
  • Eluded Document Range - the Elusion Rate Range measured in number of documents.

Manually-Selected

The Manually-selected Documents chart displays the number of document coding decisions made outside of the Active Learning queue on a given day.

The Manually-selected Documents tab contains the following columns:

  • Manually-selected documents
  • Coded on the positive choice review field
  • Coded on the negative choice review field
  • Date submitted (UTC)