Project home

Once you've created the Active Learning project, you're redirected to the project homepage. Here, you can see a new dashboard with the following items:

  • Project Size - the number of documents in the project. This count reflects the documents successfully indexed. Documents that were removed during the index build are excluded during this count.
  • Coded [Positive Choice] - the number of documents coded with the positive designation on the review field. This count includes documents coded from the queue and manually-selected documents. These documents are used to teach the model.
    • Positive Choice manually-selected - the number of documents that were coded on the positive choice designation field outside of the queue.
  • Coded [Negative Choice] - the number of documents coded with the negative designation on the review field. These documents are used in teaching the model. This count includes documents coded from the queue and manually-selected documents.
    • Negative Choice manually-selected - the number of documents that were coded on the negative choice designation field outside of the queue.
  • Skipped - the number of documents served to a reviewer that weren't coded by an end reviewer.

Once the Active Learning model completes its first build, the model builds at maximum every 20 minutes after the previous build to include coding decisions not included in the most recent build. If reviewer activity has been idle for five minutes and there are coding decisions not included in the most recent build, the model will start a build.

Note: Click the hamburger menu icon in top-right corner of the Document Rank Distribution or Prioritized Review Progress charts to export either chart as a PNG file.

Document Rank Distribution

This chart lays out all of the project's documents, ranking them from 0 to 100. Documents plotted toward 0 are less likely to be considered as relevant to the reviewer, as predicted by the model. On the other hand, documents closer to 100 are more likely to be coded as relevant. For more information, see Project Monitoring.

Prioritized Review Progress

The Prioritized Review Progress chart measures the relevancy rate every 200 documents, as confirmed by reviewers' coding decisions in the Prioritized Review queue. More specifically, of the documents in that set of 200, how many were coded as relevant by the reviewer(s). Documents included in the Active Learning model for index health are not included in the relevance rate calculation. For more information, see Project Monitoring.

Note: This chart only updates when documents are coded in the Prioritized Review queue.

Review Statistics

In the Review Statistics tab, you'll find data summarizing Prioritized Review, Coverage Review, Manually-Selected Documents and Elusion Tests.

For more information, see Review Statistics.

Update Ranks

In the top-right corner of the Project Home, you'll see three icons. The first icon is the Update Ranks button . Here, you can manually update the document ranks and ensure the rank categorization field is up to date. Click edit to update the responsive cutoff value. Note that updating ranks doesn't change the coding decision on the document.

Note: When you update the responsive cutoff value, the value is updated in all three places where it’s used in the application: Elusion test, Update ranks, and Project Settings.

In order to update ranks, you must specify the responsive cutoff. This value determines the minimum rank needed for a document to receive a responsive categorization. You can look at the Document Rank Distribution chart for insight as to where to set this cutoff score. Every document on or above the rank cutoff (to the right when looking at the Document Rank Distribution chart) receives the responsive categorization, while everything below the rank cutoff (to the left) receives the non-responsive categorization. Note that this responsive/non-responsive categorization is distinct from the coding decision on the document.

Note: When you update the responsive cutoff value, the value is updated in all three places where it’s used in the application: Elusion test, Update ranks, and Project Settings.

Clicking Update Ranks for the first time creates the following fields:

  • Categories - <Project Name> Cat. Set - the positive or negative choice based on the Responsive Cutoff value. Documents below the cutoff are automatically given the negative choice category.
  • CSR- <Project Name> Cat. Set::Category Rank - the rank score, on a scale from 0 to 100, from the last time update ranks was run.
  • CSR- <Project Name> Cat. Set::Category Name - the positive or negative choice based on the Responsive Cutoff value. Documents below the cutoff are automatically given the negative choice category.

    Note: The values in the rank categorization fields are distinct from the coding decision on the document. For example, a document may be coded not responsive, but if the rank is above the responsive cutoff value, it is categorized as responsive.

The next time you update ranks, these fields are populated with the most up-to-date rank and category information.

While updating ranks, the Update Ranks icon displays a small clock icon in the corner. If you click the icon to open the fly-out modal, you can view the update progress. You can update ranks again only after the current modification is complete.

Notifications

The next icon, Notifications , informs you of any notifications you may have in the project. More specifically, you'll see any project errors here. A red circle will appear in the bottom corner of the Notifications icon if a notification exists. Follow the instructions in the error message to resolve the project error. Once you've resolved the error, the error message will automatically disappear.

Project Settings

The third icon, found in the top-right corner of the Project Home, is Project Settings . This gives an overview of the settings that were selected during the initial project setup (with the exception of Responsive Cutoff). It includes the following Project Details:

  • Project Name
  • Analytics Index
  • Review Field
  • Positive Choice
  • Suppress Exact Duplicates
  • Responsive Cutoff

Click the icon to edit the responsive cutoff value.

Note: When you update the responsive cutoff value, the value is updated in all three places where it’s used in the application: Elusion test, Update ranks, and Project Settings.

The Project Settings also include Review Setup and the Reviewer Group selected.