Classify Domains

The Classify Domains pipeline step locates email address domains used to communicate within your data set and uses AI to categorizes each as Law Firm or Third Party. This drives attorney, privilege conferring individual, discovery that influences privileged predictions. The AI uses the Universal Brain, Matter Brain, Known Law Firms items, language from documents, and broader web data to capture all law firm domains.

Requirements

Following are requirements for the Classify Domains pipeline step:

  • You must perform both the Run action and the Apply Annotations action on the Classify Domains pipeline step. The Run action identifies all email address domains and populate them on the Domains tab.
  • Before performing the Apply Annotations action, you must annotate domains based on the conditions outlined in Annotate domains by selecting a choice on the Annotator Decision field.
    Note: Domains not annotated on the Annotator Decision field will respect their Prediction.
  • The AI considers domains with a Prediction of Undetermined as Third Party. The Apply Annotations action will apply your annotations to the AI to drive attorney discovery and privileged predictions.
  • All Predicted Law Firm Domains relevant to the active project must have an Annotator Decision set to proceed.”

Actions

To run Classify Domains:

  1. Navigate to the Projects (Priv) page.
  2. Select the project you want to interact with.
  3. Locate the Classify Domains pipeline step in the Pipeline Steps category.
  4. Click the Run button within the Actions column next to the Classify Domains pipeline step.
    The Run button next to the Classify Domains pipeline step will only be available when you have successfully completed Identify Spammers.

The Classify Domains step status will change to Run in Progress. The system will disable the Run action button until the status updates.

Upon the successful completion of the Classify Domains Run action, the status on the step will change to Ready to Apply Annotations. The Apply Annotations action button is enabled.

Caution: Before completing this step, you must annotate the Domains identified by the Classify Domains step to confirm or deny the Predictions on the Annotator Decision field. Quality check (QC) the decisions made by your team for accuracy. See Annotating Domains for more details.

To apply annotations for Classify Domains:

  1. Navigate to the Projects (Priv) page.
  2. Select the project you want to interact with.
  3. Locate the Classify Domains step in the Pipeline Steps category.
  4. Click the Apply Annotations button within the Actions column next to the Classify Domains step.
    The Apply Annotations button will only be available when you have successfully performed the Run action.
  5. A pop-up window displaying annotation details will appear. Review the number of Domains Annotated and Domains Missing Annotator Decision.
    Click Confirm to indicate that you have performed annotations.
Note: An Annotator Decision is required for all Domains with a Prediction of Law Firm. Other Domains missing an Annotator Decision will use their Prediction field value as their decision. Domains with a Prediction field value of Undetermined will be treated as 3rd Party. If the Prediction field value is incorrect, it may result in Entities discovered during Validate Attorneys, that communicate under these domains, not receiving a Legal Role prediction. This will lead to privileged documents being predicted as Not Privileged due to the lack of a privilege conferring individual presence (lower Recall). The Final Privilege Status of a Domain can be adjusted in the Confirm Privilege Status step.

The Classify Domains step status will change to Complete In Progress. The system will disable the Apply Annotations button until the status updates.

Upon the successful completion of the Classify Domains Apply Annotation action, the status on the step will change to Completed. Move on to the Match Equivalent Domains pipeline step.

Errors

If the status of the Classify Domains pipeline step becomes Run Failed or Apply Annotations Failed then there was an error in the action. Check the Error Details field within the Pipeline Steps category for more detailed error information including steps to resolve the issue.

Following is a list of the most common Classify Domains failures:

Error Cause Solution
Run Failed There is a system failure that is causing the operation to timeout. Retry the action, and if the issue persists contact Relativity support.
Apply Annotations Failed There is a system failure that is causing the operation to timeout. Retry the action, and if the issue persists contact Relativity support.
Apply Annotations Failed

There are missing annotations.

All Domains associated to this Privilege Project where Prediction = Law Firm must be annotated.

 Annotate all Domains associated to this Privilege Project where Prediction = Law Firm and then retry the Apply Annotations action.

Once you resolve any errors you can rerun the Classify Domains pipeline step.