Identify Spammers

The Identify Spammers pipeline step finds spam-like email addresses communicating within your data set whose communications do not contain privileged content and the AI should ignore for analysis. These email addresses create noise in our social network graphs that we use to understand relationships between individuals used to make privileged calls.

Requirements

Following are requirements for the Identify Spammers pipeline step:

  • You must perform both the Run action and the Apply Annotations action on the Identify Spammers pipeline step. The Run action will identify all potential spammer email addresses and populate them on the Spammers tab.
  • Before performing the Apply Annotations action, you must annotate spammers based on the conditions outlined in Annotate spammers by confirming or denying the Prediction on the Annotator Decision field.
    Note: The AI considers spammers not annotated on the Annotator Decision field as spammers and will not analyze their communications for privilege.
  • The Apply Annotations action sends your Annotation Decisions to the AI to directly ignore communications sent and received from and to these spammer email addresses.

Actions

To run Identify Spammers:

  1. Navigate to the Projects (Priv) page.
  2. Select the project you want to interact with.
  3. Locate the Identify Spammers step in the Pipeline Steps category.
  4. Click the Run button within the Actions column next to the Identify Spammers step.
    This will only be available when you have successfully completed the Scrub Disclaimers pipeline step.

The Identify Spammers step status will change to Run In Progress. The system will disable the Run button until the status updates.

When the Identify Spammers step completes, the status on the step changes to Ready to Apply Annotations. The system enables the Apply Annotations action button.

Caution: Before completing this step, you must annotate the spammers identified by the Identify Spammers step to confirm or deny the AI predictions on the Annotator Decision field. You should also quality check (QC) the decisions made by your team for accuracy. See Annotating Spammers for more details.

To apply annotations for Identify Spammers:

  1. Navigate to the Projects (Priv) page.
  2. Select the Privilege Project you want to interact with.
  3. Scroll down to the Pipeline Steps category.
  4. Locate the Identify Spammers step in the Pipeline Steps.
  5. Click the Apply Annotations button within the Actions column next to the Identify Spammers step.
    This will only be available when you have successfully performed the Run action.
  6. A pop-up window displaying annotation details will appear. Review the number of Spammers Annotated and Spammers Missing Annotator Decision.
    Click Confirm to indicate that you have performed annotations.
Note: Spammers missing an Annotator Decision will be treated as Spammer and considered Privilege Neutral and ignored during the Validate Attorneys pipeline step. If this default decision is incorrect, it may result in privileged documents being predicted as Not Privileged due to the lack of a privilege conferring individual presence (lower recall).
Note: Once annotations are applied, you will not be able to change the Annotator Decisions.

The Identify Spammers step status will change to Apply Annotations In Progress. The system will disable the Apply Annotations action button until the status updates.

Upon the successful completion of the Identify Spammers Apply Annotations action, the status on the step will change to Completed and you can move on to the next pipeline step.

Errors

If the status of the Identify Spammers pipeline step becomes fails, then there was an error in the action. Check the Error Details field within the Pipeline Steps category for more detailed error information including steps to resolve the issue.

Following is a list of the most common Identify Spammers failures:

Error Cause Solution
Run Failed There is a system failure that is causing the operation to timeout. Retry the action, and if the issue persists contact Relativity support.
Apply Annotations Failed There is a system failure that is causing the operation to timeout. Retry the action, and if the issue persists contact Relativity support.

Once you resolve any errors you can rerun the Identify Spammers pipeline step.