Identify Spammers

The Identify Spammers pipeline step finds spam-like email addresses communicating within your data set whose communications do not contain privileged content and the AI should ignore for analysis. These email addresses create noise in our social network graphs that we use to understand relationships between individuals used to make privileged calls.

Requirements

Following are requirements for the Identify Spammers pipeline step:

  • When the system runs the Identify Spammers pipeline step it will identify all potential spammer email addresses and populate them on the Spammers tab. You must annotate spammers based on the conditions outlined in Annotate spammers by confirming or denying the Prediction on the Annotator Decision field.

    Note: The AI considers spammers not annotated on the Annotator Decision field as spammers and will not analyze their communications for privilege.

  • After annotating spammers, you must perform the Apply Annotations action.

  • The Apply Annotations action sends your Annotation Decisions to the AI to directly ignore communications sent and received from and to these spammer email addresses.

Actions

Once the Scrub Disclaimers pipeline step is complete, the system will automatically run Identify Spammers and the status will change to Run In Progress.

When the Identify Spammers step completes, the status on the step changes to Ready to Apply Annotations and the system enables the Apply Annotations action button.

Caution: Before completing this step, you must annotate the spammers identified by the Identify Spammers step to confirm or deny the AI predictions on the Annotator Decision field. You should also quality check (QC) the decisions made by your team for accuracy. See Annotating Spammers for more details.

To apply annotations for Identify Spammers:

  1. Navigate to the Projects (Priv) page.
  2. Select the Privilege Project you want to interact with.
  3. Scroll down to the Pipeline Steps category.
  4. Locate the Identify Spammers step in the Pipeline Steps.
  5. Click the Apply Annotations button within the Actions column next to the Identify Spammers step.
    This will only be available when you have successfully performed the Run action.
  6. A pop-up window displaying annotation details will appear. Review the number of Spammers Annotated and Spammers Missing Annotator Decision.
    Click Confirm to indicate that you have performed annotations.
Note: Spammers missing an Annotator Decision will be treated as Spammer and considered Privilege Neutral and ignored during the Validate Attorneys pipeline step. If this default decision is incorrect, it may result in privileged documents being predicted as Not Privileged due to the lack of a privilege conferring individual presence (lower recall).
Note: Once annotations are applied, you will not be able to change the Annotator Decisions.

The Identify Spammers step status will change to Apply Annotations In Progress. The system will disable the Apply Annotations action button until the status updates.

Upon the successful completion of the Identify Spammers Apply Annotations action, the status on the step will change to Completed and you can move on to the next pipeline step.

Errors

If the status of a pipeline step becomes Run Failed or Apply Annotations Failed then there was an error in the action. Check the Error Details field within the Pipeline Steps category or refer to the error message that appears on screen for detailed error information including steps to resolve the issue.

For more information, see aiR for Privilege errors.