Sample-Based Learning reports

Sample-Based Learning's reporting structure provides a detailed picture of how the project is progressing. In addition to gauging your progress, you can gain transparency into why Relativity categorized documents the way it did.

Note: This page uses Responsive and Not Responsive as designation choice terms because those are the most common. The designation choice terms you use in your project may be different.

This page contains the following sections:

Refer to the following related topics:

Report types

Designation reports

Designation-related reports include the following options:

  • Round Summary report - The Round Summary report is split into two graphs. The first graph provides a categorization breakdown of each category per round, allowing you to track categorization results as the Sample-Based Learning project progresses. The second graph displays the volatility of each category per round, while accompanying tables provide additional information such as document tallies and population size changes. See Round Summary report.
  • Rank Distribution report - The Designation Rank Distribution report offers insight into categorization results according to their rank score. The accompanying table also provides document tallies. See Rank Distribution report.
  • Overturn Summary report - The Overturn Summary report provides a high level view of a Sample-Based Learning project’s overturn percentages and tallies from round to round. The accompanying table gives even greater detail, including a breakdown of responsive and non-responsive overturn rates. See Overturn Summary report.
  • Project Summary report - The Project Summary report provides a consolidated set of quality metrics from the entire project so that you can see the state of the project based on the last round completed. This report includes the following information - manually coded documents, project categorization results, project overturn results, and control set statistics. See Project Summary report.

Control set reports

Control set-related reports include the following options:

  • Control set statistics report - The Control Set Statistics report displays a project’s accuracy trends from round to round. The report displays precision, recall, and F1 scores for each round in a single line chart. See Control Set Statistics report.

Issue reports

Issue-related reports include the following options:

  • Issue summary report - The issue summary provides a breakdown of issue coding categorization results. The table version of the report also displays document tallies and previous round information. See Issue Summary report.
  • Designation-Issue comparison report - The Designation-issue Comparison Report provides valuable insights into designation and issue coding categorization results, and how they relate to one another. See Designation-Issue Comparison report.

Assisted Review project document reporting views

  • Viewing control set documents - See the Viewing control set documents section in Assisted Review project document reporting views.
  • Viewing overturned documents - The Overturned Documents view allows a Sample-Based Learning admin to view documents that require re-evaluation quickly and efficiently. You can focus on a single round and filter by the highest ranking overturns. You may also use the pivot feature to see the most influential seed documents (documents that are responsible for a large number of overturns). Once you identify documents as needing further analysis, you can click on a link in order to review the document immediately. See Viewing overturned documents.
  • Viewing saved categorization results - The Saved Cat. Results view provides details on each set of saved categorization results based on what you selected when you finished a round. See Viewing saved categorization results.

Viewing reports

You can access each report by clicking on its link on the Assisted Review project console.

The following toolbar appears at the top of each report:

RAR report print and save options

This toolbar provides the following options, from left to right:

  • Print opens a print dialog to select printing options.
  • Export and save/file type saves the report in the selected file type format (pdf, xls, xlsx, csv, or image).
  • Each report contains the Close button at the top of the window. Click this to close the report.

Note: The choice you selected in the Positive choice for designation field on the project appears first in the graphs and tables of all reports containing designation choices. For example, if you selected Responsive as the positive choice, it appears before all other designation choices.