Note: This page uses Responsive and Not Responsive as designation choice terms because those are the most common. The designation choice terms you use in your project may be different.
This page contains the following sections:
Refer to the following related topics:
Imagine you're the senior attorney on a case using
After this first training round, you conduct four QC rounds to test Relativity’s accuracy in grouping the documents. During the QC rounds, another reviewer codes a random sample of documents without knowing if Relativity has categorized them as responsive or non-responsive. As the QC rounds proceed, you run the overturn summary report and notice an unusual number of documents being overturned by reviewers.
These overturns consisted largely of company newsletters that were showing up as responsive due only to their inclusion of relevant property and project names. This tells you that you can easily use keyword searching to remove the newsletters from the document universe. You can then rebuild the Analytics index to exclude these newsletters, thus saving you more time and eliminating useless information from your project.
Designation-related reports include the following options:
- Round Summary report - The Round Summary report is split into two graphs. The first graph provides
a categorization breakdown of each category per round, allowing you to track
categorization results as the
Sample-Based Learningproject progresses. The second graph displays the volatility of each category per round, while accompanying tables provide additional information such as document tallies and population size changes. See Round Summary report.
- Rank Distribution report - The Designation Rank Distribution report offers insight into categorization results according to their rank score. The accompanying table also provides document tallies. See Rank Distribution report.
- Overturn Summary report - The Overturn Summary report provides a high level view of a
Sample-Based Learningproject’s overturn percentages and tallies from round to round. The accompanying table gives even greater detail, including a breakdown of responsive and non-responsive overturn rates. See Overturn Summary report.
- Project Summary report - The Project Summary report provides a consolidated set of quality metrics from the entire project so that you can see the state of the project based on the last round completed. This report includes the following information - manually coded documents, project categorization results, project overturn results, and control set statistics. See Project Summary report.
Control set reports
Control set-related reports include the following options:
- Control set statistics report - The Control Set Statistics report displays a project’s accuracy trends from round to round. The report displays precision, recall, and F1 scores for each round in a single line chart. See Control Set Statistics report.
Issue-related reports include the following options:
- Issue summary report - The issue summary provides a breakdown of issue coding categorization results. The table version of the report also displays document tallies and previous round information. See Issue Summary report.
- Designation-Issue comparison report - The Designation-issue Comparison Report provides valuable insights into designation and issue coding categorization results, and how they relate to one another. See Designation-Issue Comparison report.
RAR project document reporting views
- Viewing control set documents - See the Viewing control set documents section in RAR project document reporting views.
- Viewing overturned documents - The Overturned Documents view allows a
Sample-Based Learningadmin to view documents that require re-evaluation quickly and efficiently. You can focus on a single round and filter by the highest ranking overturns. You may also use the pivot feature to see the most influential seed documents (documents that are responsible for a large number of overturns). Once you identify documents as needing further analysis, you can click on a link in order to review the document immediately. See Viewing overturned documents.
- Viewing saved categorization results - The Saved Cat. Results view provides details on each set of saved categorization results based on what you selected when you finished a round. See Viewing saved categorization results.
You can access each report by clicking on its link on the Assisted Review project console.
The following toolbar appears at the top of each report:
This toolbar provides the following options, from left to right:
- Print opens a print dialog to select printing options.
- Export and save/file type saves the report in the selected file type format (pdf, xls, xlsx, csv, or image).
- Each report contains the Close button at the top of the window. Click this to close the report.
Note: The choice you selected in the Positive choice for designation field on the project appears first in the graphs and tables of all reports containing designation choices. For example, if you selected Responsive as the positive choice, it appears before all other designation choices.