Review Center - Admin quick reference guide

This guide provides step-by-step instructions for creating and administering a Review Center queue, with a checklist at the end. This guide is intended as a quick reference, and it does not explain the features in depth.

For more detailed instructions, see the Review Center section of the documentation site.

Choose a queue type

1. Saved Search—the queue serves up documents from a saved search, according to one of the following delivery methods:
   • Batches—the document set is divided into groups, then checked out to reviewers group by group.
   • Linear—documents are automatically checked out to reviewers a few at a time, according to the sort order of the saved search.
2. Prioritized Review—the queue uses artificial intelligence to predict which documents are most likely to be coded positive, and it serves those up first. To train the predictions, you need to code at least one positive and one negative document in the data set before starting the queue. Coding more documents leads to more accurate predictions.

All queues can be set to serve entire relational groups to the same reviewer.

Create the required fields and choices

• Review Field—a single-choice field that serves as the coding field for your queue. This field should have at least one positive choice (such as Responsive) and one negative choice (such as Not Responsive.) Any other choices will be considered neutral.
• Rank Output (prioritized review queue only)— a decimal field that will hold the document ranks. Each prioritized review queue needs a separate Rank Output field on the Document object.

Set up the reviewer permissions group

1. Decide which user group should contain the reviewers for the queue. You can either create a brand new group, or modify the permissions for an existing user group. You can assign multiple groups to the same queue.
2. Add the group to the workspace.
3. Assign the reviewer group these permissions:
   • Object Security: Document - View and Document - Edit
   • Object Security: Review Center Queue - View
   • Tab Visibility: Review Queues tab

Set up the layout

Create a coding layout that includes the queue’s review field. Reviewers will use this layout to code documents in the queue. You can also add any other fields you want such as rank output, issue coding, privilege coding, a field to indicate further review needed or technical issues, and more.

Create the saved search

Create a saved search that contains the documents you want in the Review Center queue.

For prioritized review queues, the AI classifier only uses the extracted text field to make its predictions. Returning other fields in the saved search does not affect the results.

Create the queue template

Review Center uses templates to speed up the process of setting up multiple queues. You can either use one of the pre-made templates included with Review Center, or create your own.

If you already have a template customized for your workspace, you can skip this step.

1. Navigate to the Review Center tab.
2. Click the Add Queue button.
3. Fill out the template settings. For a full list, see Queue and template settings list.
   • Set the Is Template field to On. This adds the new template to your template list and makes many fields optional.
   • If a field value needs to be changed for each queue, such as Reviewer Groups, leave that field blank.
4. Click Create Queue.
5. Navigate to the Review Library tab.
   The template now appears in the Review Library list.

Create the queue

1. Navigate to the Review Center tab.
2. Click the Add Queue button.
3. Select a queue type, then click Continue.
4. Edit the queue settings. For a full list, see Queue and template settings list.
   1. Under Select Template, choose the template you want to use.
   2. Under Reviewer Groups, choose one or more reviewer groups.
   3. In the other fields, review the default values filled in by the template. Change any values that should be different for this queue.
5. Click Create Queue.
   The new queue appears as a tab in the banner at the top of the dashboard.

All queue settings can also be edited after creating the queue.

After a queue has been created from a template, the two of them are no longer connected. You can edit the template without affecting the queue.

Activate and manage the queue

From the Review Center dashboard, you can start, track, manage, and edit all Review Center queues.

To start your queue, follow these steps:

1. (Prioritized review queue only) Make sure at least one document in the data set is already coded positive, and at least one is coded negative. For even more efficient AI predictions, try having at least 10 positive-coded and 10 negative-coded documents.
2. Navigate to the Review Center tab.
3. If you have more than one queue, their names will be listed as tabs across the top. Click on the queue you want to start.
4. (Optional) Click Prepare Only. This re-runs the saved search for all queues and retrains the AI classifier for prioritized review queues. It does not start the queue.
5. Click Start Review. If you chose not to prepare the queue in advance, this will say Prepare and Start. After the queue has started, your reviewers can start reviewing.

After the queue has finished starting, a pause button will appear next to the words Active Queue. Clicking the button pauses the queue and stops reviewers from checking out more documents.

Update the queue and the classifier

If Queue Refresh is set to On, a queue with active reviewers will automatically re-run the saved search and update the classifier (for prioritized review queues) when there is coding activity in any queue. You can change this setting at any time.

If you need to trigger an immediate refresh, click on the words Auto Refresh to trigger an additional manual refresh. For example, if new documents have been added to the saved search, you can click this to add them to the queue quickly instead of waiting until the next auto-refresh. If Queue Refresh is turned off, this option will say Refresh Queue.

Review documents

1. Navigate to the Review Queues tab.
2. Each queue you are assigned to has a separate row. Locate the row with the same name as the queue you want.
3. For batched queues:
   1. Click the arrow beside a queue name to expand the list of batches underneath it.
   2. If there are unassigned batches, you can check them out to claim them. Click Check Out on the batch row.
      
4. Click Start. This button brings you into the document viewer where you can review documents.

As you review, you can click on Documents on the left-hand navigation. This opens the Documents panel.

• For linear queues, this shows you documents you already reviewed in the queue.
• For batched queues, this shows you the other documents in the batch.

Review Center queue checklist

Can be done in your workspace template:

Must be done in the workspace: