Using project sets

Project sets make it easier to manage and refine prompt criteria for aiR for Review projects. They let you create new sets within a single aiR project so you can iterate without having to start over with a new aiR project. You can use these sets to change saved searches (data sources) during prompt criteria development, to switch between sets to review results, or to start prompt criteria validation in Review Center.

The project set workflow outlined below aligns with aiR for Review’s phases (see aiR for Review phases).

1. Develop: This set type is used to develop your prompt criteria on a small document set. With develop sets, the data source (saved search) being used in the project can be changed to allow greater flexibility to run multiple jobs within a single aiR project. See Creating a new project set for more information.
2. Validate: This set type is used to validate your prompt criteria leveraging Review Center. See Validating the prompt criteria for more information.
3. Apply: This set type is commonly used after validation to apply your prompt criteria to a larger document population. See Applying the prompt criteria for more information.

Navigating the project set details strip

The project set details strip contains the following:

• Project set type—identifies whether the project set is in the Develop, Validate, or Apply phase.
• Name—identifies the name of the saved search used for the set, number of documents analyzed, and total number of documents in the saved search.
• Refresh button—click the circular arrows to update the selected data source (saved search) so it reflects any changes made to the saved search document list after the project was created. For example, to ensure it reflects newly added or deleted documents or updated saved search criteria. This option is only available for Develop project sets. See Refreshing a data source.
• Version number—identifies the version number of the prompt criteria for the project set and the date it ran or was saved.
• Down arrow button—click the down arrow to switch between project sets to review analysis results and to track project activity.
• + sign—click the plus sign to create a new project set using a different data source, to validate the currently selected prompt criteria version, or to apply it to a larger document population.

Creating a new project set

Use the steps below to create (develop) a new project set within the current aiR for Review project. This enables you to change the data source (saved search) used to iterate on the prompt criteria and view results.

1. Click the project sets + sign.
2. Click I want to develop my prompt criteria using a different data source.
   
3. Click Select and choose the data source (saved search) to use for this project set.
4. Click Create Develop Set.
5. Proceed with modifying the prompt criteria as needed.

Validating the prompt criteria

Use the steps below to validate the project set's prompt criteria within the current aiR for Review project.

1. Within the desired project set, click the project sets + sign.
2. Click I want to validate the prompt criteria on a target document population.
   
3. Click Select and choose the data source (saved search) to use for this project set.
   We strongly recommended that you avoid modifying the data source (saved search) after you start the validation process as this will interfere with the results.
4. Fill out the Validation Settings fields to determine the validation sample. For more information on each field, see Validation Settings fields.
5. Review the confirmation summary modal and provide email addresses, if needed.
6. Click Start Analysis.
7. When the analysis is finished, click Go to Review Center to begin the human review and coding of the validation sample in Review Center. Refer to Prompt Criteria validation in Review Center for the steps to follow in Review Center.

For more information on validating prompt criteria, see Setting up aiR for Review prompt criteria validation.

Applying the prompt criteria

Use the steps below to apply the project set's prompt criteria within the current aiR for Review project.

1. Within the desired project set, click the project sets + sign.
2. Click I want to apply my prompt criteria to a document population.
   
3. Click Create Apply Set.
4. Review the confirmation summary modal and provide email addresses, if needed.
5. Click Start Analysis. For more information, see Running the analysis.

Conflicts are not displayed in the Project Metrics section of the dashboard after running Apply on a project set. See Version Metrics tab for more information on the Conflicts tab.

After the prompt criteria are applied to the document population, they cannot be changed. The only way to revise the criteria is by creating a new develop project set and updating it. See Creating a new project set for the details.

Refreshing a data source

If the document list in the selected data source saved search changes after you create a project, click the Refresh button (circular arrows) next to the data source in the project set details strip. This updates the project analysis to use the most current document list. For example, documents may have been added or removed, or the saved search criteria may have changed after the project started. This option is available only for Develop project sets.

After a project set begins validation, the Refresh option is no longer available. In this situation, you need to create a new project to use the updated data source.