Sampling

With sampling you can generate a randomized subset of items from a larger population. You can use that randomized sample to QC the list items or to identify characteristics of the whole population. To execute sampling, Relativity uses a randomization algorithm which guarantees an efficient and unbiased result.

You can enable any object to use Relativity's sampling. By default, sampling is enabled on the Document object.

Once you've enabled sampling for an object, the sampling icon is available at the top right hand side of the view bar in the workspace.

Note: The sampling feature requires the Use Sampling Admin Operations permission. See Workspace security.

This page contains the following sections:

See these related pages:

Enabling sampling on an object

To enable an object for sampling:

  1. Navigate to the Object Type tab.
  2. In the Object Type Information section, enter a name and select the object for which you want to enable sampling.
  3. Ensure that Sampling Enabled is enabled. If you are creating a new object, this is enabled by default.
  4. Ensure that Lists Enabled is enabled. If this field is disabled, you can't save the list of sampled items without creating a separate field, and then using mass edit to tag all of the sampled items. This field is disabled by default for new object types.
  5. Note: You can't save a list of sampled items as a saved search because the sample results are generated randomly.

  6. Click Save. The sampling icon is now available on the object as long as you are assigned the Use Sampling Admin operation permission.

Generating a sample

The sampling drop-down menu provides three options for setting the sampling type (size):

  • Fixed size - creates a randomized sample set of a specific number of items from the entire item list. See Creating a fixed size sample set.
  • Percentage - creates a randomized sample set of a specific percentage of items from the entire item list. See Creating a percentage sample set.
  • Statistical - creates a randomized sample set of a size based on statistical sample calculations, which determines how many items reviewers need to address in order to get results that reflect the entire data set as precisely as needed. See Creating a statistical sample set.

Note: If you select a sampling type you previously applied in the same workspace, Relativity automatically populates the related settings field(s) with your last value(s).

Clicking Sample on the sampling drop-down menu applies your sampling settings to the item list and creates the randomized sample set.

The sample summary bar displays the sampling type you applied and a count of the sample set out of the total number of items.

Sample summary bar

Once you've applied the desired sampling settings, you can save the sampling results as a list using the Save as List mass operation. Then open the list as a saved search. For more information on lists, including creating and viewing lists, see Lists.

Note the following:

  • Click Clear Sample on the sample summary bar menu to clear the sample. The sample set you create persists on the list of items until a user clears it. This includes while updating search conditions, switching and navigating within browser panels, including adding in relational items, and navigating to other tabs.
  • Sampling is disabled (grayed out) when related items are included via the Related Items drop-down list or a search. Selecting an option (e.g., Family) from the Related Items drop-down list for a list of sampled items clears the sample automatically.

Note: Save Search is also disabled for sampling results because the sample results are generated randomly. Clearing a sampled list of items re-enables Save Search.

Creating a fixed size sample set

To create a sample set of a fixed size:

  1. Click the Documents tab.
  2. Display the documents you want create a randomized sample of by selecting a folder, view, saved search, or performing a document search.
  3. Click the Sampling icon to display the sampling drop-down menu.
  4. Select Fixed size and provide a value greater than 0 in the Size field.
  5. Click Sample.

Creating a percentage sample set

To create sample set of a specified percentage of total documents:

  1. Click the Documents tab.
  2. Display the documents you want to create a randomized sample of by selecting a folder, view, saved search, or performing a document search.
  3. Click the Sampling icon to display the sampling drop-down menu.
  4. Select Percentage and provide a percentage value greater than 0% in the Percentage field.
  1. Click Sample.

Creating a statistical sample set

Note: We recommend that you only use the statistical sampling type on data sets that are large enough to return a reliable statistical sample. If a data set contains fewer than 300 items, you may want to consider using a different sampling type.

To create a sample set size based on statistical confidence and margin of error specifications:

  1. Click the Documents tab.
  2. Display the documents you want to create a randomized sample of by selecting a folder, view, saved search, or performing a document search.
  3. Click the Sampling icon to display the sampling drop-down menu.
  4. Select Statistical.
  5. Select 99%, 95%, or 90% for the Confidence Level field.
  6. Select a value for the Margin of Error field. This is the room for error you want to allow in your sample results when you select a sampling type of statistical. Selecting a lower margin of error requires a larger sample size.
  7. Click Sample.