Importing data through Integration Points

Note: As of September 1, 2024, we’ve streamlined our Staging boundaries to more effectively separate staging data from workspace and system data. With this change, you will no longer be able to write to or access data outside of the four defined staging area folders. The four folders that comprise the Staging area are ARM, ProcessingSource, StructuredData, and TenantVM. Folders that were removed include FTA, Temp, Export, and dtSearch, in addition to any other folders that you manually created. Refer to the Staging Area topic and Staging Area FAQ in Community for more details.

Integration Points provides you with the ability to import a CSV file, LDAP, or load file directly into your workspace, and schedule future or recurrent import jobs.

Note: Although importing and exporting a load file is possible in Integration Points, Import/Export is the main application recommended for a stable and efficient load file import and export.

All Integration Points jobs are fully editable after run.

Note: Changing root folder permissions during import is not a supported workflow.

Creating an import Integration Point

The general workflow for creating Integration Points to import data are listed below. For specific details and parameters surrounding each type of integration point you need to create, refer to the other sections in this topic:

  1. Navigate to Integration Points in your workspace.
  2. On the Integration Points tab, click New Integration Point.
  3. Set up the new integration point parameters.
  4. Connect to the data source by setting up the connection parameters.
  5. Map the import fields.
  6. Click Save.

Once you save the integration point, you can run the import job. For more information, see Manually running the import job.

Importing a CSV file

Importing LDAP

Importing a document load file

Importing an image load file

Importing a production load file

Importing from Microsoft Entra ID

Note: Microsoft has renamed Azure Active Directory (Azure AD) to Microsoft Entra ID. This site has been updated to reflect the name change, where applicable. Refer to Microsoft documentation for more information.

Manually running the import job

Once you have created an Integration Point, you can manually run an integration point by selecting the Integration Point, and clicking Run from the console. This lets you run an integration point instantly, as opposed to scheduling an integration point to run.

Arrow pointing to Run button under Transfer Options console

Click OK on the run confirmation message.

The Run button turns to red and gives you the option of stopping the job you just kicked off, as long as that job has a status of Pending or Processing.

If necessary, monitor the progress of the promote job by viewing the Status field in the Status view at the bottom of the layout. You will see any of the following status values:

  • Pending—the job has yet to be picked up by an agent.
  • Validation—an agent is validating the job to make sure it has the required settings, such as access to the source and destination objects (saved searches, workspaces, etc.). If validation fails, the status changes to "Validation failed," and Relativity logs an error. If the validation succeeds, the job moves on to a status of "Processing."
  • Validation failed—the job validation has failed, resulting in an error, the details of which are saved in the Job History Errors tab.
  • Processing—the agent has picked up the job and is in the process of completing it.
  • Completed—the job is complete, and no errors occurred.
  • Completed with errors—the job is complete and errors have occurred.
  • Error - job failed—a job-level error occurred and the job did not complete because it failed.
  • Stopping—you clicked the Stop button, and the stop job has yet to be picked up by an agent.
  • Stopped—the job has been stopped.

Downloading the error file

If your integration point encounters any errors during its run, the Download Error File link on the Transfer Options console is activated. This gives you the option of downloading an Excel (csv) file containing all the errors found in the integration point.

Note: This option is available for load file imports only and is not visible for other providers.

  1. To download this file, click the Download Error File link in the Transfer Options console.

Arrow pointing to Download Error File under Transfer Options console

  1. Open the downloaded Excel file to review the errors.
  1. If desired, manually fix the errors. Once fixed, save the modified file and create a new integration point to import the fixed files, since they were not imported during the original transfer. Be sure that the Import Source field of the new integration point refers to the file you just added.

Disabling a scheduled Integration Point job

To disable a scheduled integration point , simply turn off the scheduler.

  1. From the Integration Points landing page, click the Integration Point Name that you wish to disable.
  2. Click Edit.
  3. In the Scheduling section, select No for Enable Scheduler. The integration point is no longer scheduled to run.

Scheduling options of Yes or No.

Scheduler date format considerations

The integration points scheduler accepts U.S. and non-U.S. date formats based off the default language setting in your browser settings.

For example, if the language setting is English (Australian), the date format would be Day/Month/Year instead of Month/Day/Year.

Browser Language settings dialog

Relativity properly displays the date for the Start and End Date fields when setting up Scheduling.

Example of properly formatted Start and End dates

This date format appears in Relativity wherever a date is displayed, such as on the saved Integration Point Details layout and the Date Last Modified field on the Document list.

Automatically stopping a scheduled job that repeatedly fails

In some cases, a scheduled job may fail each time it is executed, and it may take some time before you become aware of the failed attempts. To mitigate this situation, you can configure an instance setting to specify the maximum number of consecutive failed attempts encountered before the job is automatically stopped. For example, you may want to stop the scheduled job after four consecutive failed attempts at running.

  1. Navigate to the Instance Settings page.
  2. Create a new instance setting with the following settings.
    • Name—enter MaxFailedScheduledJobsCount.
    • Section—enter kcura.IntegrationPoints.
    • Value Type—select Integer 32-bit.
    • Value—enter the number of consecutive failed attempts to be executed before the scheduled job is stopped.
Sample of new integration point listed in table.

The integration point's Scheduling tab displays the failed jobs with a Job Type of "Scheduled Run," Job Status of "Error - job failed," Items Transferred of "0," and Total Items based on the number of items in that job. The system will attempt one more run after the configured maximum number of consecutive failed attempts before it stops the scheduled job. The Total Items column will be blank.

Schedule tab displaying jobs failed list

The "Next Scheduled Runtime (UTC)" field on the Scheduling tab will be blank to let you know that the job is not scheduled to run again. You must correct the error(s) before it will run again as scheduled.

A blank Next Scheduled Runtime field outlined on Scheduling tab

The Job History page displays the system-generated error description explaining why the scheduled job was stopped.

Sample screen of error message