Convert Ahead (P2) - Queue Backlog Threshold Exceeded

Description

This alert is triggered when the message backlog in the Convert Ahead (P2) ConversionAgent and ConversionCompleteAgent queues exceeds 1,000 messages for more than 10 minutes, indicating potential processing delays.

Resolution Guidance

A backlog in the Convert Ahead Conversion queue leads to slower or failed document rendering in the viewer, delaying review workflows.
Risk of further backlog accumulation if not addressed.

How To Resolve

In RabbitMQ, locate the affected queues:
- conversions_RP*_ConversionAgent_Priority2*
- conversionresponses_ConversionCompleteAgent_Priority2* Confirm the message count is greater than 1,000 (the threshold) and observe whether the count is decreasing or increasing/static.
Queues to check: ConversionAgent / ConversionCompleteAgent.
Check the message count in each queue.
Observe the trend:
- Decreasing: Agents are actively processing messages.
- Increasing or static: Agents may be stalled or underperforming.
Check the status of the ConversionAgent / ConversionCompleteAgent in Relativity:
- Log into Relativity
- Go to the Agents tab
- Filter by name containing 'conversion'
Ensure RabbitMQ is running and healthy.
After remediation, monitor the backlog until it falls below the threshold.

You can also try..

If the queue continues to remain backlogged. You can try following:

Restart the kCura services on the Conversion Agent servers.
Review system resources (CPU, memory, disk) on Conversion Agent and RabbitMQ hosts.

Alert Details

This alert monitors the message count of the Mass Convert (Priority 2) Conversion Agent and Conversion Complete Agent queues. It triggers if the backlog exceeds 1,000 messages for more than 10 minutes.

Alert Condition Details

Name	Value	Description
Rule Type	Metric threshold
Data View	metrics-*
Filter Query	((labels.rabbitmq_queue_name: conversions_RP_ConversionAgent_Priority2 AND NOT labels.rabbitmq_queue_name: conversions_RP-_ConversionAgent_Priority2) OR labels.rabbitmq_queue_name: conversionresponses_ConversionCompleteAgent_Priority2* )	Target both P2 conversion queues
Aggregation	max	Highest queue depth within the time window
Group by	labels.rabbitmq_queue_name	Evaluate per queue
Threshold	>= 1000	Alert when queue depth exceeds 1,000
Time Window	10 minutes	Evaluate the last 10 minutes
Frequency	2 minutes	Check every 2 minutes

Alert Metric Details

Metric Name: rabbitmq.message.current

Metric Description: The alert is true when a queue’s message count remains above 1,000 for the last 10 minutes.

Metric Attributes:

Attribute Name	Description
labels.rabbitmq_queue_name	The name of the RabbitMQ queue
rabbitmq.message.current	Current number of messages in the queue