OpenTelemetry Metrics
OpenTelemetry counters, histograms, and gauges.
Queuert emits OpenTelemetry metrics through the @queuert/otel adapter. All metrics follow the naming pattern:
Text
queuert.{component}.{operation}[.{suboperation}]The ObservabilityAdapter interface accepts milliseconds; the @queuert/otel adapter converts duration values to seconds per OTEL Messaging Semantic Conventions.
Counters
The row under each metric lists its attributes; worker counters have none.
Worker lifecycle
- queuert.worker.started counterWorker registered and started processing.
- queuert.worker.error counterWorker encountered an error.
- queuert.worker.lease_lost counterWorker lost its lease and restarts.
- queuert.worker.stopped counterWorker fully stopped.
Job lifecycle
- queuert.job.created counterJob created.queuert.job.type queuert.chain.type
- queuert.job.completed counterJob completed (by a worker or workerless). Use
queuert.job.attempt.completedto count only worker-processed completions.queuert.job.type queuert.chain.type queuert.job.continued - queuert.job.blocked counterJob blocked by incomplete blocker chains.queuert.job.type queuert.chain.type
- queuert.job.unblocked counterJob unblocked after blocker chain completed.queuert.job.type queuert.chain.type
- queuert.job.rescheduled counterJob returned to pending: client reschedule,
complete({ reschedule }), retry after a failed attempt, or reclaim from a worker that lost its lease, stopped or no longer runs it.queuert.job.type queuert.chain.type
Attempt lifecycle
- queuert.job.attempt.started counterWorker began processing an attempt.queuert.job.type queuert.chain.type
- queuert.job.attempt.completed counterAttempt completed successfully (including
complete({ reschedule })).queuert.job.type queuert.chain.type - queuert.job.attempt.failed counterAttempt failed (may retry).queuert.job.type queuert.chain.type
- queuert.job.attempt.lost counterAttempt lost ownership before committing: taken by another worker, completed elsewhere, or deleted.queuert.job.type queuert.chain.type
- queuert.job.attempt.reclaimed counterAttempt rescheduled for retry from a worker that lost its lease, stopped or no longer runs it.queuert.job.type queuert.chain.type
Chain lifecycle
- queuert.chain.created counterChain created.queuert.chain.type
- queuert.chain.completed counterChain completed.queuert.chain.type
- queuert.chain.deleted counterChain deleted.queuert.chain.type
Adapter errors
- queuert.state_adapter.error counterState adapter operation failed.queuert.adapter.operation
- queuert.notify_adapter.error counterNotify adapter operation failed.queuert.adapter.operation
Histograms
Histograms track duration distributions at three levels. Unit is seconds.
Durations
- Duration from chain creation to completion.queuert.chain.type
- Duration from job creation to completion.queuert.job.type queuert.chain.type
- Duration of a single attempt.queuert.job.type queuert.chain.type
These form a hierarchy — chain duration encompasses job durations (plus wait time between continuations), and job duration encompasses attempt durations (plus wait time between retries):
durations
span06.2 s12.4 s
- queuert.chain.duration
- queuert.job.duration (head job)
- queuert.job.attempt.duration (attempt 1)
- queuert.job.attempt.duration (attempt 2, retry)
- queuert.job.duration (continuation)
- queuert.job.attempt.duration
Gauges
Two up-down counters track real-time worker state. They are incremented/decremented via delta values.
Gauges
- queuert.job_type.idle up-down counterWorkers currently idle for this job type.queuert.job.type
- queuert.job_type.processing up-down counterJobs of this type currently being processed.queuert.job.type
Metric attributes
Metric attributes
- queuert.job.type stringJob type name.
- queuert.chain.type stringChain type name.
- queuert.job.continued boolean
trueif the completion produced a continuation,falseotherwise. - queuert.adapter.operation stringAdapter operation that produced an error.