Skip to content

adding ingestion delay metric#7443

Open
Shvejan wants to merge 2 commits intocortexproject:masterfrom
Shvejan:ingestion-delay-metric
Open

adding ingestion delay metric#7443
Shvejan wants to merge 2 commits intocortexproject:masterfrom
Shvejan:ingestion-delay-metric

Conversation

@Shvejan
Copy link
Copy Markdown
Contributor

@Shvejan Shvejan commented Apr 21, 2026

What this PR does:

Adds a new per-tenant native histogram metric cortex_ingester_ingestion_delay_seconds to track the
delay between when samples arrive at the ingester and their original timestamp. This metric helps
operators:

  • Set appropriate rule_query_offset values based on actual ingestion delays
  • Troubleshoot discrepancies between recording rules and underlying metrics
  • Monitor and alert on ingestion lag per tenant

Which issue(s) this PR fixes:
Fixes #6748

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE],
    [ENHANCEMENT], [BUGFIX]
  • docs/configuration/v1-guarantees.md updated if this PR introduces experimental flags

Signed-off-by: Shvejan Mutheboyina <shvejan@amazon.com>
@dosubot dosubot Bot added component/ingester type/observability To help know what is going on inside Cortex labels Apr 21, 2026
Signed-off-by: Shvejan Mutheboyina <shvejan@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

component/ingester size/L type/observability To help know what is going on inside Cortex

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add a metric to track delay in ingestion

1 participant