Skip to content

Ingester: Ingester TSDB OOO sample delta metric always show 0 #6850

Open
@yeya24

Description

@yeya24

Describe the bug
There is a histogram metric in Cortex Ingester called cortex_ingester_tsdb_sample_ooo_delta. It is used to track how old a sample (timestamp delta) is when it hits out of order or out of bound errors.

I have a Cortex cluster where we keep having out of order and out of bounds sample issues. However, this metric seems remain 0 and doesn't seem to work.

Expected behavior
I am able to use cortex_ingester_tsdb_sample_ooo_delta metric to get the ingestion delay (seconds delta) on the ingester.

Alternative Solution
#6748 can be an alternative solution.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions