Skip to content

Add configurable memory limiter #21

Description

@pratik50

PAI collectors currently use the batch processor but do not have a memory limiter.

During traffic spikes, or when Parseable is slow/down, data can build up inside the collector. This may increase memory usage until the collector gets OOM-killed.

Add support for the OpenTelemetry memory_limiter processor for logs, metrics, traces, and events pipelines.

The processor order will be:

receiver → memory_limiter → batch → exporter

Keep it disabled by default so existing users.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions