Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support elastic_data_stream #1190

Merged
merged 1 commit into from
Jun 4, 2024

Conversation

fschlager
Copy link
Contributor

What this PR does / why we need it:

This PR adds support for Elasticsearch's data streams:

A data stream lets you store append-only time series data across multiple indices while giving you a single named resource for requests. Data streams are well-suited for logs, events, metrics, and other continuously generated data.

The underlying fluentd plugin already supports this, with this PR we can make use of it in the usual fluent-operator context.

This is designed to be a separate plugin to keep things simple, to reflect how this is treated by fluentd itself and to not break existing configurations.

Which issue(s) this PR fixes:

Fixes #1170

Does this PR introduced a user-facing change?

Add support for `elasticDataStream` plugin

Additional documentation, usage docs, etc.:


Signed-off-by: Fabian Schlager <fabian.schlager@advastore.com>
@benjaminhuo
Copy link
Member

@fschlager Thanks, that's big enhancement!

@benjaminhuo benjaminhuo merged commit d1a2e27 into fluent:master Jun 4, 2024
9 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Supporting elasticsearch_data_stream
2 participants