Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Raise prefer_ilm configuration as a known issue #4505

Merged
merged 5 commits into from
Nov 8, 2024
Merged
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions docs/en/observability/apm/known-issues.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,28 @@ _Versions: XX.XX.XX, YY.YY.YY, ZZ.ZZ.ZZ_
// If applicable, link to fix
////

[discrete]
== `prefer_ilm` required in component templates to create custom lifecycle policies

_Elastic Stack versions: 8.15.0+_
lahsivjar marked this conversation as resolved.
Show resolved Hide resolved
lahsivjar marked this conversation as resolved.
Show resolved Hide resolved

// The conditions in which this issue occurs
The issue occurs when creating a _new_ cluster using any 8.15.x version.
The issue occurs for any APM data streams created from 8.15.x.
The issue does _not_ occur if custom component template has been created before 8.15.0.
lahsivjar marked this conversation as resolved.
Show resolved Hide resolved

// Describe why it happens
In 8.15.0, APM Server switched to use https://github.com/elastic/elasticsearch/tree/main/x-pack/plugin/apm-data[apm-data plugin]
to manage data streams, ingest pipelines, lifecycle policies, etc. In 8.15.1, to fix older clusters using
default ILM policies and producing unmanaged indices, a fix was added to fallback to default ILM policy if
it exists. As part of the fix `prefer_ilm` configuration was set to `false`. This setting would have an
effect if both ILM and DSL were in play - a condition that would occur when trying to configure custom
ILM policies using `@custom` component templates for the conditions mentioned above.
lahsivjar marked this conversation as resolved.
Show resolved Hide resolved

// How to fix it
To override ILM policies for these new clusters using component template, set the `prefer_ilm` configuration
to `true` by following the {observability-guide}/apm-ilm-how-to.html[updated guide to customize ILM].

[discrete]
== Upgrading to v8.15.x may cause ingestion to fail

Expand Down