Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

apm: rm deprecated peer_service_aggregation config #23284

Merged
merged 2 commits into from
Apr 2, 2024

Conversation

ahmed-mez
Copy link
Contributor

@ahmed-mez ahmed-mez commented Feb 29, 2024

What does this PR do?

AIT-9878

Complete the deprecation of peer_service_aggregation that started in this commit https://github.com/DataDog/datadog-agent/pull/20550/files#diff-a77843a3a2d99bdc21000210a1c6a0fc99871774b33d15b6779389e8299aa794

Motivation

Clean up deprecated beta parameters in the trace-agent

Additional Notes

The corresponding docs PR is DataDog/documentation#21991

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes

The new parameter peer_tags_aggregation is unit tested.

@ahmed-mez ahmed-mez added team/agent-apm trace-agent qa/done Skip QA week as QA was done before merge and regressions are covered by tests labels Feb 29, 2024
@ahmed-mez ahmed-mez added this to the 7.53.0 milestone Feb 29, 2024
ahmed-mez added a commit to DataDog/documentation that referenced this pull request Feb 29, 2024
@ahmed-mez ahmed-mez force-pushed the ahmed/rm-peer_tags_aggregation branch from 2681f04 to 268db96 Compare February 29, 2024 10:48
@ahmed-mez ahmed-mez marked this pull request as ready for review February 29, 2024 10:59
@ahmed-mez ahmed-mez requested review from a team as code owners February 29, 2024 10:59
@pr-commenter
Copy link

pr-commenter bot commented Feb 29, 2024

Bloop Bleep... Dogbot Here

Regression Detector Results

Run ID: 1a1c819d-6b58-4e0f-9c95-d43ad34410b3
Baseline: d40837d
Comparison: 268db96

Performance changes are noted in the perf column of each table:

  • ✅ = significantly better comparison variant performance
  • ❌ = significantly worse comparison variant performance
  • ➖ = no significant change in performance

Experiments with missing or malformed data

  • basic_py_check

Usually, this warning means that there is no usable optimization goal data for that experiment, which could be a result of misconfiguration.

No significant changes in experiment optimization goals

Confidence level: 90.00%
Effect size tolerance: |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

Experiments ignored for regressions

Regressions in experiments with settings containing erratic: true are ignored.

perf experiment goal Δ mean % Δ mean % CI
file_to_blackhole % cpu utilization -0.42 [-6.94, +6.10]

Fine details of change detection per experiment

perf experiment goal Δ mean % Δ mean % CI
process_agent_standard_check memory utilization +0.34 [+0.30, +0.37]
process_agent_real_time_mode memory utilization +0.20 [+0.16, +0.23]
trace_agent_msgpack ingress throughput +0.02 [+0.00, +0.03]
trace_agent_json ingress throughput +0.01 [-0.01, +0.03]
tcp_dd_logs_filter_exclude ingress throughput +0.00 [-0.00, +0.00]
uds_dogstatsd_to_api ingress throughput +0.00 [-0.00, +0.00]
process_agent_standard_check_with_stats memory utilization -0.04 [-0.07, -0.01]
idle memory utilization -0.40 [-0.44, -0.37]
file_to_blackhole % cpu utilization -0.42 [-6.94, +6.10]
file_tree memory utilization -0.72 [-0.79, -0.66]
uds_dogstatsd_to_api_cpu % cpu utilization -0.77 [-2.19, +0.66]
tcp_syslog_to_blackhole ingress throughput -0.84 [-0.89, -0.79]
otel_to_otel_logs ingress throughput -1.13 [-1.75, -0.50]

Explanation

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

  1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

  2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that if our statistical model is accurate, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

  3. Its configuration does not mark it "erratic".

drichards-87 pushed a commit to DataDog/documentation that referenced this pull request Feb 29, 2024
@ahmed-mez ahmed-mez changed the title apm: rm peer_service_aggregation apm: rm deprecated peer_service_aggregation config Feb 29, 2024
@ahmed-mez ahmed-mez modified the milestones: 7.53.0, 7.54.0 Feb 29, 2024
@ahmed-mez
Copy link
Contributor Author

To be merged for v7.54.0

@pr-commenter
Copy link

pr-commenter bot commented Apr 2, 2024

Test changes on VM

Use this command from test-infra-definitions to manually test this PR changes on a VM:

inv create-vm --pipeline-id=31244521 --os-family=ubuntu

@ahmed-mez
Copy link
Contributor Author

/merge

@dd-devflow
Copy link

dd-devflow bot commented Apr 2, 2024

🚂 MergeQueue

Pull request added to the queue.

This build is going to start soon! (estimated merge in less than 28m)

Use /merge -c to cancel this operation!

@pr-commenter
Copy link

pr-commenter bot commented Apr 2, 2024

Regression Detector

Regression Detector Results

Run ID: 85c45200-b9d1-46cf-8891-670faa31f2a0
Baseline: 6294adc
Comparison: 45b3693

Performance changes are noted in the perf column of each table:

  • ✅ = significantly better comparison variant performance
  • ❌ = significantly worse comparison variant performance
  • ➖ = no significant change in performance

No significant changes in experiment optimization goals

Confidence level: 90.00%
Effect size tolerance: |Δ mean %| ≥ 5.00%

There were no significant changes in experiment optimization goals at this confidence level and effect size tolerance.

Experiments ignored for regressions

Regressions in experiments with settings containing erratic: true are ignored.

perf experiment goal Δ mean % Δ mean % CI
file_to_blackhole % cpu utilization +0.83 [-5.45, +7.11]

Fine details of change detection per experiment

perf experiment goal Δ mean % Δ mean % CI
basic_py_check % cpu utilization +1.70 [-0.91, +4.32]
file_tree memory utilization +1.29 [+1.18, +1.40]
file_to_blackhole % cpu utilization +0.83 [-5.45, +7.11]
uds_dogstatsd_to_api_cpu % cpu utilization +0.67 [-2.28, +3.62]
idle memory utilization +0.37 [+0.33, +0.42]
process_agent_standard_check memory utilization +0.32 [+0.27, +0.38]
process_agent_standard_check_with_stats memory utilization +0.30 [+0.26, +0.34]
process_agent_real_time_mode memory utilization +0.20 [+0.16, +0.24]
tcp_dd_logs_filter_exclude ingress throughput +0.01 [-0.01, +0.03]
trace_agent_json ingress throughput +0.01 [-0.01, +0.03]
trace_agent_msgpack ingress throughput +0.00 [-0.00, +0.00]
uds_dogstatsd_to_api ingress throughput -0.00 [-0.20, +0.20]
otel_to_otel_logs ingress throughput -0.10 [-0.50, +0.31]
tcp_syslog_to_blackhole ingress throughput -0.14 [-0.22, -0.05]
pycheck_1000_100byte_tags % cpu utilization -0.43 [-5.35, +4.49]

Explanation

A regression test is an A/B test of target performance in a repeatable rig, where "performance" is measured as "comparison variant minus baseline variant" for an optimization goal (e.g., ingress throughput). Due to intrinsic variability in measuring that goal, we can only estimate its mean value for each experiment; we report uncertainty in that value as a 90.00% confidence interval denoted "Δ mean % CI".

For each experiment, we decide whether a change in performance is a "regression" -- a change worth investigating further -- if all of the following criteria are true:

  1. Its estimated |Δ mean %| ≥ 5.00%, indicating the change is big enough to merit a closer look.

  2. Its 90.00% confidence interval "Δ mean % CI" does not contain zero, indicating that if our statistical model is accurate, there is at least a 90.00% chance there is a difference in performance between baseline and comparison variants.

  3. Its configuration does not mark it "erratic".

@dd-mergequeue dd-mergequeue bot merged commit cc47a37 into main Apr 2, 2024
191 checks passed
@dd-mergequeue dd-mergequeue bot deleted the ahmed/rm-peer_tags_aggregation branch April 2, 2024 11:27
@github-actions github-actions bot removed this from the 7.54.0 milestone Apr 2, 2024
@github-actions github-actions bot added this to the 7.53.0 milestone Apr 2, 2024
@kacper-murzyn kacper-murzyn modified the milestones: 7.53.0, 7.54.0 Apr 3, 2024
codeboten pushed a commit to open-telemetry/opentelemetry-collector-contrib that referenced this pull request May 2, 2024
Updates pkg/trace to the following commit version:
DataDog/datadog-agent@32187be.

Includes the following notable changes:
- DataDog/datadog-agent#25099
- DataDog/datadog-agent#23284
  - This config option is not being removed in the Collector yet

Verified locally that when only `peer_service_aggregation` is set,
`peer_tags_aggregation` gets updated automatically with the same value
and a warning log is emitted.
mx-psi added a commit to open-telemetry/opentelemetry-collector-contrib that referenced this pull request May 6, 2024
…er (#32327)

**Description:** <Describe what has changed.>
<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
This PR adds support for the logs agent exporter in order to export logs
to Datadog. The following changes were made in order to support this:
- Update datadog-agent modules to the following commit hash version:
DataDog/datadog-agent@a1ef7ed
- Remove `peer_service_aggregation` config option which was deprecated
and removed since last datadog-agent version:
DataDog/datadog-agent#23284
- Add logs agent exporter setup in datadog exporter factory. This is
disabled by default and can be enabled via feature gate.

**Link to tracking Issue:** 

Fixes
#30099

**Testing:** <Describe what testing was performed and which tests were
added.>

**Documentation:** <Describe the documentation added.>

---------

Co-authored-by: Pablo Baeyens <pbaeyens31+github@gmail.com>
hughesjj pushed a commit to hughesjj/opentelemetry-collector-contrib that referenced this pull request May 6, 2024
…er (open-telemetry#32327)

**Description:** <Describe what has changed.>
<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
This PR adds support for the logs agent exporter in order to export logs
to Datadog. The following changes were made in order to support this:
- Update datadog-agent modules to the following commit hash version:
DataDog/datadog-agent@a1ef7ed
- Remove `peer_service_aggregation` config option which was deprecated
and removed since last datadog-agent version:
DataDog/datadog-agent#23284
- Add logs agent exporter setup in datadog exporter factory. This is
disabled by default and can be enabled via feature gate.

**Link to tracking Issue:** 

Fixes
open-telemetry#30099

**Testing:** <Describe what testing was performed and which tests were
added.>

**Documentation:** <Describe the documentation added.>

---------

Co-authored-by: Pablo Baeyens <pbaeyens31+github@gmail.com>
ajgajg1134 added a commit that referenced this pull request May 7, 2024
pkalmakis added a commit that referenced this pull request May 7, 2024
kacper-murzyn pushed a commit that referenced this pull request May 8, 2024
dd-mergequeue bot pushed a commit that referenced this pull request May 8, 2024
agent-platform-auto-pr bot pushed a commit that referenced this pull request May 8, 2024
This reverts commit cc47a37.

(cherry picked from commit 466c27b)
kacper-murzyn pushed a commit that referenced this pull request May 8, 2024
This reverts commit cc47a37.

(cherry picked from commit 466c27b)

Co-authored-by: Peter Kalmakis <peter.kalmakis@datadoghq.com>
rimitchell pushed a commit to rimitchell/opentelemetry-collector-contrib that referenced this pull request May 8, 2024
Updates pkg/trace to the following commit version:
DataDog/datadog-agent@32187be.

Includes the following notable changes:
- DataDog/datadog-agent#25099
- DataDog/datadog-agent#23284
  - This config option is not being removed in the Collector yet

Verified locally that when only `peer_service_aggregation` is set,
`peer_tags_aggregation` gets updated automatically with the same value
and a warning log is emitted.
rimitchell pushed a commit to rimitchell/opentelemetry-collector-contrib that referenced this pull request May 8, 2024
…er (open-telemetry#32327)

**Description:** <Describe what has changed.>
<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
This PR adds support for the logs agent exporter in order to export logs
to Datadog. The following changes were made in order to support this:
- Update datadog-agent modules to the following commit hash version:
DataDog/datadog-agent@a1ef7ed
- Remove `peer_service_aggregation` config option which was deprecated
and removed since last datadog-agent version:
DataDog/datadog-agent#23284
- Add logs agent exporter setup in datadog exporter factory. This is
disabled by default and can be enabled via feature gate.

**Link to tracking Issue:** 

Fixes
open-telemetry#30099

**Testing:** <Describe what testing was performed and which tests were
added.>

**Documentation:** <Describe the documentation added.>

---------

Co-authored-by: Pablo Baeyens <pbaeyens31+github@gmail.com>
alexgallotta pushed a commit that referenced this pull request May 9, 2024
cparkins pushed a commit to AmadeusITGroup/opentelemetry-collector-contrib that referenced this pull request Jul 11, 2024
Updates pkg/trace to the following commit version:
DataDog/datadog-agent@32187be.

Includes the following notable changes:
- DataDog/datadog-agent#25099
- DataDog/datadog-agent#23284
  - This config option is not being removed in the Collector yet

Verified locally that when only `peer_service_aggregation` is set,
`peer_tags_aggregation` gets updated automatically with the same value
and a warning log is emitted.
cparkins pushed a commit to AmadeusITGroup/opentelemetry-collector-contrib that referenced this pull request Jul 11, 2024
…er (open-telemetry#32327)

**Description:** <Describe what has changed.>
<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
This PR adds support for the logs agent exporter in order to export logs
to Datadog. The following changes were made in order to support this:
- Update datadog-agent modules to the following commit hash version:
DataDog/datadog-agent@a1ef7ed
- Remove `peer_service_aggregation` config option which was deprecated
and removed since last datadog-agent version:
DataDog/datadog-agent#23284
- Add logs agent exporter setup in datadog exporter factory. This is
disabled by default and can be enabled via feature gate.

**Link to tracking Issue:** 

Fixes
open-telemetry#30099

**Testing:** <Describe what testing was performed and which tests were
added.>

**Documentation:** <Describe the documentation added.>

---------

Co-authored-by: Pablo Baeyens <pbaeyens31+github@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
qa/done Skip QA week as QA was done before merge and regressions are covered by tests team/agent-apm trace-agent
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants