Skip to content

Create final status tag on test events #10528

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
daniel-mohedano merged 5 commits into from
Feb 10, 2026
Merged

Create final status tag on test events #10528

daniel-mohedano merged 5 commits into from
Feb 10, 2026

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Feb 5, 2026 •
edited by atlassian bot
Loading

What Does This Do

  • Adds a @test.final_status tag to indicate the final status for the test actually reported to the testing framework, as opposed to Datadog. It's possible values are:
    • pass if the test passed, passed after retries, or its failure was suppressed to avoid failing the test process.
    • skip if the test was skipped.
    • fail if the test failed the build.
  • The tag is reported only on the final retry of a test, or in its only execution if it is not retried by any of DD's advanced features.

Motivation

This information will provide better context to users on whether a certain test failed or not their build, without having to infer it from other tags + understanding the behavior of our advanced features. This tag will allow them to easily track actual test failures in their pipelines.

Additional Notes

Note

Given the big amount of changes due to test fixtures updates, the commits haven been organized to ease the review process.

  • Test fixtures have been updated to consider this new tag as well.

Contributor Checklist

Jira ticket: SDTEST-2983

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Feb 5, 2026
@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 57.18
agentEvpProxy 57.15

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 36.88
agentless 38.23
agentlessCodeCoverage 44.21
agentlessLineCoverage 75.37

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 11.26
agentless 11.37
agentlessCodeCoverage 18.38

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 19.98
agentless 16.15
agentlessCodeCoverage 18.06
agentlessLineCoverage 28.04

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - netflix-zuul

Job Status: success

Scenario Overhead (%)
agent 92.73
agentless 83.45
agentlessCodeCoverage 99.22
agentlessLineCoverage 116.15

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 13.80
agentless 12.09
agentlessCodeCoverage 15.18
agentlessLineCoverage 19.30

@pr-commenter
Copy link

pr-commenter bot commented Feb 5, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770571409 1770647186
git_commit_sha d10055d 7e7637f
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~7e7637f2c3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770649079 1770649079
ci_job_id 1409815639 1409815639
ci_pipeline_id 95239457 95239457
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-97wkjoxb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-97wkjoxb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063950
Total [baseline] (10.941 s) : 0, 10940794
Agent [candidate] (1.065 s) : 0, 1065451
Total [candidate] (10.863 s) : 0, 10862857
section appsec
Agent [baseline] (1.237 s) : 0, 1236868
Total [baseline] (10.969 s) : 0, 10969101
Agent [candidate] (1.24 s) : 0, 1240177
Total [candidate] (10.985 s) : 0, 10984635
section iast
Agent [baseline] (1.248 s) : 0, 1247933
Total [baseline] (11.227 s) : 0, 11226914
Agent [candidate] (1.233 s) : 0, 1233045
Total [candidate] (11.237 s) : 0, 11236663
section profiling
Agent [baseline] (1.192 s) : 0, 1191706
Total [baseline] (11.032 s) : 0, 11032298
Agent [candidate] (1.189 s) : 0, 1188788
Total [candidate] (11.013 s) : 0, 11012705
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.237 s 172.918 ms (16.3%)
Agent iast 1.248 s 183.983 ms (17.3%)
Agent profiling 1.192 s 127.756 ms (12.0%)
Total tracing 10.941 s -
Total appsec 10.969 s 28.307 ms (0.3%)
Total iast 11.227 s 286.12 ms (2.6%)
Total profiling 11.032 s 91.504 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.24 s 174.726 ms (16.4%)
Agent iast 1.233 s 167.594 ms (15.7%)
Agent profiling 1.189 s 123.337 ms (11.6%)
Total tracing 10.863 s -
Total appsec 10.985 s 121.778 ms (1.1%)
Total iast 11.237 s 373.806 ms (3.4%)
Total profiling 11.013 s 149.848 ms (1.4%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (627.786 ms) : 0, 627786
BytebuddyAgent [candidate] (629.253 ms) : 0, 629253
AgentMeter [baseline] (28.869 ms) : 0, 28869
AgentMeter [candidate] (28.917 ms) : 0, 28917
GlobalTracer [baseline] (257.404 ms) : 0, 257404
GlobalTracer [candidate] (257.689 ms) : 0, 257689
AppSec [baseline] (32.675 ms) : 0, 32675
AppSec [candidate] (32.693 ms) : 0, 32693
Debugger [baseline] (63.331 ms) : 0, 63331
Debugger [candidate] (61.347 ms) : 0, 61347
Remote Config [baseline] (605.928 µs) : 0, 606
Remote Config [candidate] (620.819 µs) : 0, 621
Telemetry [baseline] (10.59 ms) : 0, 10590
Telemetry [candidate] (13.799 ms) : 0, 13799
Flare Poller [baseline] (6.161 ms) : 0, 6161
Flare Poller [candidate] (4.549 ms) : 0, 4549
section appsec
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (657.171 ms) : 0, 657171
BytebuddyAgent [candidate] (658.647 ms) : 0, 658647
AgentMeter [baseline] (11.953 ms) : 0, 11953
AgentMeter [candidate] (11.953 ms) : 0, 11953
GlobalTracer [baseline] (258.06 ms) : 0, 258060
GlobalTracer [candidate] (258.9 ms) : 0, 258900
IAST [baseline] (25.057 ms) : 0, 25057
IAST [candidate] (25.351 ms) : 0, 25351
AppSec [baseline] (167.381 ms) : 0, 167381
AppSec [candidate] (168.125 ms) : 0, 168125
Debugger [baseline] (67.351 ms) : 0, 67351
Debugger [candidate] (67.361 ms) : 0, 67361
Remote Config [baseline] (669.846 µs) : 0, 670
Remote Config [candidate] (661.307 µs) : 0, 661
Telemetry [baseline] (9.231 ms) : 0, 9231
Telemetry [candidate] (9.171 ms) : 0, 9171
Flare Poller [baseline] (3.663 ms) : 0, 3663
Flare Poller [candidate] (3.62 ms) : 0, 3620
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.172 ms) : 0, 1172
BytebuddyAgent [baseline] (806.995 ms) : 0, 806995
BytebuddyAgent [candidate] (795.961 ms) : 0, 795961
AgentMeter [baseline] (11.712 ms) : 0, 11712
AgentMeter [candidate] (11.31 ms) : 0, 11310
GlobalTracer [baseline] (250.198 ms) : 0, 250198
GlobalTracer [candidate] (248.845 ms) : 0, 248845
IAST [baseline] (27.309 ms) : 0, 27309
IAST [candidate] (27.181 ms) : 0, 27181
AppSec [baseline] (32.435 ms) : 0, 32435
AppSec [candidate] (34.035 ms) : 0, 34035
Debugger [baseline] (69.796 ms) : 0, 69796
Debugger [candidate] (65.748 ms) : 0, 65748
Remote Config [baseline] (545.509 µs) : 0, 546
Remote Config [candidate] (535.757 µs) : 0, 536
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.722 ms) : 0, 8722
Flare Poller [baseline] (3.513 ms) : 0, 3513
Flare Poller [candidate] (3.472 ms) : 0, 3472
section profiling
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (683.234 ms) : 0, 683234
BytebuddyAgent [candidate] (680.821 ms) : 0, 680821
AgentMeter [baseline] (8.577 ms) : 0, 8577
AgentMeter [candidate] (8.543 ms) : 0, 8543
GlobalTracer [baseline] (216.149 ms) : 0, 216149
GlobalTracer [candidate] (215.81 ms) : 0, 215810
AppSec [baseline] (32.43 ms) : 0, 32430
AppSec [candidate] (32.395 ms) : 0, 32395
Debugger [baseline] (67.903 ms) : 0, 67903
Debugger [candidate] (67.644 ms) : 0, 67644
Remote Config [baseline] (600.315 µs) : 0, 600
Remote Config [candidate] (587.64 µs) : 0, 588
Telemetry [baseline] (8.961 ms) : 0, 8961
Telemetry [candidate] (8.801 ms) : 0, 8801
Flare Poller [baseline] (3.753 ms) : 0, 3753
Flare Poller [candidate] (3.741 ms) : 0, 3741
ProfilingAgent [baseline] (99.018 ms) : 0, 99018
ProfilingAgent [candidate] (99.481 ms) : 0, 99481
Profiling [baseline] (99.588 ms) : 0, 99588
Profiling [candidate] (100.057 ms) : 0, 100057
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063554
Total [baseline] (8.738 s) : 0, 8738117
Agent [candidate] (1.077 s) : 0, 1077316
Total [candidate] (8.742 s) : 0, 8741747
section iast
Agent [baseline] (1.23 s) : 0, 1229942
Total [baseline] (9.392 s) : 0, 9392401
Agent [candidate] (1.232 s) : 0, 1232311
Total [candidate] (9.367 s) : 0, 9367313
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.23 s 166.388 ms (15.6%)
Total tracing 8.738 s -
Total iast 9.392 s 654.284 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent iast 1.232 s 154.995 ms (14.4%)
Total tracing 8.742 s -
Total iast 9.367 s 625.566 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.169 ms) : 0, 1169
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (628.364 ms) : 0, 628364
BytebuddyAgent [candidate] (635.929 ms) : 0, 635929
AgentMeter [baseline] (28.943 ms) : 0, 28943
AgentMeter [candidate] (29.315 ms) : 0, 29315
GlobalTracer [baseline] (257.501 ms) : 0, 257501
GlobalTracer [candidate] (260.286 ms) : 0, 260286
AppSec [baseline] (32.744 ms) : 0, 32744
AppSec [candidate] (33.196 ms) : 0, 33196
Debugger [baseline] (62.013 ms) : 0, 62013
Debugger [candidate] (61.748 ms) : 0, 61748
Remote Config [baseline] (640.297 µs) : 0, 640
Remote Config [candidate] (647.021 µs) : 0, 647
Telemetry [baseline] (12.193 ms) : 0, 12193
Telemetry [candidate] (11.606 ms) : 0, 11606
Flare Poller [baseline] (4.657 ms) : 0, 4657
Flare Poller [candidate] (7.773 ms) : 0, 7773
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (794.94 ms) : 0, 794940
BytebuddyAgent [candidate] (796.727 ms) : 0, 796727
AgentMeter [baseline] (11.254 ms) : 0, 11254
AgentMeter [candidate] (11.277 ms) : 0, 11277
GlobalTracer [baseline] (247.847 ms) : 0, 247847
GlobalTracer [candidate] (248.883 ms) : 0, 248883
IAST [baseline] (26.729 ms) : 0, 26729
IAST [candidate] (26.87 ms) : 0, 26870
AppSec [baseline] (34.813 ms) : 0, 34813
AppSec [candidate] (32.964 ms) : 0, 32964
Debugger [baseline] (65.208 ms) : 0, 65208
Debugger [candidate] (66.422 ms) : 0, 66422
Remote Config [baseline] (539.354 µs) : 0, 539
Remote Config [candidate] (542.094 µs) : 0, 542
Telemetry [baseline] (8.723 ms) : 0, 8723
Telemetry [candidate] (8.618 ms) : 0, 8618
Flare Poller [baseline] (3.494 ms) : 0, 3494
Flare Poller [candidate] (3.526 ms) : 0, 3526
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770571409 1770647186
git_commit_sha d10055d 7e7637f
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~7e7637f2c3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770649756 1770649756
ci_job_id 1409815643 1409815643
ci_pipeline_id 95239457 95239457
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-86437ahz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-86437ahz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:iast:high_load better
[-1.704ms; -0.781ms] or [-9.218%; -4.223%]		 unsure
[-1.826ms; -0.520ms] or [-6.161%; -1.754%]		 unstable
[-12.345op/s; +41.657op/s] or [-4.951%; +16.707%]		 17.244ms 28.467ms 264.000op/s 18.486ms 29.640ms 249.344op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.751ms; +2.005ms] or [+4.331%; +11.558%]		 unsure
[+0.519ms; +2.210ms] or [+1.810%; +7.704%]		 unstable
[-45.241op/s; +9.429op/s] or [-17.127%; +3.569%]		 18.728ms 30.053ms 246.250op/s 17.349ms 28.689ms 264.156op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.168 ms) : 1157, 1180
.   : milestone, 1168,
iast (3.247 ms) : 3204, 3291
.   : milestone, 3247,
iast_FULL (5.89 ms) : 5830, 5950
.   : milestone, 5890,
iast_GLOBAL (3.505 ms) : 3448, 3562
.   : milestone, 3505,
profiling (2.089 ms) : 2070, 2107
.   : milestone, 2089,
tracing (1.837 ms) : 1822, 1852
.   : milestone, 1837,
section candidate
no_agent (1.173 ms) : 1162, 1185
.   : milestone, 1173,
iast (3.326 ms) : 3280, 3372
.   : milestone, 3326,
iast_FULL (5.984 ms) : 5922, 6046
.   : milestone, 5984,
iast_GLOBAL (3.536 ms) : 3483, 3588
.   : milestone, 3536,
profiling (2.213 ms) : 2192, 2234
.   : milestone, 2213,
tracing (1.839 ms) : 1824, 1855
.   : milestone, 1839,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.168 ms [1.157 ms, 1.18 ms] -
iast 3.247 ms [3.204 ms, 3.291 ms] 2.079 ms (177.9%)
iast_FULL 5.89 ms [5.83 ms, 5.95 ms] 4.722 ms (404.1%)
iast_GLOBAL 3.505 ms [3.448 ms, 3.562 ms] 2.337 ms (200.0%)
profiling 2.089 ms [2.07 ms, 2.107 ms] 920.443 µs (78.8%)
tracing 1.837 ms [1.822 ms, 1.852 ms] 668.33 µs (57.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.173 ms [1.162 ms, 1.185 ms] -
iast 3.326 ms [3.28 ms, 3.372 ms] 2.153 ms (183.5%)
iast_FULL 5.984 ms [5.922 ms, 6.046 ms] 4.811 ms (410.1%)
iast_GLOBAL 3.536 ms [3.483 ms, 3.588 ms] 2.363 ms (201.4%)
profiling 2.213 ms [2.192 ms, 2.234 ms] 1.04 ms (88.6%)
tracing 1.839 ms [1.824 ms, 1.855 ms] 666.344 µs (56.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.101 ms) : 17914, 18288
.   : milestone, 18101,
appsec (18.689 ms) : 18498, 18879
.   : milestone, 18689,
code_origins (17.66 ms) : 17482, 17838
.   : milestone, 17660,
iast (18.717 ms) : 18530, 18904
.   : milestone, 18717,
profiling (18.435 ms) : 18251, 18619
.   : milestone, 18435,
tracing (17.625 ms) : 17451, 17798
.   : milestone, 17625,
section candidate
no_agent (18.103 ms) : 17923, 18283
.   : milestone, 18103,
appsec (18.974 ms) : 18784, 19165
.   : milestone, 18974,
code_origins (18.956 ms) : 18763, 19149
.   : milestone, 18956,
iast (17.672 ms) : 17497, 17847
.   : milestone, 17672,
profiling (18.349 ms) : 18165, 18532
.   : milestone, 18349,
tracing (17.901 ms) : 17723, 18078
.   : milestone, 17901,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.101 ms [17.914 ms, 18.288 ms] -
appsec 18.689 ms [18.498 ms, 18.879 ms] 587.327 µs (3.2%)
code_origins 17.66 ms [17.482 ms, 17.838 ms] -441.441 µs (-2.4%)
iast 18.717 ms [18.53 ms, 18.904 ms] 616.011 µs (3.4%)
profiling 18.435 ms [18.251 ms, 18.619 ms] 333.973 µs (1.8%)
tracing 17.625 ms [17.451 ms, 17.798 ms] -476.52 µs (-2.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.103 ms [17.923 ms, 18.283 ms] -
appsec 18.974 ms [18.784 ms, 19.165 ms] 871.721 µs (4.8%)
code_origins 18.956 ms [18.763 ms, 19.149 ms] 853.221 µs (4.7%)
iast 17.672 ms [17.497 ms, 17.847 ms] -430.267 µs (-2.4%)
profiling 18.349 ms [18.165 ms, 18.532 ms] 245.921 µs (1.4%)
tracing 17.901 ms [17.723 ms, 18.078 ms] -202.032 µs (-1.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/final-status
git_commit_date 1770571409 1770647186
git_commit_sha d10055d 7e7637f
release_version 1.60.0-SNAPSHOT~d10055d2a1 1.60.0-SNAPSHOT~7e7637f2c3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770649184 1770649184
ci_job_id 1409815646 1409815646
ci_pipeline_id 95239457 95239457
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3b4cvk7b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3b4cvk7b 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.436ms; -1.089ms] or [-37.870%; -28.705%]		 2.530ms 3.793ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.325 s) : 15325000, 15325000
.   : milestone, 15325000,
appsec (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
iast (18.241 s) : 18241000, 18241000
.   : milestone, 18241000,
iast_GLOBAL (17.782 s) : 17782000, 17782000
.   : milestone, 17782000,
profiling (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,
tracing (14.708 s) : 14708000, 14708000
.   : milestone, 14708000,
section candidate
no_agent (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
appsec (14.887 s) : 14887000, 14887000
.   : milestone, 14887000,
iast (18.523 s) : 18523000, 18523000
.   : milestone, 18523000,
iast_GLOBAL (17.763 s) : 17763000, 17763000
.   : milestone, 17763000,
profiling (15.551 s) : 15551000, 15551000
.   : milestone, 15551000,
tracing (14.711 s) : 14711000, 14711000
.   : milestone, 14711000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.325 s [15.325 s, 15.325 s] -
appsec 14.965 s [14.965 s, 14.965 s] -360.0 ms (-2.3%)
iast 18.241 s [18.241 s, 18.241 s] 2.916 s (19.0%)
iast_GLOBAL 17.782 s [17.782 s, 17.782 s] 2.457 s (16.0%)
profiling 14.869 s [14.869 s, 14.869 s] -456.0 ms (-3.0%)
tracing 14.708 s [14.708 s, 14.708 s] -617.0 ms (-4.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.028 s [15.028 s, 15.028 s] -
appsec 14.887 s [14.887 s, 14.887 s] -141.0 ms (-0.9%)
iast 18.523 s [18.523 s, 18.523 s] 3.495 s (23.3%)
iast_GLOBAL 17.763 s [17.763 s, 17.763 s] 2.735 s (18.2%)
profiling 15.551 s [15.551 s, 15.551 s] 523.0 ms (3.5%)
tracing 14.711 s [14.711 s, 14.711 s] -317.0 ms (-2.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7e7637f2c3, baseline=1.60.0-SNAPSHOT~d10055d2a1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.793 ms) : 3572, 4015
.   : milestone, 3793,
iast (2.274 ms) : 2203, 2344
.   : milestone, 2274,
iast_GLOBAL (2.307 ms) : 2236, 2378
.   : milestone, 2307,
profiling (2.121 ms) : 2062, 2179
.   : milestone, 2121,
tracing (2.085 ms) : 2030, 2140
.   : milestone, 2085,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.53 ms) : 2475, 2586
.   : milestone, 2530,
iast (2.267 ms) : 2197, 2338
.   : milestone, 2267,
iast_GLOBAL (2.315 ms) : 2244, 2385
.   : milestone, 2315,
profiling (2.104 ms) : 2047, 2161
.   : milestone, 2104,
tracing (2.073 ms) : 2018, 2128
.   : milestone, 2073,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.793 ms [3.572 ms, 4.015 ms] 2.318 ms (157.1%)
iast 2.274 ms [2.203 ms, 2.344 ms] 798.186 µs (54.1%)
iast_GLOBAL 2.307 ms [2.236 ms, 2.378 ms] 831.464 µs (56.3%)
profiling 2.121 ms [2.062 ms, 2.179 ms] 645.102 µs (43.7%)
tracing 2.085 ms [2.03 ms, 2.14 ms] 609.467 µs (41.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.53 ms [2.475 ms, 2.586 ms] 1.054 ms (71.4%)
iast 2.267 ms [2.197 ms, 2.338 ms] 791.002 µs (53.6%)
iast_GLOBAL 2.315 ms [2.244 ms, 2.385 ms] 838.357 µs (56.8%)
profiling 2.104 ms [2.047 ms, 2.161 ms] 628.094 µs (42.5%)
tracing 2.073 ms [2.018 ms, 2.128 ms] 596.717 µs (40.4%)

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 95.03
agentless 91.21
agentlessCodeCoverage 100.07
agentlessLineCoverage 101.62

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 19.02
agentless 16.32
agentlessCodeCoverage 19.07
agentlessLineCoverage 36.55

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 16.27
agentless 9.32
agentlessCodeCoverage 13.46
agentlessLineCoverage 31.78

@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Feb 5, 2026 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 48.62
agentless 16.95
agentlessCodeCoverage 127.63
agentlessLineCoverage 153.50

@daniel-mohedano daniel-mohedano marked this pull request as ready for review February 6, 2026 10:34
@daniel-mohedano daniel-mohedano requested review from a team as code owners February 6, 2026 10:34
@daniel-mohedano daniel-mohedano requested review from mcculls and removed request for a team February 6, 2026 10:34
@daniel-mohedano daniel-mohedano added this pull request to the merge queue Feb 9, 2026
github-merge-queue bot pushed a commit that referenced this pull request Feb 9, 2026
@daniel-mohedano
Create final status tag on test events (#10528)
5c8d895 
* feat: final_status tag implementation

* chore: fixture updates

* chore: spotless

* fix: final status for RunNTimes policy and add explanation comments
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to no response for status checks Feb 9, 2026
@daniel-mohedano daniel-mohedano added this pull request to the merge queue Feb 9, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to no response for status checks Feb 9, 2026
@daniel-mohedano daniel-mohedano merged commit 9e90f7d into master Feb 10, 2026
544 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/final-status branch February 10, 2026 09:13
@github-actions github-actions bot added this to the 1.60.0 milestone Feb 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-sdk-capabilities-java

+1 more reviewer

@anmarchenko anmarchenko anmarchenko approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.60.0

Development

Successfully merging this pull request may close these issues.

3 participants

@daniel-mohedano @anmarchenko @nikita-tkachenko-datadog