Skip to content

Use ControllableTimeSource for deterministic TempLocationManagerTest#10538

Merged
jbachorik merged 5 commits intomasterfrom
jb/tlm_test_1
Feb 8, 2026
Merged

Use ControllableTimeSource for deterministic TempLocationManagerTest#10538
jbachorik merged 5 commits intomasterfrom
jb/tlm_test_1

Conversation

@jbachorik
Copy link
Contributor

@jbachorik jbachorik commented Feb 6, 2026 •
edited
Loading

What Does This Do

Injects TimeSource into TempLocationManager to allow tests to control time deterministically using ControllableTimeSource, eliminating flakiness in timeout-related tests.

Motivation

TempLocationManagerTest.testCleanupWithTimeout was intermittently failing in CI due to dependency on real wall-clock time. JDK 8 timer resolution and system load caused non-deterministic behavior. By using the existing ControllableTimeSource from utils/time-utils, tests can now advance simulated time instantly without real delays.

After trying all other options I finally did the right one ...

Additional Notes

  • No changes to TimeSource interface - uses existing getCurrentTimeMillis() method
  • Production behavior unchanged (defaults to SystemTimeSource.INSTANCE)
  • All 10 consecutive test runs passed locally

Contributor Checklist

Jira ticket: N/A

@jbachorik @claude
Use ControllableTimeSource for deterministic TempLocationManagerTest
3aa2150 
Inject TimeSource into TempLocationManager to allow tests to control
time without depending on real wall-clock delays. This eliminates
flakiness caused by JDK timer resolution differences.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@jbachorik jbachorik added type: bug Bug report and fix comp: testing Testing tag: no release notes Changes to exclude from release notes AI Generated with AI assistance tag: ai generated Largely based on code generated by an AI or LLM and removed AI Generated with AI assistance labels Feb 6, 2026
jbachorik and others added 2 commits February 6, 2026 11:54
@jbachorik @claude
Fix timeout test to be independent of hook invocation count
58ca53f 
Advance time only once and only for failure case, making the test
deterministic regardless of directory structure variations.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@jbachorik @claude
Simplify CleanupVisitor to use millis directly
a4d67fd 
Remove Instant conversions - work with milliseconds throughout
for cleaner, allocation-free time comparisons.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@jbachorik jbachorik marked this pull request as ready for review February 6, 2026 11:29
@jbachorik jbachorik requested a review from a team as a code owner February 6, 2026 11:29
@jbachorik jbachorik requested a review from mcculls February 6, 2026 11:29
@pr-commenter
Copy link

pr-commenter bot commented Feb 6, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_1
git_commit_date 1770386810 1770389754
git_commit_sha e036f8c 197bd8b
release_version 1.60.0-SNAPSHOT~e036f8ca99 1.60.0-SNAPSHOT~197bd8b3f8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770391695 1770391695
ci_job_id 1406440261 1406440261
ci_pipeline_id 95005122 95005122
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-j1u0tg5o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-j1u0tg5o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1075265
Total [baseline] (10.939 s) : 0, 10939277
Agent [candidate] (1.081 s) : 0, 1080777
Total [candidate] (11.103 s) : 0, 11102616
section appsec
Agent [baseline] (1.243 s) : 0, 1242962
Total [baseline] (10.979 s) : 0, 10978812
Agent [candidate] (1.25 s) : 0, 1249757
Total [candidate] (11.183 s) : 0, 11183323
section iast
Agent [baseline] (1.235 s) : 0, 1234647
Total [baseline] (11.223 s) : 0, 11222956
Agent [candidate] (1.238 s) : 0, 1238019
Total [candidate] (11.261 s) : 0, 11261411
section profiling
Agent [baseline] (1.205 s) : 0, 1204748
Total [baseline] (11.099 s) : 0, 11098728
Agent [candidate] (1.191 s) : 0, 1190860
Total [candidate] (10.974 s) : 0, 10974012
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent appsec 1.243 s 167.697 ms (15.6%)
Agent iast 1.235 s 159.382 ms (14.8%)
Agent profiling 1.205 s 129.482 ms (12.0%)
Total tracing 10.939 s -
Total appsec 10.979 s 39.535 ms (0.4%)
Total iast 11.223 s 283.679 ms (2.6%)
Total profiling 11.099 s 159.451 ms (1.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.25 s 168.98 ms (15.6%)
Agent iast 1.238 s 157.241 ms (14.5%)
Agent profiling 1.191 s 110.083 ms (10.2%)
Total tracing 11.103 s -
Total appsec 11.183 s 80.707 ms (0.7%)
Total iast 11.261 s 158.795 ms (1.4%)
Total profiling 10.974 s -128.604 ms (-1.2%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (633.457 ms) : 0, 633457
BytebuddyAgent [candidate] (638.173 ms) : 0, 638173
AgentMeter [baseline] (29.403 ms) : 0, 29403
AgentMeter [candidate] (29.409 ms) : 0, 29409
GlobalTracer [baseline] (260.504 ms) : 0, 260504
GlobalTracer [candidate] (261.557 ms) : 0, 261557
AppSec [baseline] (33.261 ms) : 0, 33261
AppSec [candidate] (33.326 ms) : 0, 33326
Debugger [baseline] (62.131 ms) : 0, 62131
Debugger [candidate] (64.657 ms) : 0, 64657
Remote Config [baseline] (628.178 µs) : 0, 628
Remote Config [candidate] (625.512 µs) : 0, 626
Telemetry [baseline] (12.314 ms) : 0, 12314
Telemetry [candidate] (10.847 ms) : 0, 10847
Flare Poller [baseline] (6.883 ms) : 0, 6883
Flare Poller [candidate] (5.32 ms) : 0, 5320
section appsec
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (661.868 ms) : 0, 661868
BytebuddyAgent [candidate] (664.766 ms) : 0, 664766
AgentMeter [baseline] (11.948 ms) : 0, 11948
AgentMeter [candidate] (12.048 ms) : 0, 12048
GlobalTracer [baseline] (258.872 ms) : 0, 258872
GlobalTracer [candidate] (260.797 ms) : 0, 260797
AppSec [baseline] (167.492 ms) : 0, 167492
AppSec [candidate] (168.53 ms) : 0, 168530
Debugger [baseline] (67.395 ms) : 0, 67395
Debugger [candidate] (67.996 ms) : 0, 67996
Remote Config [baseline] (650.519 µs) : 0, 651
Remote Config [candidate] (663.581 µs) : 0, 664
Telemetry [baseline] (9.16 ms) : 0, 9160
Telemetry [candidate] (9.182 ms) : 0, 9182
Flare Poller [baseline] (3.631 ms) : 0, 3631
Flare Poller [candidate] (3.68 ms) : 0, 3680
IAST [baseline] (25.319 ms) : 0, 25319
IAST [candidate] (25.492 ms) : 0, 25492
section iast
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (797.512 ms) : 0, 797512
BytebuddyAgent [candidate] (800.492 ms) : 0, 800492
AgentMeter [baseline] (11.279 ms) : 0, 11279
AgentMeter [candidate] (11.482 ms) : 0, 11482
GlobalTracer [baseline] (249.185 ms) : 0, 249185
GlobalTracer [candidate] (249.076 ms) : 0, 249076
AppSec [baseline] (34.792 ms) : 0, 34792
AppSec [candidate] (35.616 ms) : 0, 35616
Debugger [baseline] (65.856 ms) : 0, 65856
Debugger [candidate] (64.991 ms) : 0, 64991
Remote Config [baseline] (539.154 µs) : 0, 539
Remote Config [candidate] (542.03 µs) : 0, 542
Telemetry [baseline] (8.635 ms) : 0, 8635
Telemetry [candidate] (8.651 ms) : 0, 8651
Flare Poller [baseline] (3.491 ms) : 0, 3491
Flare Poller [candidate] (3.479 ms) : 0, 3479
IAST [baseline] (26.871 ms) : 0, 26871
IAST [candidate] (27.149 ms) : 0, 27149
section profiling
ProfilingAgent [baseline] (99.372 ms) : 0, 99372
ProfilingAgent [candidate] (99.443 ms) : 0, 99443
crashtracking [baseline] (1.229 ms) : 0, 1229
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (691.463 ms) : 0, 691463
BytebuddyAgent [candidate] (682.495 ms) : 0, 682495
AgentMeter [baseline] (8.86 ms) : 0, 8860
AgentMeter [candidate] (8.536 ms) : 0, 8536
GlobalTracer [baseline] (218.581 ms) : 0, 218581
GlobalTracer [candidate] (215.956 ms) : 0, 215956
AppSec [baseline] (33.138 ms) : 0, 33138
AppSec [candidate] (32.578 ms) : 0, 32578
Debugger [baseline] (68.427 ms) : 0, 68427
Debugger [candidate] (67.682 ms) : 0, 67682
Remote Config [baseline] (595.252 µs) : 0, 595
Remote Config [candidate] (595.639 µs) : 0, 596
Telemetry [baseline] (8.743 ms) : 0, 8743
Telemetry [candidate] (8.778 ms) : 0, 8778
Flare Poller [baseline] (3.749 ms) : 0, 3749
Flare Poller [candidate] (3.781 ms) : 0, 3781
Profiling [baseline] (99.947 ms) : 0, 99947
Profiling [candidate] (100.005 ms) : 0, 100005
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1074896
Total [baseline] (8.793 s) : 0, 8793347
Agent [candidate] (1.063 s) : 0, 1063498
Total [candidate] (8.708 s) : 0, 8708312
section iast
Agent [baseline] (1.23 s) : 0, 1229683
Total [baseline] (9.393 s) : 0, 9393105
Agent [candidate] (1.232 s) : 0, 1232035
Total [candidate] (9.4 s) : 0, 9399643
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.075 s -
Agent iast 1.23 s 154.787 ms (14.4%)
Total tracing 8.793 s -
Total iast 9.393 s 599.757 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.232 s 168.538 ms (15.8%)
Total tracing 8.708 s -
Total iast 9.4 s 691.331 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (634.538 ms) : 0, 634538
BytebuddyAgent [candidate] (627.76 ms) : 0, 627760
AgentMeter [baseline] (29.243 ms) : 0, 29243
AgentMeter [candidate] (28.891 ms) : 0, 28891
GlobalTracer [baseline] (259.69 ms) : 0, 259690
GlobalTracer [candidate] (257.705 ms) : 0, 257705
AppSec [baseline] (33.218 ms) : 0, 33218
AppSec [candidate] (32.86 ms) : 0, 32860
Debugger [baseline] (60.198 ms) : 0, 60198
Debugger [candidate] (62.594 ms) : 0, 62594
Remote Config [baseline] (629.67 µs) : 0, 630
Remote Config [candidate] (607.351 µs) : 0, 607
Telemetry [baseline] (13.763 ms) : 0, 13763
Telemetry [candidate] (10.615 ms) : 0, 10615
Flare Poller [baseline] (6.903 ms) : 0, 6903
Flare Poller [candidate] (6.101 ms) : 0, 6101
section iast
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (794.724 ms) : 0, 794724
BytebuddyAgent [candidate] (795.726 ms) : 0, 795726
AgentMeter [baseline] (11.217 ms) : 0, 11217
AgentMeter [candidate] (11.264 ms) : 0, 11264
GlobalTracer [baseline] (248.11 ms) : 0, 248110
GlobalTracer [candidate] (249.047 ms) : 0, 249047
IAST [baseline] (26.844 ms) : 0, 26844
IAST [candidate] (26.911 ms) : 0, 26911
AppSec [baseline] (32.191 ms) : 0, 32191
AppSec [candidate] (32.111 ms) : 0, 32111
Debugger [baseline] (67.411 ms) : 0, 67411
Debugger [candidate] (67.825 ms) : 0, 67825
Remote Config [baseline] (544.112 µs) : 0, 544
Remote Config [candidate] (546.85 µs) : 0, 547
Telemetry [baseline] (8.751 ms) : 0, 8751
Telemetry [candidate] (8.674 ms) : 0, 8674
Flare Poller [baseline] (3.533 ms) : 0, 3533
Flare Poller [candidate] (3.499 ms) : 0, 3499
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_1
git_commit_date 1770386810 1770389754
git_commit_sha e036f8c 197bd8b
release_version 1.60.0-SNAPSHOT~e036f8ca99 1.60.0-SNAPSHOT~197bd8b3f8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770391978 1770391978
ci_job_id 1406440262 1406440262
ci_pipeline_id 95005122 95005122
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-d6f29el1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-d6f29el1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 13 metrics, 18 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-537.822µs; -321.241µs] or [-9.707%; -5.798%]		 unstable
[-2.147ms; -0.690ms] or [-15.762%; -5.065%]		 unstable
[-22.836op/s; +149.961op/s] or [-3.078%; +20.212%]		 5.111ms 12.203ms 805.500op/s 5.540ms 13.622ms 741.938op/s
scenario:load:petclinic:appsec:high_load worse
[+1.980ms; +2.565ms] or [+10.885%; +14.096%]		 worse
[+1.460ms; +2.782ms] or [+4.838%; +9.218%]		 unstable
[-45.375op/s; -2.750op/s] or [-18.125%; -1.099%]		 20.467ms 32.297ms 226.281op/s 18.194ms 30.176ms 250.344op/s
scenario:load:petclinic:iast:high_load better
[-1.467ms; -0.841ms] or [-7.854%; -4.499%]		 better
[-2.163ms; -0.803ms] or [-7.177%; -2.665%]		 unstable
[-8.425op/s; +37.237op/s] or [-3.420%; +15.118%]		 17.528ms 28.650ms 260.719op/s 18.682ms 30.133ms 246.312op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.189 ms) : 1178, 1201
.   : milestone, 1189,
iast (3.087 ms) : 3047, 3127
.   : milestone, 3087,
iast_FULL (6.236 ms) : 6171, 6300
.   : milestone, 6236,
iast_GLOBAL (3.624 ms) : 3571, 3676
.   : milestone, 3624,
profiling (1.993 ms) : 1976, 2009
.   : milestone, 1993,
tracing (1.841 ms) : 1826, 1856
.   : milestone, 1841,
section candidate
no_agent (1.241 ms) : 1228, 1254
.   : milestone, 1241,
iast (3.165 ms) : 3125, 3206
.   : milestone, 3165,
iast_FULL (5.739 ms) : 5682, 5796
.   : milestone, 5739,
iast_GLOBAL (3.529 ms) : 3468, 3589
.   : milestone, 3529,
profiling (2.103 ms) : 2084, 2122
.   : milestone, 2103,
tracing (1.816 ms) : 1800, 1832
.   : milestone, 1816,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.189 ms [1.178 ms, 1.201 ms] -
iast 3.087 ms [3.047 ms, 3.127 ms] 1.898 ms (159.6%)
iast_FULL 6.236 ms [6.171 ms, 6.3 ms] 5.046 ms (424.3%)
iast_GLOBAL 3.624 ms [3.571 ms, 3.676 ms] 2.434 ms (204.7%)
profiling 1.993 ms [1.976 ms, 2.009 ms] 803.195 µs (67.5%)
tracing 1.841 ms [1.826 ms, 1.856 ms] 651.587 µs (54.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.241 ms [1.228 ms, 1.254 ms] -
iast 3.165 ms [3.125 ms, 3.206 ms] 1.924 ms (155.1%)
iast_FULL 5.739 ms [5.682 ms, 5.796 ms] 4.498 ms (362.5%)
iast_GLOBAL 3.529 ms [3.468 ms, 3.589 ms] 2.288 ms (184.3%)
profiling 2.103 ms [2.084 ms, 2.122 ms] 862.302 µs (69.5%)
tracing 1.816 ms [1.8 ms, 1.832 ms] 574.98 µs (46.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.395 ms) : 18206, 18584
.   : milestone, 18395,
appsec (18.642 ms) : 18449, 18834
.   : milestone, 18642,
code_origins (17.712 ms) : 17534, 17889
.   : milestone, 17712,
iast (18.948 ms) : 18756, 19139
.   : milestone, 18948,
profiling (19.734 ms) : 19537, 19931
.   : milestone, 19734,
tracing (17.492 ms) : 17317, 17666
.   : milestone, 17492,
section candidate
no_agent (19.218 ms) : 19020, 19416
.   : milestone, 19218,
appsec (20.641 ms) : 20432, 20850
.   : milestone, 20641,
code_origins (17.617 ms) : 17444, 17790
.   : milestone, 17617,
iast (17.897 ms) : 17721, 18074
.   : milestone, 17897,
profiling (19.802 ms) : 19602, 20002
.   : milestone, 19802,
tracing (17.801 ms) : 17625, 17977
.   : milestone, 17801,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.395 ms [18.206 ms, 18.584 ms] -
appsec 18.642 ms [18.449 ms, 18.834 ms] 246.716 µs (1.3%)
code_origins 17.712 ms [17.534 ms, 17.889 ms] -683.37 µs (-3.7%)
iast 18.948 ms [18.756 ms, 19.139 ms] 552.663 µs (3.0%)
profiling 19.734 ms [19.537 ms, 19.931 ms] 1.339 ms (7.3%)
tracing 17.492 ms [17.317 ms, 17.666 ms] -903.194 µs (-4.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.218 ms [19.02 ms, 19.416 ms] -
appsec 20.641 ms [20.432 ms, 20.85 ms] 1.423 ms (7.4%)
code_origins 17.617 ms [17.444 ms, 17.79 ms] -1.601 ms (-8.3%)
iast 17.897 ms [17.721 ms, 18.074 ms] -1.321 ms (-6.9%)
profiling 19.802 ms [19.602 ms, 20.002 ms] 583.947 µs (3.0%)
tracing 17.801 ms [17.625 ms, 17.977 ms] -1.417 ms (-7.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_1
git_commit_date 1770386810 1770389754
git_commit_sha e036f8c 197bd8b
release_version 1.60.0-SNAPSHOT~e036f8ca99 1.60.0-SNAPSHOT~197bd8b3f8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770391631 1770391631
ci_job_id 1406440263 1406440263
ci_pipeline_id 95005122 95005122
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-0vppw41p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-0vppw41p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.966 s) : 14966000, 14966000
.   : milestone, 14966000,
appsec (14.867 s) : 14867000, 14867000
.   : milestone, 14867000,
iast (18.491 s) : 18491000, 18491000
.   : milestone, 18491000,
iast_GLOBAL (17.874 s) : 17874000, 17874000
.   : milestone, 17874000,
profiling (14.834 s) : 14834000, 14834000
.   : milestone, 14834000,
tracing (14.891 s) : 14891000, 14891000
.   : milestone, 14891000,
section candidate
no_agent (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
appsec (14.95 s) : 14950000, 14950000
.   : milestone, 14950000,
iast (18.326 s) : 18326000, 18326000
.   : milestone, 18326000,
iast_GLOBAL (17.85 s) : 17850000, 17850000
.   : milestone, 17850000,
profiling (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
tracing (14.761 s) : 14761000, 14761000
.   : milestone, 14761000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.966 s [14.966 s, 14.966 s] -
appsec 14.867 s [14.867 s, 14.867 s] -99.0 ms (-0.7%)
iast 18.491 s [18.491 s, 18.491 s] 3.525 s (23.6%)
iast_GLOBAL 17.874 s [17.874 s, 17.874 s] 2.908 s (19.4%)
profiling 14.834 s [14.834 s, 14.834 s] -132.0 ms (-0.9%)
tracing 14.891 s [14.891 s, 14.891 s] -75.0 ms (-0.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.049 s [15.049 s, 15.049 s] -
appsec 14.95 s [14.95 s, 14.95 s] -99.0 ms (-0.7%)
iast 18.326 s [18.326 s, 18.326 s] 3.277 s (21.8%)
iast_GLOBAL 17.85 s [17.85 s, 17.85 s] 2.801 s (18.6%)
profiling 14.926 s [14.926 s, 14.926 s] -123.0 ms (-0.8%)
tracing 14.761 s [14.761 s, 14.761 s] -288.0 ms (-1.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~197bd8b3f8, baseline=1.60.0-SNAPSHOT~e036f8ca99
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1494
.   : milestone, 1482,
appsec (3.773 ms) : 3552, 3994
.   : milestone, 3773,
iast (2.258 ms) : 2188, 2327
.   : milestone, 2258,
iast_GLOBAL (2.315 ms) : 2244, 2385
.   : milestone, 2315,
profiling (2.144 ms) : 2086, 2202
.   : milestone, 2144,
tracing (2.079 ms) : 2024, 2133
.   : milestone, 2079,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (3.717 ms) : 3500, 3934
.   : milestone, 3717,
iast (2.269 ms) : 2199, 2338
.   : milestone, 2269,
iast_GLOBAL (2.304 ms) : 2234, 2374
.   : milestone, 2304,
profiling (2.108 ms) : 2051, 2165
.   : milestone, 2108,
tracing (2.069 ms) : 2015, 2123
.   : milestone, 2069,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.494 ms] -
appsec 3.773 ms [3.552 ms, 3.994 ms] 2.291 ms (154.6%)
iast 2.258 ms [2.188 ms, 2.327 ms] 775.392 µs (52.3%)
iast_GLOBAL 2.315 ms [2.244 ms, 2.385 ms] 832.686 µs (56.2%)
profiling 2.144 ms [2.086 ms, 2.202 ms] 662.034 µs (44.7%)
tracing 2.079 ms [2.024 ms, 2.133 ms] 596.476 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 3.717 ms [3.5 ms, 3.934 ms] 2.241 ms (151.8%)
iast 2.269 ms [2.199 ms, 2.338 ms] 792.818 µs (53.7%)
iast_GLOBAL 2.304 ms [2.234 ms, 2.374 ms] 827.866 µs (56.1%)
profiling 2.108 ms [2.051 ms, 2.165 ms] 631.939 µs (42.8%)
tracing 2.069 ms [2.015 ms, 2.123 ms] 593.045 µs (40.2%)

jbachorik and others added 2 commits February 6, 2026 13:49
@jbachorik jbachorik merged commit 36e285c into master Feb 8, 2026
545 checks passed
@jbachorik jbachorik deleted the jb/tlm_test_1 branch February 8, 2026 08:18
@github-actions github-actions bot added this to the 1.60.0 milestone Feb 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees

No one assigned

Labels

comp: testing Testing tag: ai generated Largely based on code generated by an AI or LLM tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.60.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jbachorik @mcculls @AlexeyKuznetsov-DD