Add rate limit on span decoration probe errors by jpbempel · Pull Request #10529 · DataDog/dd-trace-java

jpbempel · 2026-02-05T13:40:21Z

What Does This Do

if an evaluation error is generated by a span decoration probe we are rate limiting it

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: DEBUG-3797

if an evaluation error is generated by a span decoration probe we are rate limiting it

github-actions · 2026-02-05T13:40:40Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2026-02-05T13:57:15Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1770299150	1770299496
end_time	2026-02-05T13:47:10	2026-02-05T13:52:56
git_branch	master	jpbempel/fix-span-deco-error-rate-limit
git_commit_sha	`4039fd9`	`84ab56b`
start_time	2026-02-05T13:45:51	2026-02-05T13:51:37

See matching parameters

	Baseline	Candidate
ci_job_id	1403862432	1403862432
ci_pipeline_id	94861663	94861663
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1770298666	1770298666

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-30.332µs; +17.374µs] or [-10.915%; +6.252%]	unstable [-43.208µs; +26.364µs] or [-13.535%; +8.258%]	unstable [-55.286µs; +36.121µs] or [-16.542%; +10.808%]	unstable [-74.362µs; +160.076µs] or [-7.912%; +17.032%]	same
scenario:basic	unsure [-9.468µs; -2.038µs] or [-3.801%; -0.818%]	same	same	unstable [-73.316µs; +277.616µs] or [-10.634%; +40.268%]	unstable [-165.204op/s; +165.204op/s] or [-6.113%; +6.113%]
scenario:loop	same	same	same	same	same

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (319.232 µs) : 278, 360
.   : milestone, 319,
basic (276.875 µs) : 270, 284
.   : milestone, 277,
loop (8.957 ms) : 8952, 8962
.   : milestone, 8957,
section candidate
noprobe (310.81 µs) : 288, 334
.   : milestone, 311,
basic (273.624 µs) : 267, 280
.   : milestone, 274,
loop (8.962 ms) : 8957, 8968
.   : milestone, 8962,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	319.232 µs [278.451 µs, 360.013 µs]
basic	276.875 µs [269.752 µs, 283.998 µs]
loop	8.957 ms [8.952 ms, 8.962 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	310.81 µs [287.756 µs, 333.863 µs]
basic	273.624 µs [267.363 µs, 279.886 µs]
loop	8.962 ms [8.957 ms, 8.968 ms]

pr-commenter · 2026-02-05T14:24:29Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-span-deco-error-rate-limit
git_commit_date	1770237481	1770298666
git_commit_sha	`9c3d035`	`84ab56b`
release_version	1.60.0-SNAPSHOT~9c3d035f5f	1.60.0-SNAPSHOT~84ab56b1f9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1770300428	1770300428
ci_job_id	1403862416	1403862416
ci_pipeline_id	94861663	94861663
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-r8c0u2cy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-r8c0u2cy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060201
Total [baseline] (8.717 s) : 0, 8717261
Agent [candidate] (1.062 s) : 0, 1062428
Total [candidate] (8.71 s) : 0, 8709515
section iast
Agent [baseline] (1.23 s) : 0, 1230162
Total [baseline] (9.348 s) : 0, 9348204
Agent [candidate] (1.229 s) : 0, 1228816
Total [candidate] (9.341 s) : 0, 9341254

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	iast	1.23 s	169.961 ms (16.0%)
Total	tracing	8.717 s	-
Total	iast	9.348 s	630.943 ms (7.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.062 s	-
Agent	iast	1.229 s	166.388 ms (15.7%)
Total	tracing	8.71 s	-
Total	iast	9.341 s	631.739 ms (7.3%)

gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (626.685 ms) : 0, 626685
BytebuddyAgent [candidate] (627.14 ms) : 0, 627140
AgentMeter [baseline] (28.832 ms) : 0, 28832
AgentMeter [candidate] (28.753 ms) : 0, 28753
GlobalTracer [baseline] (257.124 ms) : 0, 257124
GlobalTracer [candidate] (257.298 ms) : 0, 257298
AppSec [baseline] (32.863 ms) : 0, 32863
AppSec [candidate] (32.726 ms) : 0, 32726
Debugger [baseline] (63.144 ms) : 0, 63144
Debugger [candidate] (60.936 ms) : 0, 60936
Remote Config [baseline] (610.402 µs) : 0, 610
Remote Config [candidate] (623.402 µs) : 0, 623
Telemetry [baseline] (10.666 ms) : 0, 10666
Telemetry [candidate] (11.481 ms) : 0, 11481
Flare Poller [baseline] (3.793 ms) : 0, 3793
Flare Poller [candidate] (6.943 ms) : 0, 6943
section iast
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (794.903 ms) : 0, 794903
BytebuddyAgent [candidate] (795.126 ms) : 0, 795126
AgentMeter [baseline] (11.28 ms) : 0, 11280
AgentMeter [candidate] (11.257 ms) : 0, 11257
GlobalTracer [baseline] (247.834 ms) : 0, 247834
GlobalTracer [candidate] (247.185 ms) : 0, 247185
IAST [baseline] (27.061 ms) : 0, 27061
IAST [candidate] (26.849 ms) : 0, 26849
AppSec [baseline] (33.166 ms) : 0, 33166
AppSec [candidate] (35.517 ms) : 0, 35517
Debugger [baseline] (66.809 ms) : 0, 66809
Debugger [candidate] (63.757 ms) : 0, 63757
Remote Config [baseline] (543.925 µs) : 0, 544
Remote Config [candidate] (534.09 µs) : 0, 534
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.696 ms) : 0, 8696
Flare Poller [baseline] (3.498 ms) : 0, 3498
Flare Poller [candidate] (3.481 ms) : 0, 3481

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066234
Total [baseline] (10.917 s) : 0, 10916564
Agent [candidate] (1.066 s) : 0, 1066366
Total [candidate] (10.913 s) : 0, 10913236
section appsec
Agent [baseline] (1.233 s) : 0, 1232677
Total [baseline] (10.907 s) : 0, 10907066
Agent [candidate] (1.239 s) : 0, 1238805
Total [candidate] (10.924 s) : 0, 10923997
section iast
Agent [baseline] (1.232 s) : 0, 1231786
Total [baseline] (11.153 s) : 0, 11152643
Agent [candidate] (1.24 s) : 0, 1239886
Total [candidate] (11.162 s) : 0, 11162047
section profiling
Agent [baseline] (1.194 s) : 0, 1194473
Total [baseline] (10.867 s) : 0, 10866914
Agent [candidate] (1.193 s) : 0, 1193373
Total [candidate] (10.99 s) : 0, 10989757

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.233 s	166.443 ms (15.6%)
Agent	iast	1.232 s	165.552 ms (15.5%)
Agent	profiling	1.194 s	128.24 ms (12.0%)
Total	tracing	10.917 s	-
Total	appsec	10.907 s	-9.498 ms (-0.1%)
Total	iast	11.153 s	236.079 ms (2.2%)
Total	profiling	10.867 s	-49.65 ms (-0.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.239 s	172.439 ms (16.2%)
Agent	iast	1.24 s	173.519 ms (16.3%)
Agent	profiling	1.193 s	127.007 ms (11.9%)
Total	tracing	10.913 s	-
Total	appsec	10.924 s	10.762 ms (0.1%)
Total	iast	11.162 s	248.811 ms (2.3%)
Total	profiling	10.99 s	76.521 ms (0.7%)

gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (628.058 ms) : 0, 628058
BytebuddyAgent [candidate] (629.014 ms) : 0, 629014
AgentMeter [baseline] (28.855 ms) : 0, 28855
AgentMeter [candidate] (28.853 ms) : 0, 28853
GlobalTracer [baseline] (257.551 ms) : 0, 257551
GlobalTracer [candidate] (258.247 ms) : 0, 258247
AppSec [baseline] (32.779 ms) : 0, 32779
AppSec [candidate] (32.773 ms) : 0, 32773
Debugger [baseline] (62.638 ms) : 0, 62638
Debugger [candidate] (61.773 ms) : 0, 61773
Remote Config [baseline] (630.239 µs) : 0, 630
Remote Config [candidate] (608.814 µs) : 0, 609
Telemetry [baseline] (12.37 ms) : 0, 12370
Telemetry [candidate] (12.395 ms) : 0, 12395
Flare Poller [baseline] (6.79 ms) : 0, 6790
Flare Poller [candidate] (6.2 ms) : 0, 6200
section appsec
crashtracking [baseline] (1.17 ms) : 0, 1170
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (654.977 ms) : 0, 654977
BytebuddyAgent [candidate] (658.316 ms) : 0, 658316
AgentMeter [baseline] (11.795 ms) : 0, 11795
AgentMeter [candidate] (11.869 ms) : 0, 11869
GlobalTracer [baseline] (256.752 ms) : 0, 256752
GlobalTracer [candidate] (258.404 ms) : 0, 258404
AppSec [baseline] (167.254 ms) : 0, 167254
AppSec [candidate] (167.765 ms) : 0, 167765
Debugger [baseline] (67.001 ms) : 0, 67001
Debugger [candidate] (67.08 ms) : 0, 67080
Remote Config [baseline] (666.445 µs) : 0, 666
Remote Config [candidate] (667.273 µs) : 0, 667
Telemetry [baseline] (9.092 ms) : 0, 9092
Telemetry [candidate] (9.213 ms) : 0, 9213
Flare Poller [baseline] (3.601 ms) : 0, 3601
Flare Poller [candidate] (3.688 ms) : 0, 3688
IAST [baseline] (25.221 ms) : 0, 25221
IAST [candidate] (25.334 ms) : 0, 25334
section iast
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (796.771 ms) : 0, 796771
BytebuddyAgent [candidate] (802.235 ms) : 0, 802235
AgentMeter [baseline] (11.256 ms) : 0, 11256
AgentMeter [candidate] (11.517 ms) : 0, 11517
GlobalTracer [baseline] (247.774 ms) : 0, 247774
GlobalTracer [candidate] (248.918 ms) : 0, 248918
AppSec [baseline] (34.839 ms) : 0, 34839
AppSec [candidate] (35.647 ms) : 0, 35647
Debugger [baseline] (65.237 ms) : 0, 65237
Debugger [candidate] (65.161 ms) : 0, 65161
Remote Config [baseline] (537.096 µs) : 0, 537
Remote Config [candidate] (552.055 µs) : 0, 552
Telemetry [baseline] (8.737 ms) : 0, 8737
Telemetry [candidate] (8.73 ms) : 0, 8730
Flare Poller [baseline] (3.44 ms) : 0, 3440
Flare Poller [candidate] (3.428 ms) : 0, 3428
IAST [baseline] (26.801 ms) : 0, 26801
IAST [candidate] (27.146 ms) : 0, 27146
section profiling
ProfilingAgent [baseline] (99.32 ms) : 0, 99320
ProfilingAgent [candidate] (99.996 ms) : 0, 99996
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (685.612 ms) : 0, 685612
BytebuddyAgent [candidate] (682.962 ms) : 0, 682962
AgentMeter [baseline] (8.854 ms) : 0, 8854
AgentMeter [candidate] (8.748 ms) : 0, 8748
GlobalTracer [baseline] (215.763 ms) : 0, 215763
GlobalTracer [candidate] (216.598 ms) : 0, 216598
AppSec [baseline] (32.456 ms) : 0, 32456
AppSec [candidate] (32.776 ms) : 0, 32776
Debugger [baseline] (67.983 ms) : 0, 67983
Debugger [candidate] (68.026 ms) : 0, 68026
Remote Config [baseline] (602.32 µs) : 0, 602
Remote Config [candidate] (612.684 µs) : 0, 613
Telemetry [baseline] (8.817 ms) : 0, 8817
Telemetry [candidate] (8.828 ms) : 0, 8828
Flare Poller [baseline] (3.816 ms) : 0, 3816
Flare Poller [candidate] (3.784 ms) : 0, 3784
Profiling [baseline] (99.886 ms) : 0, 99886
Profiling [candidate] (100.57 ms) : 0, 100570

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-span-deco-error-rate-limit
git_commit_date	1770237481	1770298666
git_commit_sha	`9c3d035`	`84ab56b`
release_version	1.60.0-SNAPSHOT~9c3d035f5f	1.60.0-SNAPSHOT~84ab56b1f9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1770300929	1770300929
ci_job_id	1403862419	1403862419
ci_pipeline_id	94861663	94861663
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-eb79i6gh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-eb79i6gh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+81.584µs; +207.321µs] or [+5.080%; +12.909%]	unstable [+252.162µs; +1102.349µs] or [+5.508%; +24.081%]	unstable [-499.884op/s; +18.196op/s] or [-21.936%; +0.798%]	1.750ms	5.255ms	2038.031op/s	1.606ms	4.578ms	2278.875op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-349.752µs; -129.266µs] or [-6.430%; -2.376%]	better [-1058.991µs; -343.213µs] or [-8.025%; -2.601%]	unstable [-51.914op/s; +112.664op/s] or [-6.877%; +14.925%]	5.200ms	12.496ms	785.250op/s	5.440ms	13.197ms	754.875op/s
scenario:load:petclinic:tracing:high_load	better [-789.339µs; -392.450µs] or [-4.522%; -2.248%]	unsure [-1036.847µs; -19.827µs] or [-3.642%; -0.070%]	unstable [-18.854op/s; +31.042op/s] or [-7.173%; +11.810%]	16.865ms	27.941ms	268.938op/s	17.456ms	28.469ms	262.844op/s
scenario:load:petclinic:appsec:high_load	worse [+547.286µs; +1442.934µs] or [+3.001%; +7.912%]	unsure [+187.323µs; +1643.951µs] or [+0.626%; +5.494%]	unstable [-35.237op/s; +11.862op/s] or [-14.042%; +4.727%]	19.233ms	30.840ms	239.250op/s	18.238ms	29.925ms	250.938op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.273 ms) : 19072, 19475
.   : milestone, 19273,
appsec (18.597 ms) : 18407, 18788
.   : milestone, 18597,
code_origins (17.649 ms) : 17473, 17824
.   : milestone, 17649,
iast (17.753 ms) : 17578, 17927
.   : milestone, 17753,
profiling (18.468 ms) : 18283, 18653
.   : milestone, 18468,
tracing (17.755 ms) : 17578, 17932
.   : milestone, 17755,
section candidate
no_agent (18.948 ms) : 18756, 19140
.   : milestone, 18948,
appsec (19.514 ms) : 19315, 19712
.   : milestone, 19514,
code_origins (17.538 ms) : 17363, 17712
.   : milestone, 17538,
iast (17.609 ms) : 17432, 17785
.   : milestone, 17609,
profiling (18.417 ms) : 18233, 18602
.   : milestone, 18417,
tracing (17.348 ms) : 17180, 17516
.   : milestone, 17348,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.273 ms [19.072 ms, 19.475 ms]	-
appsec	18.597 ms [18.407 ms, 18.788 ms]	-675.711 µs (-3.5%)
code_origins	17.649 ms [17.473 ms, 17.824 ms]	-1.625 ms (-8.4%)
iast	17.753 ms [17.578 ms, 17.927 ms]	-1.52 ms (-7.9%)
profiling	18.468 ms [18.283 ms, 18.653 ms]	-804.929 µs (-4.2%)
tracing	17.755 ms [17.578 ms, 17.932 ms]	-1.518 ms (-7.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.948 ms [18.756 ms, 19.14 ms]	-
appsec	19.514 ms [19.315 ms, 19.712 ms]	565.928 µs (3.0%)
code_origins	17.538 ms [17.363 ms, 17.712 ms]	-1.41 ms (-7.4%)
iast	17.609 ms [17.432 ms, 17.785 ms]	-1.339 ms (-7.1%)
profiling	18.417 ms [18.233 ms, 18.602 ms]	-530.558 µs (-2.8%)
tracing	17.348 ms [17.18 ms, 17.516 ms]	-1.6 ms (-8.4%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.19 ms) : 1179, 1202
.   : milestone, 1190,
iast (3.206 ms) : 3162, 3251
.   : milestone, 3206,
iast_FULL (6.129 ms) : 6065, 6193
.   : milestone, 6129,
iast_GLOBAL (3.563 ms) : 3497, 3628
.   : milestone, 3563,
profiling (1.98 ms) : 1963, 1998
.   : milestone, 1980,
tracing (1.769 ms) : 1754, 1783
.   : milestone, 1769,
section candidate
no_agent (1.183 ms) : 1171, 1196
.   : milestone, 1183,
iast (3.15 ms) : 3107, 3192
.   : milestone, 3150,
iast_FULL (5.888 ms) : 5829, 5946
.   : milestone, 5888,
iast_GLOBAL (3.585 ms) : 3525, 3644
.   : milestone, 3585,
profiling (2.223 ms) : 2201, 2245
.   : milestone, 2223,
tracing (1.754 ms) : 1739, 1768
.   : milestone, 1754,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.19 ms [1.179 ms, 1.202 ms]	-
iast	3.206 ms [3.162 ms, 3.251 ms]	2.016 ms (169.3%)
iast_FULL	6.129 ms [6.065 ms, 6.193 ms]	4.939 ms (414.9%)
iast_GLOBAL	3.563 ms [3.497 ms, 3.628 ms]	2.372 ms (199.3%)
profiling	1.98 ms [1.963 ms, 1.998 ms]	789.854 µs (66.3%)
tracing	1.769 ms [1.754 ms, 1.783 ms]	578.284 µs (48.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.183 ms [1.171 ms, 1.196 ms]	-
iast	3.15 ms [3.107 ms, 3.192 ms]	1.966 ms (166.1%)
iast_FULL	5.888 ms [5.829 ms, 5.946 ms]	4.704 ms (397.5%)
iast_GLOBAL	3.585 ms [3.525 ms, 3.644 ms]	2.401 ms (202.9%)
profiling	2.223 ms [2.201 ms, 2.245 ms]	1.04 ms (87.8%)
tracing	1.754 ms [1.739 ms, 1.768 ms]	570.107 µs (48.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-span-deco-error-rate-limit
git_commit_date	1770237481	1770298666
git_commit_sha	`9c3d035`	`84ab56b`
release_version	1.60.0-SNAPSHOT~9c3d035f5f	1.60.0-SNAPSHOT~84ab56b1f9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1770300587	1770300587
ci_job_id	1403862421	1403862421
ci_pipeline_id	94861663	94861663
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-egsw59e5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-egsw59e5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.502 ms) : 2447, 2556
.   : milestone, 2502,
iast (2.253 ms) : 2184, 2322
.   : milestone, 2253,
iast_GLOBAL (2.292 ms) : 2223, 2361
.   : milestone, 2292,
profiling (2.107 ms) : 2050, 2163
.   : milestone, 2107,
tracing (2.07 ms) : 2017, 2124
.   : milestone, 2070,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (3.766 ms) : 3544, 3989
.   : milestone, 3766,
iast (2.257 ms) : 2188, 2325
.   : milestone, 2257,
iast_GLOBAL (2.307 ms) : 2237, 2376
.   : milestone, 2307,
profiling (2.079 ms) : 2025, 2134
.   : milestone, 2079,
tracing (2.065 ms) : 2012, 2118
.   : milestone, 2065,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.464 ms, 1.487 ms]	-
appsec	2.502 ms [2.447 ms, 2.556 ms]	1.026 ms (69.5%)
iast	2.253 ms [2.184 ms, 2.322 ms]	777.041 µs (52.7%)
iast_GLOBAL	2.292 ms [2.223 ms, 2.361 ms]	816.323 µs (55.3%)
profiling	2.107 ms [2.05 ms, 2.163 ms]	630.699 µs (42.7%)
tracing	2.07 ms [2.017 ms, 2.124 ms]	594.203 µs (40.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.489 ms]	-
appsec	3.766 ms [3.544 ms, 3.989 ms]	2.289 ms (155.0%)
iast	2.257 ms [2.188 ms, 2.325 ms]	779.532 µs (52.8%)
iast_GLOBAL	2.307 ms [2.237 ms, 2.376 ms]	829.817 µs (56.2%)
profiling	2.079 ms [2.025 ms, 2.134 ms]	602.298 µs (40.8%)
tracing	2.065 ms [2.012 ms, 2.118 ms]	587.872 µs (39.8%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~84ab56b1f9, baseline=1.60.0-SNAPSHOT~9c3d035f5f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.08 s) : 15080000, 15080000
.   : milestone, 15080000,
appsec (15.135 s) : 15135000, 15135000
.   : milestone, 15135000,
iast (17.918 s) : 17918000, 17918000
.   : milestone, 17918000,
iast_GLOBAL (17.981 s) : 17981000, 17981000
.   : milestone, 17981000,
profiling (14.871 s) : 14871000, 14871000
.   : milestone, 14871000,
tracing (14.865 s) : 14865000, 14865000
.   : milestone, 14865000,
section candidate
no_agent (15.126 s) : 15126000, 15126000
.   : milestone, 15126000,
appsec (14.863 s) : 14863000, 14863000
.   : milestone, 14863000,
iast (18.357 s) : 18357000, 18357000
.   : milestone, 18357000,
iast_GLOBAL (17.951 s) : 17951000, 17951000
.   : milestone, 17951000,
profiling (15.007 s) : 15007000, 15007000
.   : milestone, 15007000,
tracing (14.601 s) : 14601000, 14601000
.   : milestone, 14601000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.08 s [15.08 s, 15.08 s]	-
appsec	15.135 s [15.135 s, 15.135 s]	55.0 ms (0.4%)
iast	17.918 s [17.918 s, 17.918 s]	2.838 s (18.8%)
iast_GLOBAL	17.981 s [17.981 s, 17.981 s]	2.901 s (19.2%)
profiling	14.871 s [14.871 s, 14.871 s]	-209.0 ms (-1.4%)
tracing	14.865 s [14.865 s, 14.865 s]	-215.0 ms (-1.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.126 s [15.126 s, 15.126 s]	-
appsec	14.863 s [14.863 s, 14.863 s]	-263.0 ms (-1.7%)
iast	18.357 s [18.357 s, 18.357 s]	3.231 s (21.4%)
iast_GLOBAL	17.951 s [17.951 s, 17.951 s]	2.825 s (18.7%)
profiling	15.007 s [15.007 s, 15.007 s]	-119.0 ms (-0.8%)
tracing	14.601 s [14.601 s, 14.601 s]	-525.0 ms (-3.5%)

jpbempel · 2026-02-05T17:36:02Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-02-05T17:36:07Z

View all feedbacks in Devflow UI.

2026-02-05 17:36:06 UTC ℹ️ Start processing command /merge

2026-02-05 17:36:11 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-02-05 17:36:37 UTC ❌ MergeQueue: This merge request is not mergeable, blocked by github

PR can't be merged according to github policy

sarahchen6 · 2026-02-05T21:01:44Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-02-05T21:01:49Z

View all feedbacks in Devflow UI.

2026-02-05 21:01:48 UTC ℹ️ Start processing command /merge

2026-02-05 21:01:53 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-02-05 22:17:04 UTC ℹ️ MergeQueue: This merge request was merged

sarahchen6 · 2026-02-05T21:02:12Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-02-05T21:02:16Z

View all feedbacks in Devflow UI.

2026-02-05 21:02:16 UTC ℹ️ Start processing command /merge

2026-02-05 21:02:18 UTC ❌ MergeQueue

PR already in the queue with status in_progress

Add rate limit on Span decoration probe errors

84ab56b

if an evaluation error is generated by a span decoration probe we are rate limiting it

jpbempel requested a review from a team as a code owner February 5, 2026 13:40

jpbempel requested review from shatzi and removed request for a team February 5, 2026 13:40

jpbempel added comp: debugger Dynamic Instrumentation type: bug Bug report and fix labels Feb 5, 2026

jpbempel changed the title ~~Add rate limit on Span decoration probe errors~~ Add rate limit on span decoration probe errors Feb 5, 2026

tylfin approved these changes Feb 5, 2026

View reviewed changes

gh-worker-dd-devflow-36fce6 bot added mergequeue-status: queued mergequeue-status: rejected and removed mergequeue-status: queued labels Feb 5, 2026

shatzi approved these changes Feb 5, 2026

View reviewed changes

gh-worker-dd-devflow-36fce6 bot added mergequeue-status: queued mergequeue-status: in_progress and removed mergequeue-status: rejected mergequeue-status: queued labels Feb 5, 2026

gh-worker-dd-mergequeue-cf854d bot merged commit eff2a4b into master Feb 5, 2026
566 of 572 checks passed

gh-worker-dd-devflow-36fce6 bot removed the mergequeue-status: in_progress label Feb 5, 2026

gh-worker-dd-mergequeue-cf854d bot deleted the jpbempel/fix-span-deco-error-rate-limit branch February 5, 2026 22:16

gh-worker-dd-devflow-36fce6 bot added the mergequeue-status: done label Feb 5, 2026

github-actions bot added this to the 1.60.0 milestone Feb 5, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add rate limit on span decoration probe errors#10529

Add rate limit on span decoration probe errors#10529
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomasterfrom
jpbempel/fix-span-deco-error-rate-limit

jpbempel commented Feb 5, 2026 •

edited by atlassian bot

Loading

Uh oh!

github-actions bot commented Feb 5, 2026

Uh oh!

pr-commenter bot commented Feb 5, 2026

Uh oh!

pr-commenter bot commented Feb 5, 2026

Uh oh!

jpbempel commented Feb 5, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 •

edited

Loading

Uh oh!

sarahchen6 commented Feb 5, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 •

edited

Loading

Uh oh!

sarahchen6 commented Feb 5, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

jpbempel commented Feb 5, 2026 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented Feb 5, 2026

Uh oh!

pr-commenter bot commented Feb 5, 2026

Debugger benchmarks

Parameters

Summary

Uh oh!

pr-commenter bot commented Feb 5, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

jpbempel commented Feb 5, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sarahchen6 commented Feb 5, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sarahchen6 commented Feb 5, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

jpbempel commented Feb 5, 2026 •

edited by atlassian bot

Loading

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Feb 5, 2026 •

edited

Loading