Implement OpenTelemetry meter storage and aggregations #10534

mcculls · 2026-02-06T00:20:26Z

Additional Notes

Exporting of metrics will be implemented in a separate PR.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APMAPI-1765

…ice - we do this to match OTel behaviour

pr-commenter · 2026-02-06T00:33:39Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/otel-meter-storage
git_commit_date	1770332232	1770372678
git_commit_sha	`d8f2599`	`3f305b4`
release_version	1.60.0-SNAPSHOT~d8f2599d6f	1.60.0-SNAPSHOT~3f305b4c07

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1770374341	1770374341
ci_job_id	1405797954	1405797954
ci_pipeline_id	94974658	94974658
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-5krpcs8u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-5krpcs8u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063892
Total [baseline] (8.732 s) : 0, 8732374
Agent [candidate] (1.063 s) : 0, 1063211
Total [candidate] (8.756 s) : 0, 8755789
section iast
Agent [baseline] (1.229 s) : 0, 1229497
Total [baseline] (9.355 s) : 0, 9354520
Agent [candidate] (1.231 s) : 0, 1231223
Total [candidate] (9.377 s) : 0, 9377462

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	iast	1.229 s	165.605 ms (15.6%)
Total	tracing	8.732 s	-
Total	iast	9.355 s	622.146 ms (7.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.063 s	-
Agent	iast	1.231 s	168.012 ms (15.8%)
Total	tracing	8.756 s	-
Total	iast	9.377 s	621.674 ms (7.1%)

gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (628.483 ms) : 0, 628483
BytebuddyAgent [candidate] (627.658 ms) : 0, 627658
AgentMeter [baseline] (28.953 ms) : 0, 28953
AgentMeter [candidate] (28.927 ms) : 0, 28927
GlobalTracer [baseline] (258.174 ms) : 0, 258174
GlobalTracer [candidate] (257.863 ms) : 0, 257863
AppSec [baseline] (32.807 ms) : 0, 32807
AppSec [candidate] (32.884 ms) : 0, 32884
Debugger [baseline] (61.468 ms) : 0, 61468
Debugger [candidate] (61.085 ms) : 0, 61085
Remote Config [baseline] (613.904 µs) : 0, 614
Remote Config [candidate] (612.52 µs) : 0, 613
Telemetry [baseline] (13.072 ms) : 0, 13072
Telemetry [candidate] (12.289 ms) : 0, 12289
Flare Poller [baseline] (3.79 ms) : 0, 3790
Flare Poller [candidate] (5.388 ms) : 0, 5388
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (795.499 ms) : 0, 795499
BytebuddyAgent [candidate] (796.354 ms) : 0, 796354
AgentMeter [baseline] (11.254 ms) : 0, 11254
AgentMeter [candidate] (11.284 ms) : 0, 11284
GlobalTracer [baseline] (247.272 ms) : 0, 247272
GlobalTracer [candidate] (247.826 ms) : 0, 247826
AppSec [baseline] (34.661 ms) : 0, 34661
AppSec [candidate] (33.816 ms) : 0, 33816
Debugger [baseline] (64.618 ms) : 0, 64618
Debugger [candidate] (65.751 ms) : 0, 65751
Remote Config [baseline] (545.486 µs) : 0, 545
Remote Config [candidate] (534.801 µs) : 0, 535
Telemetry [baseline] (8.667 ms) : 0, 8667
Telemetry [candidate] (8.729 ms) : 0, 8729
Flare Poller [baseline] (3.497 ms) : 0, 3497
Flare Poller [candidate] (3.548 ms) : 0, 3548
IAST [baseline] (27.004 ms) : 0, 27004
IAST [candidate] (26.888 ms) : 0, 26888

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065622
Total [baseline] (10.848 s) : 0, 10847996
Agent [candidate] (1.072 s) : 0, 1071836
Total [candidate] (10.942 s) : 0, 10941924
section appsec
Agent [baseline] (1.235 s) : 0, 1235444
Total [baseline] (10.938 s) : 0, 10938209
Agent [candidate] (1.239 s) : 0, 1238726
Total [candidate] (11.069 s) : 0, 11068624
section iast
Agent [baseline] (1.242 s) : 0, 1242458
Total [baseline] (11.148 s) : 0, 11148381
Agent [candidate] (1.23 s) : 0, 1229778
Total [candidate] (11.238 s) : 0, 11238423
section profiling
Agent [baseline] (1.196 s) : 0, 1195595
Total [baseline] (10.967 s) : 0, 10966858
Agent [candidate] (1.19 s) : 0, 1190036
Total [candidate] (10.976 s) : 0, 10975526

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.235 s	169.822 ms (15.9%)
Agent	iast	1.242 s	176.836 ms (16.6%)
Agent	profiling	1.196 s	129.973 ms (12.2%)
Total	tracing	10.848 s	-
Total	appsec	10.938 s	90.213 ms (0.8%)
Total	iast	11.148 s	300.385 ms (2.8%)
Total	profiling	10.967 s	118.862 ms (1.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.072 s	-
Agent	appsec	1.239 s	166.891 ms (15.6%)
Agent	iast	1.23 s	157.943 ms (14.7%)
Agent	profiling	1.19 s	118.201 ms (11.0%)
Total	tracing	10.942 s	-
Total	appsec	11.069 s	126.7 ms (1.2%)
Total	iast	11.238 s	296.499 ms (2.7%)
Total	profiling	10.976 s	33.602 ms (0.3%)

gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (628.002 ms) : 0, 628002
BytebuddyAgent [candidate] (633.515 ms) : 0, 633515
AgentMeter [baseline] (28.828 ms) : 0, 28828
AgentMeter [candidate] (29.114 ms) : 0, 29114
GlobalTracer [baseline] (257.572 ms) : 0, 257572
GlobalTracer [candidate] (259.092 ms) : 0, 259092
AppSec [baseline] (32.838 ms) : 0, 32838
AppSec [candidate] (32.925 ms) : 0, 32925
Debugger [baseline] (62.786 ms) : 0, 62786
Debugger [candidate] (62.305 ms) : 0, 62305
Remote Config [baseline] (626.895 µs) : 0, 627
Remote Config [candidate] (617.772 µs) : 0, 618
Telemetry [baseline] (12.338 ms) : 0, 12338
Telemetry [candidate] (11.482 ms) : 0, 11482
Flare Poller [baseline] (6.176 ms) : 0, 6176
Flare Poller [candidate] (6.047 ms) : 0, 6047
section appsec
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (655.53 ms) : 0, 655530
BytebuddyAgent [candidate] (657.601 ms) : 0, 657601
AgentMeter [baseline] (11.851 ms) : 0, 11851
AgentMeter [candidate] (11.838 ms) : 0, 11838
GlobalTracer [baseline] (257.915 ms) : 0, 257915
GlobalTracer [candidate] (258.868 ms) : 0, 258868
IAST [baseline] (25.204 ms) : 0, 25204
IAST [candidate] (25.242 ms) : 0, 25242
AppSec [baseline] (168.12 ms) : 0, 168120
AppSec [candidate] (167.67 ms) : 0, 167670
Debugger [baseline] (67.112 ms) : 0, 67112
Debugger [candidate] (67.63 ms) : 0, 67630
Remote Config [baseline] (666.732 µs) : 0, 667
Remote Config [candidate] (669.069 µs) : 0, 669
Telemetry [baseline] (9.106 ms) : 0, 9106
Telemetry [candidate] (9.205 ms) : 0, 9205
Flare Poller [baseline] (3.603 ms) : 0, 3603
Flare Poller [candidate] (3.624 ms) : 0, 3624
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (804.876 ms) : 0, 804876
BytebuddyAgent [candidate] (795.007 ms) : 0, 795007
AgentMeter [baseline] (11.354 ms) : 0, 11354
AgentMeter [candidate] (11.235 ms) : 0, 11235
GlobalTracer [baseline] (249.582 ms) : 0, 249582
GlobalTracer [candidate] (247.653 ms) : 0, 247653
IAST [baseline] (27.032 ms) : 0, 27032
IAST [candidate] (26.836 ms) : 0, 26836
AppSec [baseline] (32.992 ms) : 0, 32992
AppSec [candidate] (34.761 ms) : 0, 34761
Debugger [baseline] (67.368 ms) : 0, 67368
Debugger [candidate] (65.404 ms) : 0, 65404
Remote Config [baseline] (552.084 µs) : 0, 552
Remote Config [candidate] (543.433 µs) : 0, 543
Telemetry [baseline] (8.603 ms) : 0, 8603
Telemetry [candidate] (8.569 ms) : 0, 8569
Flare Poller [baseline] (3.478 ms) : 0, 3478
Flare Poller [candidate] (3.434 ms) : 0, 3434
section profiling
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (684.484 ms) : 0, 684484
BytebuddyAgent [candidate] (682.705 ms) : 0, 682705
AgentMeter [baseline] (8.81 ms) : 0, 8810
AgentMeter [candidate] (8.7 ms) : 0, 8700
GlobalTracer [baseline] (217.368 ms) : 0, 217368
GlobalTracer [candidate] (215.788 ms) : 0, 215788
AppSec [baseline] (32.572 ms) : 0, 32572
AppSec [candidate] (32.33 ms) : 0, 32330
Debugger [baseline] (68.098 ms) : 0, 68098
Debugger [candidate] (67.329 ms) : 0, 67329
Remote Config [baseline] (618.196 µs) : 0, 618
Remote Config [candidate] (590.18 µs) : 0, 590
Telemetry [baseline] (9.019 ms) : 0, 9019
Telemetry [candidate] (8.76 ms) : 0, 8760
Flare Poller [baseline] (3.773 ms) : 0, 3773
Flare Poller [candidate] (3.791 ms) : 0, 3791
ProfilingAgent [baseline] (99.718 ms) : 0, 99718
ProfilingAgent [candidate] (98.851 ms) : 0, 98851
Profiling [baseline] (100.294 ms) : 0, 100294
Profiling [candidate] (99.428 ms) : 0, 99428

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/otel-meter-storage
git_commit_date	1770332232	1770372678
git_commit_sha	`d8f2599`	`3f305b4`
release_version	1.60.0-SNAPSHOT~d8f2599d6f	1.60.0-SNAPSHOT~3f305b4c07

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1770374831	1770374831
ci_job_id	1405797955	1405797955
ci_pipeline_id	94974658	94974658
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-6avi3hmc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-6avi3hmc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 1 performance regressions! Performance is the same for 13 metrics, 18 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	better [-227.024µs; -106.026µs] or [-12.667%; -5.916%]	unstable [-1323.803µs; -502.569µs] or [-23.934%; -9.086%]	unstable [+59.062op/s; +550.688op/s] or [+3.008%; +28.044%]	1.626ms	4.618ms	2268.562op/s	1.792ms	5.531ms	1963.688op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-564.524µs; -226.802µs] or [-10.724%; -4.309%]	better [-1224.539µs; -403.718µs] or [-9.763%; -3.219%]	unstable [-30.159op/s; +135.721op/s] or [-3.850%; +17.325%]	4.868ms	11.728ms	836.156op/s	5.264ms	12.542ms	783.375op/s
scenario:load:petclinic:profiling:high_load	better [-1.543ms; -0.648ms] or [-8.078%; -3.390%]	unsure [-2.056ms; -0.544ms] or [-6.681%; -1.767%]	unstable [-13.874op/s; +37.686op/s] or [-5.769%; +15.670%]	18.011ms	29.476ms	252.406op/s	19.106ms	30.776ms	240.500op/s
scenario:load:petclinic:iast:high_load	worse [+427.789µs; +1117.200µs] or [+2.453%; +6.406%]	unsure [+65.657µs; +1442.461µs] or [+0.230%; +5.044%]	unstable [-38.249op/s; +16.374op/s] or [-14.563%; +6.234%]	18.212ms	29.351ms	251.719op/s	17.440ms	28.597ms	262.656op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.03 ms) : 17844, 18215
.   : milestone, 18030,
appsec (18.715 ms) : 18524, 18905
.   : milestone, 18715,
code_origins (17.639 ms) : 17464, 17814
.   : milestone, 17639,
iast (17.772 ms) : 17595, 17949
.   : milestone, 17772,
profiling (19.409 ms) : 19214, 19604
.   : milestone, 19409,
tracing (17.647 ms) : 17473, 17821
.   : milestone, 17647,
section candidate
no_agent (17.906 ms) : 17725, 18087
.   : milestone, 17906,
appsec (18.313 ms) : 18128, 18497
.   : milestone, 18313,
code_origins (17.582 ms) : 17407, 17758
.   : milestone, 17582,
iast (18.537 ms) : 18351, 18723
.   : milestone, 18537,
profiling (18.489 ms) : 18306, 18672
.   : milestone, 18489,
tracing (17.783 ms) : 17609, 17957
.   : milestone, 17783,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.03 ms [17.844 ms, 18.215 ms]	-
appsec	18.715 ms [18.524 ms, 18.905 ms]	685.371 µs (3.8%)
code_origins	17.639 ms [17.464 ms, 17.814 ms]	-390.271 µs (-2.2%)
iast	17.772 ms [17.595 ms, 17.949 ms]	-257.48 µs (-1.4%)
profiling	19.409 ms [19.214 ms, 19.604 ms]	1.38 ms (7.7%)
tracing	17.647 ms [17.473 ms, 17.821 ms]	-382.968 µs (-2.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.906 ms [17.725 ms, 18.087 ms]	-
appsec	18.313 ms [18.128 ms, 18.497 ms]	406.756 µs (2.3%)
code_origins	17.582 ms [17.407 ms, 17.758 ms]	-323.346 µs (-1.8%)
iast	18.537 ms [18.351 ms, 18.723 ms]	631.512 µs (3.5%)
profiling	18.489 ms [18.306 ms, 18.672 ms]	583.206 µs (3.3%)
tracing	17.783 ms [17.609 ms, 17.957 ms]	-123.177 µs (-0.7%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.172 ms) : 1160, 1183
.   : milestone, 1172,
iast (3.094 ms) : 3052, 3137
.   : milestone, 3094,
iast_FULL (5.904 ms) : 5845, 5963
.   : milestone, 5904,
iast_GLOBAL (3.451 ms) : 3399, 3503
.   : milestone, 3451,
profiling (2.31 ms) : 2288, 2332
.   : milestone, 2310,
tracing (1.795 ms) : 1779, 1810
.   : milestone, 1795,
section candidate
no_agent (1.184 ms) : 1172, 1195
.   : milestone, 1184,
iast (3.067 ms) : 3033, 3101
.   : milestone, 3067,
iast_FULL (5.527 ms) : 5473, 5581
.   : milestone, 5527,
iast_GLOBAL (3.587 ms) : 3531, 3643
.   : milestone, 3587,
profiling (1.99 ms) : 1971, 2009
.   : milestone, 1990,
tracing (1.841 ms) : 1823, 1858
.   : milestone, 1841,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.172 ms [1.16 ms, 1.183 ms]	-
iast	3.094 ms [3.052 ms, 3.137 ms]	1.923 ms (164.1%)
iast_FULL	5.904 ms [5.845 ms, 5.963 ms]	4.732 ms (403.9%)
iast_GLOBAL	3.451 ms [3.399 ms, 3.503 ms]	2.28 ms (194.6%)
profiling	2.31 ms [2.288 ms, 2.332 ms]	1.138 ms (97.2%)
tracing	1.795 ms [1.779 ms, 1.81 ms]	622.94 µs (53.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.184 ms [1.172 ms, 1.195 ms]	-
iast	3.067 ms [3.033 ms, 3.101 ms]	1.883 ms (159.1%)
iast_FULL	5.527 ms [5.473 ms, 5.581 ms]	4.343 ms (366.9%)
iast_GLOBAL	3.587 ms [3.531 ms, 3.643 ms]	2.403 ms (203.0%)
profiling	1.99 ms [1.971 ms, 2.009 ms]	805.86 µs (68.1%)
tracing	1.841 ms [1.823 ms, 1.858 ms]	656.888 µs (55.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mcculls/otel-meter-storage
git_commit_date	1770332232	1770372678
git_commit_sha	`d8f2599`	`3f305b4`
release_version	1.60.0-SNAPSHOT~d8f2599d6f	1.60.0-SNAPSHOT~3f305b4c07

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1770374649	1770374649
ci_job_id	1405797956	1405797956
ci_pipeline_id	94974658	94974658
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-yoq8ywde 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-yoq8ywde 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.369 s) : 15369000, 15369000
.   : milestone, 15369000,
appsec (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
iast (18.174 s) : 18174000, 18174000
.   : milestone, 18174000,
iast_GLOBAL (17.768 s) : 17768000, 17768000
.   : milestone, 17768000,
profiling (15.473 s) : 15473000, 15473000
.   : milestone, 15473000,
tracing (14.782 s) : 14782000, 14782000
.   : milestone, 14782000,
section candidate
no_agent (14.88 s) : 14880000, 14880000
.   : milestone, 14880000,
appsec (14.792 s) : 14792000, 14792000
.   : milestone, 14792000,
iast (18.271 s) : 18271000, 18271000
.   : milestone, 18271000,
iast_GLOBAL (18.093 s) : 18093000, 18093000
.   : milestone, 18093000,
profiling (14.801 s) : 14801000, 14801000
.   : milestone, 14801000,
tracing (14.692 s) : 14692000, 14692000
.   : milestone, 14692000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.369 s [15.369 s, 15.369 s]	-
appsec	15.036 s [15.036 s, 15.036 s]	-333.0 ms (-2.2%)
iast	18.174 s [18.174 s, 18.174 s]	2.805 s (18.3%)
iast_GLOBAL	17.768 s [17.768 s, 17.768 s]	2.399 s (15.6%)
profiling	15.473 s [15.473 s, 15.473 s]	104.0 ms (0.7%)
tracing	14.782 s [14.782 s, 14.782 s]	-587.0 ms (-3.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.88 s [14.88 s, 14.88 s]	-
appsec	14.792 s [14.792 s, 14.792 s]	-88.0 ms (-0.6%)
iast	18.271 s [18.271 s, 18.271 s]	3.391 s (22.8%)
iast_GLOBAL	18.093 s [18.093 s, 18.093 s]	3.213 s (21.6%)
profiling	14.801 s [14.801 s, 14.801 s]	-79.0 ms (-0.5%)
tracing	14.692 s [14.692 s, 14.692 s]	-188.0 ms (-1.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3f305b4c07, baseline=1.60.0-SNAPSHOT~d8f2599d6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.754 ms) : 3534, 3974
.   : milestone, 3754,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.302 ms) : 2232, 2371
.   : milestone, 2302,
profiling (2.099 ms) : 2043, 2155
.   : milestone, 2099,
tracing (2.051 ms) : 1998, 2104
.   : milestone, 2051,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.765 ms) : 3544, 3986
.   : milestone, 3765,
iast (2.262 ms) : 2193, 2331
.   : milestone, 2262,
iast_GLOBAL (2.295 ms) : 2226, 2364
.   : milestone, 2295,
profiling (2.073 ms) : 2019, 2127
.   : milestone, 2073,
tracing (2.069 ms) : 2015, 2122
.   : milestone, 2069,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.459 ms, 1.482 ms]	-
appsec	3.754 ms [3.534 ms, 3.974 ms]	2.284 ms (155.3%)
iast	2.251 ms [2.182 ms, 2.32 ms]	781.113 µs (53.1%)
iast_GLOBAL	2.302 ms [2.232 ms, 2.371 ms]	831.489 µs (56.6%)
profiling	2.099 ms [2.043 ms, 2.155 ms]	628.781 µs (42.8%)
tracing	2.051 ms [1.998 ms, 2.104 ms]	580.771 µs (39.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	3.765 ms [3.544 ms, 3.986 ms]	2.294 ms (155.9%)
iast	2.262 ms [2.193 ms, 2.331 ms]	790.635 µs (53.7%)
iast_GLOBAL	2.295 ms [2.226 ms, 2.364 ms]	823.944 µs (56.0%)
profiling	2.073 ms [2.019 ms, 2.127 ms]	602.08 µs (40.9%)
tracing	2.069 ms [2.015 ms, 2.122 ms]	597.523 µs (40.6%)

PerfectSlayer

Looking good. Left few questions / comments along the review.
As the instrumentation is not enabled and still partial (anything related to callback is still missing for example), it's fine having no test for now. I prefer having small PRs to review :)

...-otel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/data/OtelMetricStorage.java

...agent-otel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelDoubleCounter.java

PerfectSlayer · 2026-02-06T08:31:09Z

...ent-otel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelDoubleHistogram.java

+            0d, 5d, 10d, 25d, 50d, 75d, 100d, 250d, 500d, 750d, 1_000d, 2_500d, 5_000d, 7_500d,
+            10_000d);


👏 praise: ‏Thanks for making numeric literals easier to read with _!

...ent-otel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelDoubleHistogram.java

PerfectSlayer · 2026-02-06T08:44:54Z

...tel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelInstrumentDescriptor.java

+import javax.annotation.Nullable;
+
+/** Uniquely describes an instrument for the Meter that created it. */
+public final class OtelInstrumentDescriptor {


💭 thought: ‏Sometime I wish we had record 😮‍💨

...gent-otel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelInstrumentType.java

...agent-otel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelLongHistogram.java

...tel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelInstrumentDescriptor.java

mcculls · 2026-02-06T11:04:36Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-02-06T11:04:41Z

View all feedbacks in Devflow UI.

2026-02-06 11:04:40 UTC ℹ️ Start processing command /merge

2026-02-06 11:04:44 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-02-06 11:54:17 UTC ℹ️ MergeQueue: This merge request was merged

mcculls added 13 commits February 5, 2026 23:30

Build instrument descriptors

4525c09

Fill in default arguments

7c3a232

Disallow negative values in counters/histograms

10d70b3

Validate and capture explicit bucket boundaries

3c0341e

Update OTel metrics helper list

f64d81e

Context is unused by our metric mapping

9cf99ae

Implement OTel metrics storage and aggregation

806f7e4

Track metrics storage per-meter

0e362ed

Introduce visitor API for exporting metrics

ed5f068

Suppress warning about catching NPE in setExplicitBucketBoundariesAdv…

2dc0b03

…ice - we do this to match OTel behaviour

Spotless

082c358

Cleanup

fb6ee6b

javadoc

492a33e

mcculls added type: feature request inst: opentelemetry OpenTelemetry instrumentation labels Feb 6, 2026

mcculls marked this pull request as ready for review February 6, 2026 01:01

mcculls requested review from a team as code owners February 6, 2026 01:01

mcculls requested review from PerfectSlayer and mhlidd and removed request for a team February 6, 2026 01:01

PerfectSlayer reviewed Feb 6, 2026

View reviewed changes

PerfectSlayer approved these changes Feb 6, 2026

View reviewed changes

PerfectSlayer reviewed Feb 6, 2026

View reviewed changes

...tel/otel-shim/src/main/java/datadog/opentelemetry/shim/metrics/OtelInstrumentDescriptor.java Show resolved Hide resolved

Review feedback

3f305b4

gh-worker-dd-devflow-36fce6 bot added mergequeue-status: queued and removed mergequeue-status: queued labels Feb 6, 2026

gh-worker-dd-devflow-36fce6 bot added the mergequeue-status: in_progress label Feb 6, 2026

gh-worker-dd-mergequeue-cf854d bot merged commit cffe9c6 into master Feb 6, 2026
548 of 551 checks passed

gh-worker-dd-devflow-36fce6 bot removed the mergequeue-status: in_progress label Feb 6, 2026

gh-worker-dd-mergequeue-cf854d bot deleted the mcculls/otel-meter-storage branch February 6, 2026 11:54

gh-worker-dd-devflow-36fce6 bot added the mergequeue-status: done label Feb 6, 2026

github-actions bot added this to the 1.60.0 milestone Feb 6, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Implement OpenTelemetry meter storage and aggregations #10534

Implement OpenTelemetry meter storage and aggregations #10534

mcculls commented Feb 6, 2026 •

edited by atlassian bot

Loading

Uh oh!

pr-commenter bot commented Feb 6, 2026 •

edited

Loading

Uh oh!

PerfectSlayer left a comment

Uh oh!

Uh oh!

Uh oh!

PerfectSlayer Feb 6, 2026

Uh oh!

Uh oh!

PerfectSlayer Feb 6, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mcculls commented Feb 6, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 6, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		0d, 5d, 10d, 25d, 50d, 75d, 100d, 250d, 500d, 750d, 1_000d, 2_500d, 5_000d, 7_500d,
		10_000d);

Implement OpenTelemetry meter storage and aggregations #10534

Implement OpenTelemetry meter storage and aggregations #10534

Conversation

mcculls commented Feb 6, 2026 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Feb 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

PerfectSlayer Feb 6, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

PerfectSlayer Feb 6, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mcculls commented Feb 6, 2026

Uh oh!

gh-worker-devflow-routing-ef8351 bot commented Feb 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

mcculls commented Feb 6, 2026 •

edited by atlassian bot

Loading

pr-commenter bot commented Feb 6, 2026 •

edited

Loading

gh-worker-devflow-routing-ef8351 bot commented Feb 6, 2026 •

edited

Loading