Exclude ElasticSearch 9.3 from muzzle checks#10522
Conversation
…gram which hasn't been published
|
Hi! 👋 Thanks for your pull request! 🎉 To help us review it, please make sure to:
If you need help, please check our contributing guidelines. |
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065510
Total [baseline] (10.951 s) : 0, 10951027
Agent [candidate] (1.07 s) : 0, 1069682
Total [candidate] (10.936 s) : 0, 10936333
section appsec
Agent [baseline] (1.251 s) : 0, 1251182
Total [baseline] (11.168 s) : 0, 11167567
Agent [candidate] (1.239 s) : 0, 1238805
Total [candidate] (11.025 s) : 0, 11025266
section iast
Agent [baseline] (1.239 s) : 0, 1238650
Total [baseline] (11.228 s) : 0, 11227718
Agent [candidate] (1.23 s) : 0, 1230352
Total [candidate] (11.253 s) : 0, 11252621
section profiling
Agent [baseline] (1.195 s) : 0, 1195452
Total [baseline] (10.923 s) : 0, 10922788
Agent [candidate] (1.189 s) : 0, 1188609
Total [candidate] (10.981 s) : 0, 10981287
gantt
title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (627.955 ms) : 0, 627955
BytebuddyAgent [candidate] (629.487 ms) : 0, 629487
AgentMeter [baseline] (28.933 ms) : 0, 28933
AgentMeter [candidate] (28.959 ms) : 0, 28959
GlobalTracer [baseline] (259.021 ms) : 0, 259021
GlobalTracer [candidate] (259.706 ms) : 0, 259706
AppSec [baseline] (33.019 ms) : 0, 33019
AppSec [candidate] (33.167 ms) : 0, 33167
Debugger [baseline] (61.907 ms) : 0, 61907
Debugger [candidate] (60.99 ms) : 0, 60990
Remote Config [baseline] (618.034 µs) : 0, 618
Remote Config [candidate] (627.121 µs) : 0, 627
Telemetry [baseline] (13.086 ms) : 0, 13086
Telemetry [candidate] (14.805 ms) : 0, 14805
Flare Poller [baseline] (4.592 ms) : 0, 4592
Flare Poller [candidate] (5.365 ms) : 0, 5365
section appsec
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (662.65 ms) : 0, 662650
BytebuddyAgent [candidate] (658.015 ms) : 0, 658015
AgentMeter [baseline] (11.925 ms) : 0, 11925
AgentMeter [candidate] (11.727 ms) : 0, 11727
GlobalTracer [baseline] (261.768 ms) : 0, 261768
GlobalTracer [candidate] (258.824 ms) : 0, 258824
AppSec [baseline] (170.09 ms) : 0, 170090
AppSec [candidate] (167.747 ms) : 0, 167747
Debugger [baseline] (68.514 ms) : 0, 68514
Debugger [candidate] (67.353 ms) : 0, 67353
Remote Config [baseline] (716.926 µs) : 0, 717
Remote Config [candidate] (683.986 µs) : 0, 684
Telemetry [baseline] (9.341 ms) : 0, 9341
Telemetry [candidate] (9.173 ms) : 0, 9173
Flare Poller [baseline] (3.697 ms) : 0, 3697
Flare Poller [candidate] (3.616 ms) : 0, 3616
IAST [baseline] (25.824 ms) : 0, 25824
IAST [candidate] (25.174 ms) : 0, 25174
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (800.273 ms) : 0, 800273
BytebuddyAgent [candidate] (794.732 ms) : 0, 794732
AgentMeter [baseline] (11.242 ms) : 0, 11242
AgentMeter [candidate] (11.12 ms) : 0, 11120
GlobalTracer [baseline] (249.754 ms) : 0, 249754
GlobalTracer [candidate] (247.999 ms) : 0, 247999
AppSec [baseline] (33.112 ms) : 0, 33112
AppSec [candidate] (32.341 ms) : 0, 32341
Debugger [baseline] (68.008 ms) : 0, 68008
Debugger [candidate] (68.295 ms) : 0, 68295
Remote Config [baseline] (539.13 µs) : 0, 539
Remote Config [candidate] (541.846 µs) : 0, 542
Telemetry [baseline] (8.668 ms) : 0, 8668
Telemetry [candidate] (8.811 ms) : 0, 8811
Flare Poller [baseline] (3.491 ms) : 0, 3491
Flare Poller [candidate] (3.429 ms) : 0, 3429
IAST [baseline] (27.051 ms) : 0, 27051
IAST [candidate] (26.753 ms) : 0, 26753
section profiling
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (685.511 ms) : 0, 685511
BytebuddyAgent [candidate] (681.333 ms) : 0, 681333
AgentMeter [baseline] (8.659 ms) : 0, 8659
AgentMeter [candidate] (8.615 ms) : 0, 8615
GlobalTracer [baseline] (217.018 ms) : 0, 217018
GlobalTracer [candidate] (215.734 ms) : 0, 215734
AppSec [baseline] (32.667 ms) : 0, 32667
AppSec [candidate] (32.248 ms) : 0, 32248
Debugger [baseline] (67.728 ms) : 0, 67728
Debugger [candidate] (67.268 ms) : 0, 67268
Remote Config [baseline] (606.927 µs) : 0, 607
Remote Config [candidate] (592.305 µs) : 0, 592
Telemetry [baseline] (8.84 ms) : 0, 8840
Telemetry [candidate] (8.909 ms) : 0, 8909
Flare Poller [baseline] (3.748 ms) : 0, 3748
Flare Poller [candidate] (3.811 ms) : 0, 3811
ProfilingAgent [baseline] (99.422 ms) : 0, 99422
ProfilingAgent [candidate] (99.105 ms) : 0, 99105
Profiling [baseline] (100.009 ms) : 0, 100009
Profiling [candidate] (99.673 ms) : 0, 99673
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061794
Total [baseline] (8.758 s) : 0, 8758140
Agent [candidate] (1.069 s) : 0, 1068757
Total [candidate] (8.765 s) : 0, 8764969
section iast
Agent [baseline] (1.228 s) : 0, 1228283
Total [baseline] (9.367 s) : 0, 9367092
Agent [candidate] (1.227 s) : 0, 1226998
Total [candidate] (9.363 s) : 0, 9363126
gantt
title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (627.725 ms) : 0, 627725
BytebuddyAgent [candidate] (631.876 ms) : 0, 631876
AgentMeter [baseline] (28.707 ms) : 0, 28707
AgentMeter [candidate] (28.959 ms) : 0, 28959
GlobalTracer [baseline] (257.532 ms) : 0, 257532
GlobalTracer [candidate] (259.14 ms) : 0, 259140
AppSec [baseline] (32.781 ms) : 0, 32781
AppSec [candidate] (33.284 ms) : 0, 33284
Debugger [baseline] (60.875 ms) : 0, 60875
Debugger [candidate] (59.934 ms) : 0, 59934
Remote Config [baseline] (617.553 µs) : 0, 618
Remote Config [candidate] (629.51 µs) : 0, 630
Telemetry [baseline] (11.694 ms) : 0, 11694
Telemetry [candidate] (11.521 ms) : 0, 11521
Flare Poller [baseline] (5.406 ms) : 0, 5406
Flare Poller [candidate] (6.879 ms) : 0, 6879
section iast
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (794.387 ms) : 0, 794387
BytebuddyAgent [candidate] (793.517 ms) : 0, 793517
AgentMeter [baseline] (11.12 ms) : 0, 11120
AgentMeter [candidate] (11.128 ms) : 0, 11128
GlobalTracer [baseline] (247.186 ms) : 0, 247186
GlobalTracer [candidate] (247.2 ms) : 0, 247200
AppSec [baseline] (35.469 ms) : 0, 35469
AppSec [candidate] (32.245 ms) : 0, 32245
Debugger [baseline] (63.932 ms) : 0, 63932
Debugger [candidate] (67.017 ms) : 0, 67017
Remote Config [baseline] (538.96 µs) : 0, 539
Remote Config [candidate] (532.044 µs) : 0, 532
Telemetry [baseline] (8.767 ms) : 0, 8767
Telemetry [candidate] (8.675 ms) : 0, 8675
Flare Poller [baseline] (3.53 ms) : 0, 3530
Flare Poller [candidate] (3.522 ms) : 0, 3522
IAST [baseline] (26.969 ms) : 0, 26969
IAST [candidate] (26.789 ms) : 0, 26789
LoadParameters
See matching parameters
SummaryFound 3 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section baseline
no_agent (1.187 ms) : 1176, 1199
. : milestone, 1187,
iast (3.235 ms) : 3192, 3277
. : milestone, 3235,
iast_FULL (5.702 ms) : 5644, 5759
. : milestone, 5702,
iast_GLOBAL (3.571 ms) : 3516, 3627
. : milestone, 3571,
profiling (2.218 ms) : 2198, 2238
. : milestone, 2218,
tracing (1.794 ms) : 1779, 1809
. : milestone, 1794,
section candidate
no_agent (1.192 ms) : 1180, 1204
. : milestone, 1192,
iast (3.17 ms) : 3127, 3213
. : milestone, 3170,
iast_FULL (5.844 ms) : 5785, 5902
. : milestone, 5844,
iast_GLOBAL (3.628 ms) : 3568, 3687
. : milestone, 3628,
profiling (1.969 ms) : 1953, 1986
. : milestone, 1969,
tracing (1.765 ms) : 1749, 1781
. : milestone, 1765,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section baseline
no_agent (19.181 ms) : 18985, 19377
. : milestone, 19181,
appsec (18.611 ms) : 18420, 18803
. : milestone, 18611,
code_origins (17.629 ms) : 17457, 17800
. : milestone, 17629,
iast (17.73 ms) : 17549, 17912
. : milestone, 17730,
profiling (18.661 ms) : 18475, 18847
. : milestone, 18661,
tracing (17.61 ms) : 17435, 17784
. : milestone, 17610,
section candidate
no_agent (17.208 ms) : 17038, 17378
. : milestone, 17208,
appsec (18.881 ms) : 18691, 19071
. : milestone, 18881,
code_origins (17.693 ms) : 17516, 17870
. : milestone, 17693,
iast (17.793 ms) : 17616, 17969
. : milestone, 17793,
profiling (18.666 ms) : 18477, 18854
. : milestone, 18666,
tracing (18.471 ms) : 18283, 18659
. : milestone, 18471,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section baseline
no_agent (14.866 s) : 14866000, 14866000
. : milestone, 14866000,
appsec (14.962 s) : 14962000, 14962000
. : milestone, 14962000,
iast (18.2 s) : 18200000, 18200000
. : milestone, 18200000,
iast_GLOBAL (17.9 s) : 17900000, 17900000
. : milestone, 17900000,
profiling (14.849 s) : 14849000, 14849000
. : milestone, 14849000,
tracing (14.529 s) : 14529000, 14529000
. : milestone, 14529000,
section candidate
no_agent (14.947 s) : 14947000, 14947000
. : milestone, 14947000,
appsec (14.892 s) : 14892000, 14892000
. : milestone, 14892000,
iast (17.997 s) : 17997000, 17997000
. : milestone, 17997000,
iast_GLOBAL (18.027 s) : 18027000, 18027000
. : milestone, 18027000,
profiling (14.616 s) : 14616000, 14616000
. : milestone, 14616000,
tracing (14.991 s) : 14991000, 14991000
. : milestone, 14991000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~3284b49637, baseline=1.60.0-SNAPSHOT~f9f47f3e84
dateFormat X
axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
. : milestone, 1470,
appsec (2.499 ms) : 2444, 2555
. : milestone, 2499,
iast (2.254 ms) : 2185, 2324
. : milestone, 2254,
iast_GLOBAL (2.307 ms) : 2237, 2377
. : milestone, 2307,
profiling (2.073 ms) : 2017, 2128
. : milestone, 2073,
tracing (2.062 ms) : 2008, 2116
. : milestone, 2062,
section candidate
no_agent (1.479 ms) : 1468, 1491
. : milestone, 1479,
appsec (3.735 ms) : 3514, 3956
. : milestone, 3735,
iast (2.257 ms) : 2188, 2326
. : milestone, 2257,
iast_GLOBAL (2.298 ms) : 2229, 2368
. : milestone, 2298,
profiling (2.526 ms) : 2362, 2690
. : milestone, 2526,
tracing (2.069 ms) : 2015, 2123
. : milestone, 2069,
|
| versions = "[2.0,3)" | ||
| assertInverse = true | ||
| skipVersions = ["7.11.0", "7.17.8", "8.8.0"] | ||
| skipVersions = ["7.11.0", "7.17.8", "8.8.0", "9.3.0"] |
There was a problem hiding this comment.
I would put a TODO comment like keep an eye for missing libs for 9.3.0, there is a chance they would be published soon, WDYT?
There was a problem hiding this comment.
hmm, yeah I considered it, but there was no explanation for the other exclusions, which discouraged me, and also they have a pretty good release rhythm, I figured they'd publish 9.3.1 soon enough, and things would return to normal
9.3.0 depends on exponential-histogram, an apparently new package, which hasn't been published (yet ?), so it makes muzzle fail not the checks but the setup, since it cannot download that dependency.
What Does This Do
Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any useful labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]