X Tutup
Skip to content

Add substituteVersion to muzzle directives to work around broken upstream POMs.#10777

Open
AlexeyKuznetsov-DD wants to merge 2 commits intomasterfrom
alexeyk/muzzle-substitute
Open

Add substituteVersion to muzzle directives to work around broken upstream POMs.#10777
AlexeyKuznetsov-DD wants to merge 2 commits intomasterfrom
alexeyk/muzzle-substitute

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Mar 9, 2026

What Does This Do

Adds a substituteVersion directive to muzzle that replaces an exact dependency coordinate with another during Gradle resolution. Both the requested and target coordinates must be in group:module:version form. Multiple
substitutions can be declared per directive.

Under the hood, the support layer:

  1. Downloads the target artifact's POM and materializes it into a synthetic local Maven repository under the requested coordinate (rewriting the <version> tag so the graph resolves cleanly).
  2. Registers a resolutionStrategy.eachDependency rule that redirects the actual artifact download to the real target version.

Applies the new directive to confluent-schema-registry-4.1 to work around a broken common-parent-7.5.13.pom published by Confluent, which references jetty.version=9.4.59 — a jetty-bom version that does not exist — causing muzzle
resolution to fail for all Confluent versions covered by that parent.

Motivation

https://packages.confluent.io/maven/io/confluent/common-parent/7.5.13/common-parent-7.5.13.pom (and several surrounding releases) shipped with <jetty.version>9.4.59</jetty.version>, where org.eclipse.jetty:jetty-bom:9.4.59 does
not exist. This caused muzzle to fail with a resolution error for every Confluent version that inherits from this parent POM, blocking CI.

The workaround substitutes org.eclipse.jetty:jetty-bom:9.4.59org.eclipse.jetty:jetty-bom:9.4.58.v20250814, the closest real release, which is API-compatible.

Additional Notes

  • The substituteVersion workaround in confluent-schema-registry-4.1/build.gradle should be removed once Confluent publishes a fixed common-parent POM.
  • The synthetic local repository approach is necessary because Gradle fetches POMs to build the dependency graph before resolutionStrategy rules apply to artifact downloads — so a missing POM causes a graph resolution failure even if a redirect rule is in place.

Found root cause and opened issue for confluent: confluentinc/kafka-connect-storage-common#468

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Mar 9, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added type: bug Bug report and fix comp: testing Testing tag: no release notes Changes to exclude from release notes inst: kafka Kafka instrumentation labels Mar 9, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review March 9, 2026 22:12
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested review from a team as code owners March 9, 2026 22:12
@pr-commenter
Copy link

pr-commenter bot commented Mar 9, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/muzzle-substitute
git_commit_date 1773086658 1773096741
git_commit_sha b77fdab 23240d2
release_version 1.61.0-SNAPSHOT~b77fdabf42 1.61.0-SNAPSHOT~23240d2cb3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773098639 1773098639
ci_job_id 1490813849 1490813849
ci_pipeline_id 101456506 101456506
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kmkwsdvv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kmkwsdvv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070692
Total [baseline] (8.859 s) : 0, 8859176
Agent [candidate] (1.06 s) : 0, 1060491
Total [candidate] (8.804 s) : 0, 8804263
section iast
Agent [baseline] (1.234 s) : 0, 1233652
Total [baseline] (9.532 s) : 0, 9532126
Agent [candidate] (1.228 s) : 0, 1228109
Total [candidate] (9.568 s) : 0, 9568210
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent iast 1.234 s 162.961 ms (15.2%)
Total tracing 8.859 s -
Total iast 9.532 s 672.949 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.228 s 167.618 ms (15.8%)
Total tracing 8.804 s -
Total iast 9.568 s 763.947 ms (8.7%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.237 ms) : 0, 1237
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (637.714 ms) : 0, 637714
BytebuddyAgent [candidate] (628.871 ms) : 0, 628871
AgentMeter [baseline] (29.532 ms) : 0, 29532
AgentMeter [candidate] (29.153 ms) : 0, 29153
GlobalTracer [baseline] (259.018 ms) : 0, 259018
GlobalTracer [candidate] (257.011 ms) : 0, 257011
AppSec [baseline] (31.819 ms) : 0, 31819
AppSec [candidate] (31.651 ms) : 0, 31651
Debugger [baseline] (59.166 ms) : 0, 59166
Debugger [candidate] (58.71 ms) : 0, 58710
Remote Config [baseline] (597.455 µs) : 0, 597
Remote Config [candidate] (585.403 µs) : 0, 585
Telemetry [baseline] (8.825 ms) : 0, 8825
Telemetry [candidate] (8.651 ms) : 0, 8651
Flare Poller [baseline] (6.495 ms) : 0, 6495
Flare Poller [candidate] (8.606 ms) : 0, 8606
section iast
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (800.849 ms) : 0, 800849
BytebuddyAgent [candidate] (797.461 ms) : 0, 797461
AgentMeter [baseline] (11.531 ms) : 0, 11531
AgentMeter [candidate] (11.318 ms) : 0, 11318
GlobalTracer [baseline] (248.294 ms) : 0, 248294
GlobalTracer [candidate] (247.813 ms) : 0, 247813
IAST [baseline] (25.359 ms) : 0, 25359
IAST [candidate] (25.149 ms) : 0, 25149
AppSec [baseline] (26.672 ms) : 0, 26672
AppSec [candidate] (27.266 ms) : 0, 27266
Debugger [baseline] (63.234 ms) : 0, 63234
Debugger [candidate] (61.562 ms) : 0, 61562
Remote Config [baseline] (551.567 µs) : 0, 552
Remote Config [candidate] (545.509 µs) : 0, 546
Telemetry [baseline] (14.853 ms) : 0, 14853
Telemetry [candidate] (15.077 ms) : 0, 15077
Flare Poller [baseline] (4.9 ms) : 0, 4900
Flare Poller [candidate] (4.638 ms) : 0, 4638
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066303
Total [baseline] (11.03 s) : 0, 11029796
Agent [candidate] (1.058 s) : 0, 1057978
Total [candidate] (11.026 s) : 0, 11026154
section appsec
Agent [baseline] (1.247 s) : 0, 1247245
Total [baseline] (11.091 s) : 0, 11091462
Agent [candidate] (1.245 s) : 0, 1245238
Total [candidate] (11.2 s) : 0, 11199800
section iast
Agent [baseline] (1.23 s) : 0, 1229650
Total [baseline] (11.401 s) : 0, 11400712
Agent [candidate] (1.226 s) : 0, 1225889
Total [candidate] (11.308 s) : 0, 11308447
section profiling
Agent [baseline] (1.182 s) : 0, 1182374
Total [baseline] (10.99 s) : 0, 10990091
Agent [candidate] (1.187 s) : 0, 1186925
Total [candidate] (11.112 s) : 0, 11111819
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.247 s 180.942 ms (17.0%)
Agent iast 1.23 s 163.347 ms (15.3%)
Agent profiling 1.182 s 116.071 ms (10.9%)
Total tracing 11.03 s -
Total appsec 11.091 s 61.666 ms (0.6%)
Total iast 11.401 s 370.916 ms (3.4%)
Total profiling 10.99 s -39.705 ms (-0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.245 s 187.259 ms (17.7%)
Agent iast 1.226 s 167.911 ms (15.9%)
Agent profiling 1.187 s 128.946 ms (12.2%)
Total tracing 11.026 s -
Total appsec 11.2 s 173.646 ms (1.6%)
Total iast 11.308 s 282.293 ms (2.6%)
Total profiling 11.112 s 85.665 ms (0.8%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (633.409 ms) : 0, 633409
BytebuddyAgent [candidate] (628.83 ms) : 0, 628830
AgentMeter [baseline] (29.191 ms) : 0, 29191
AgentMeter [candidate] (29.127 ms) : 0, 29127
GlobalTracer [baseline] (257.657 ms) : 0, 257657
GlobalTracer [candidate] (256.881 ms) : 0, 256881
AppSec [baseline] (31.679 ms) : 0, 31679
AppSec [candidate] (31.532 ms) : 0, 31532
Debugger [baseline] (59.64 ms) : 0, 59640
Debugger [candidate] (59.37 ms) : 0, 59370
Remote Config [baseline] (603.635 µs) : 0, 604
Remote Config [candidate] (598.281 µs) : 0, 598
Telemetry [baseline] (8.783 ms) : 0, 8783
Telemetry [candidate] (8.632 ms) : 0, 8632
Flare Poller [baseline] (8.051 ms) : 0, 8051
Flare Poller [candidate] (5.748 ms) : 0, 5748
section appsec
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (658.494 ms) : 0, 658494
BytebuddyAgent [candidate] (658.347 ms) : 0, 658347
AgentMeter [baseline] (11.998 ms) : 0, 11998
AgentMeter [candidate] (12.013 ms) : 0, 12013
GlobalTracer [baseline] (258.548 ms) : 0, 258548
GlobalTracer [candidate] (257.732 ms) : 0, 257732
IAST [baseline] (23.995 ms) : 0, 23995
IAST [candidate] (23.884 ms) : 0, 23884
AppSec [baseline] (177.758 ms) : 0, 177758
AppSec [candidate] (176.929 ms) : 0, 176929
Debugger [baseline] (65.782 ms) : 0, 65782
Debugger [candidate] (64.855 ms) : 0, 64855
Remote Config [baseline] (580.949 µs) : 0, 581
Remote Config [candidate] (583.562 µs) : 0, 584
Telemetry [baseline] (9.0 ms) : 0, 9000
Telemetry [candidate] (9.873 ms) : 0, 9873
Flare Poller [baseline] (3.587 ms) : 0, 3587
Flare Poller [candidate] (3.611 ms) : 0, 3611
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (796.402 ms) : 0, 796402
BytebuddyAgent [candidate] (794.528 ms) : 0, 794528
AgentMeter [baseline] (11.277 ms) : 0, 11277
AgentMeter [candidate] (11.321 ms) : 0, 11321
GlobalTracer [baseline] (247.632 ms) : 0, 247632
GlobalTracer [candidate] (247.081 ms) : 0, 247081
IAST [baseline] (25.369 ms) : 0, 25369
IAST [candidate] (25.156 ms) : 0, 25156
AppSec [baseline] (26.615 ms) : 0, 26615
AppSec [candidate] (27.25 ms) : 0, 27250
Debugger [baseline] (64.369 ms) : 0, 64369
Debugger [candidate] (63.067 ms) : 0, 63067
Remote Config [baseline] (534.478 µs) : 0, 534
Remote Config [candidate] (536.443 µs) : 0, 536
Telemetry [baseline] (15.097 ms) : 0, 15097
Telemetry [candidate] (14.867 ms) : 0, 14867
Flare Poller [baseline] (4.994 ms) : 0, 4994
Flare Poller [candidate] (4.923 ms) : 0, 4923
section profiling
crashtracking [baseline] (1.167 ms) : 0, 1167
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (682.891 ms) : 0, 682891
BytebuddyAgent [candidate] (683.84 ms) : 0, 683840
AgentMeter [baseline] (8.635 ms) : 0, 8635
AgentMeter [candidate] (8.628 ms) : 0, 8628
GlobalTracer [baseline] (215.282 ms) : 0, 215282
GlobalTracer [candidate] (216.521 ms) : 0, 216521
AppSec [baseline] (31.902 ms) : 0, 31902
AppSec [candidate] (32.233 ms) : 0, 32233
Debugger [baseline] (63.818 ms) : 0, 63818
Debugger [candidate] (65.002 ms) : 0, 65002
Remote Config [baseline] (599.493 µs) : 0, 599
Remote Config [candidate] (589.508 µs) : 0, 590
Telemetry [baseline] (9.007 ms) : 0, 9007
Telemetry [candidate] (9.051 ms) : 0, 9051
Flare Poller [baseline] (4.283 ms) : 0, 4283
Flare Poller [candidate] (3.591 ms) : 0, 3591
ProfilingAgent [baseline] (93.941 ms) : 0, 93941
ProfilingAgent [candidate] (95.044 ms) : 0, 95044
Profiling [baseline] (94.507 ms) : 0, 94507
Profiling [candidate] (95.615 ms) : 0, 95615
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/muzzle-substitute
git_commit_date 1773086658 1773096741
git_commit_sha b77fdab 23240d2
release_version 1.61.0-SNAPSHOT~b77fdabf42 1.61.0-SNAPSHOT~23240d2cb3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773099123 1773099123
ci_job_id 1490813850 1490813850
ci_pipeline_id 101456506 101456506
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-bxdz5osr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-bxdz5osr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+152.600µs; +261.912µs] or [+5.761%; +9.888%]
unstable
[-184.729µs; +1580.262µs] or [-2.392%; +20.464%]
unstable
[-226.866op/s; +47.804op/s] or [-16.805%; +3.541%]
2.856ms 8.420ms 1260.469op/s 2.649ms 7.722ms 1350.000op/s
scenario:load:insecure-bank:iast:high_load better
[-150.840µs; -55.218µs] or [-5.893%; -2.157%]
unsure
[-446.950µs; -42.694µs] or [-5.916%; -0.565%]
unstable
[-95.354op/s; +183.479op/s] or [-6.829%; +13.140%]
2.456ms 7.311ms 1440.375op/s 2.559ms 7.555ms 1396.312op/s
scenario:load:petclinic:no_agent:high_load better
[-2.288ms; -1.192ms] or [-12.549%; -6.538%]
better
[-3.535ms; -0.824ms] or [-11.661%; -2.718%]
unstable
[-2.862op/s; +52.362op/s] or [-1.154%; +21.119%]
16.493ms 28.133ms 272.688op/s 18.233ms 30.312ms 247.938op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.825 ms) : 18636, 19014
.   : milestone, 18825,
appsec (19.331 ms) : 19131, 19530
.   : milestone, 19331,
code_origins (17.836 ms) : 17661, 18012
.   : milestone, 17836,
iast (17.54 ms) : 17366, 17714
.   : milestone, 17540,
profiling (18.444 ms) : 18264, 18624
.   : milestone, 18444,
tracing (17.731 ms) : 17553, 17910
.   : milestone, 17731,
section candidate
no_agent (17.111 ms) : 16936, 17285
.   : milestone, 17111,
appsec (19.935 ms) : 19729, 20142
.   : milestone, 19935,
code_origins (18.571 ms) : 18383, 18758
.   : milestone, 18571,
iast (17.799 ms) : 17622, 17975
.   : milestone, 17799,
profiling (18.755 ms) : 18563, 18946
.   : milestone, 18755,
tracing (18.183 ms) : 18000, 18366
.   : milestone, 18183,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.825 ms [18.636 ms, 19.014 ms] -
appsec 19.331 ms [19.131 ms, 19.53 ms] 505.981 µs (2.7%)
code_origins 17.836 ms [17.661 ms, 18.012 ms] -988.609 µs (-5.3%)
iast 17.54 ms [17.366 ms, 17.714 ms] -1.285 ms (-6.8%)
profiling 18.444 ms [18.264 ms, 18.624 ms] -380.635 µs (-2.0%)
tracing 17.731 ms [17.553 ms, 17.91 ms] -1.093 ms (-5.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.111 ms [16.936 ms, 17.285 ms] -
appsec 19.935 ms [19.729 ms, 20.142 ms] 2.824 ms (16.5%)
code_origins 18.571 ms [18.383 ms, 18.758 ms] 1.46 ms (8.5%)
iast 17.799 ms [17.622 ms, 17.975 ms] 687.849 µs (4.0%)
profiling 18.755 ms [18.563 ms, 18.946 ms] 1.644 ms (9.6%)
tracing 18.183 ms [18.0 ms, 18.366 ms] 1.072 ms (6.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.178 ms) : 1167, 1190
.   : milestone, 1178,
iast (3.278 ms) : 3240, 3317
.   : milestone, 3278,
iast_FULL (5.897 ms) : 5837, 5956
.   : milestone, 5897,
iast_GLOBAL (3.393 ms) : 3337, 3449
.   : milestone, 3393,
profiling (2.005 ms) : 1988, 2023
.   : milestone, 2005,
tracing (1.776 ms) : 1762, 1790
.   : milestone, 1776,
section candidate
no_agent (1.196 ms) : 1184, 1208
.   : milestone, 1196,
iast (3.176 ms) : 3132, 3220
.   : milestone, 3176,
iast_FULL (5.792 ms) : 5732, 5851
.   : milestone, 5792,
iast_GLOBAL (3.64 ms) : 3580, 3700
.   : milestone, 3640,
profiling (2.058 ms) : 2038, 2078
.   : milestone, 2058,
tracing (1.836 ms) : 1820, 1852
.   : milestone, 1836,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.178 ms [1.167 ms, 1.19 ms] -
iast 3.278 ms [3.24 ms, 3.317 ms] 2.1 ms (178.2%)
iast_FULL 5.897 ms [5.837 ms, 5.956 ms] 4.718 ms (400.4%)
iast_GLOBAL 3.393 ms [3.337 ms, 3.449 ms] 2.215 ms (187.9%)
profiling 2.005 ms [1.988 ms, 2.023 ms] 826.737 µs (70.2%)
tracing 1.776 ms [1.762 ms, 1.79 ms] 597.722 µs (50.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.196 ms [1.184 ms, 1.208 ms] -
iast 3.176 ms [3.132 ms, 3.22 ms] 1.98 ms (165.6%)
iast_FULL 5.792 ms [5.732 ms, 5.851 ms] 4.596 ms (384.3%)
iast_GLOBAL 3.64 ms [3.58 ms, 3.7 ms] 2.444 ms (204.3%)
profiling 2.058 ms [2.038 ms, 2.078 ms] 861.938 µs (72.1%)
tracing 1.836 ms [1.82 ms, 1.852 ms] 639.825 µs (53.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/muzzle-substitute
git_commit_date 1773086658 1773096741
git_commit_sha b77fdab 23240d2
release_version 1.61.0-SNAPSHOT~b77fdabf42 1.61.0-SNAPSHOT~23240d2cb3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773098823 1773098823
ci_job_id 1490813851 1490813851
ci_pipeline_id 101456506 101456506
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-u6bzzn5h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-u6bzzn5h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
appsec (14.71 s) : 14710000, 14710000
.   : milestone, 14710000,
iast (17.889 s) : 17889000, 17889000
.   : milestone, 17889000,
iast_GLOBAL (17.607 s) : 17607000, 17607000
.   : milestone, 17607000,
profiling (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
tracing (15.058 s) : 15058000, 15058000
.   : milestone, 15058000,
section candidate
no_agent (15.325 s) : 15325000, 15325000
.   : milestone, 15325000,
appsec (14.824 s) : 14824000, 14824000
.   : milestone, 14824000,
iast (18.077 s) : 18077000, 18077000
.   : milestone, 18077000,
iast_GLOBAL (17.582 s) : 17582000, 17582000
.   : milestone, 17582000,
profiling (14.817 s) : 14817000, 14817000
.   : milestone, 14817000,
tracing (15.408 s) : 15408000, 15408000
.   : milestone, 15408000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.075 s [15.075 s, 15.075 s] -
appsec 14.71 s [14.71 s, 14.71 s] -365.0 ms (-2.4%)
iast 17.889 s [17.889 s, 17.889 s] 2.814 s (18.7%)
iast_GLOBAL 17.607 s [17.607 s, 17.607 s] 2.532 s (16.8%)
profiling 15.049 s [15.049 s, 15.049 s] -26.0 ms (-0.2%)
tracing 15.058 s [15.058 s, 15.058 s] -17.0 ms (-0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.325 s [15.325 s, 15.325 s] -
appsec 14.824 s [14.824 s, 14.824 s] -501.0 ms (-3.3%)
iast 18.077 s [18.077 s, 18.077 s] 2.752 s (18.0%)
iast_GLOBAL 17.582 s [17.582 s, 17.582 s] 2.257 s (14.7%)
profiling 14.817 s [14.817 s, 14.817 s] -508.0 ms (-3.3%)
tracing 15.408 s [15.408 s, 15.408 s] 83.0 ms (0.5%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~23240d2cb3, baseline=1.61.0-SNAPSHOT~b77fdabf42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.587 ms) : 2528, 2645
.   : milestone, 2587,
iast (2.268 ms) : 2199, 2337
.   : milestone, 2268,
iast_GLOBAL (2.316 ms) : 2246, 2386
.   : milestone, 2316,
profiling (2.11 ms) : 2053, 2166
.   : milestone, 2110,
tracing (2.067 ms) : 2013, 2121
.   : milestone, 2067,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.527 ms) : 2473, 2582
.   : milestone, 2527,
iast (2.276 ms) : 2207, 2345
.   : milestone, 2276,
iast_GLOBAL (2.313 ms) : 2243, 2383
.   : milestone, 2313,
profiling (2.532 ms) : 2367, 2698
.   : milestone, 2532,
tracing (2.084 ms) : 2030, 2137
.   : milestone, 2084,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 2.587 ms [2.528 ms, 2.645 ms] 1.11 ms (75.1%)
iast 2.268 ms [2.199 ms, 2.337 ms] 790.904 µs (53.6%)
iast_GLOBAL 2.316 ms [2.246 ms, 2.386 ms] 839.405 µs (56.8%)
profiling 2.11 ms [2.053 ms, 2.166 ms] 632.854 µs (42.9%)
tracing 2.067 ms [2.013 ms, 2.121 ms] 590.142 µs (40.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.527 ms [2.473 ms, 2.582 ms] 1.049 ms (71.0%)
iast 2.276 ms [2.207 ms, 2.345 ms] 797.888 µs (54.0%)
iast_GLOBAL 2.313 ms [2.243 ms, 2.383 ms] 834.496 µs (56.4%)
profiling 2.532 ms [2.367 ms, 2.698 ms] 1.054 ms (71.3%)
tracing 2.084 ms [2.03 ms, 2.137 ms] 605.328 µs (40.9%)

// ship a broken jetty.version=9.4.59 property, referencing a Jetty BOM that does not exist.
// Substitute with the closest real release.
// Remove once Confluent publishes a fixed common-parent POM.
substituteVersion "org.eclipse.jetty:jetty-bom:9.4.59", "org.eclipse.jetty:jetty-bom:9.4.58.v20250814"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMHO this complexify a bit the muzzle usage. Can we just skip that version?

Copy link
Contributor

@bric3 bric3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Muzzle checks look into dependencies for class elements criteria. It doesn't need to have a valid classpath for compilation or runtime execution.

For this problem on kafka-schema-registry-client and jetty, I believe this should be fixed by excluding the dependency (it a method call excludeDependency("...")).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing inst: kafka Kafka instrumentation tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

X Tutup