Skip to content

Use component as framework tag in manual API #10313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
daniel-mohedano merged 1 commit into from
Jan 8, 2026
Merged

Use component as framework tag in manual API #10313

daniel-mohedano merged 1 commit into from
Jan 8, 2026
+145 −21

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Jan 8, 2026

What Does This Do

  • Updates the manual API to use the component value as framework to tag suite and test events.
  • For metrics, the framework will still be considered OTHER.

Motivation

This change comes from a customer request where they noticed the framework value provided when creating a manual API test session wasn't correctly propagated.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Jan 8, 2026
@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 37.16
agentless 37.36
agentlessCodeCoverage 46.23
agentlessLineCoverage 76.61

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 57.57
agentEvpProxy 57.78

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 13.18
agentless 11.19
agentlessCodeCoverage 17.84

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 22.03
agentless 19.29
agentlessCodeCoverage 20.25
agentlessLineCoverage 30.66

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - netflix-zuul

Job Status: success

Scenario Overhead (%)
agent 92.79
agentless 86.18
agentlessCodeCoverage 101.41
agentlessLineCoverage 114.76

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 13.99
agentless 11.41
agentlessCodeCoverage 14.90
agentlessLineCoverage 17.84

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 91.51
agentless 85.65
agentlessCodeCoverage 95.16
agentlessLineCoverage 96.78

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 18.48
agentless 17.87
agentlessCodeCoverage 21.50
agentlessLineCoverage 35.94

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 12.08
agentless 7.26
agentlessCodeCoverage 10.14
agentlessLineCoverage 29.90

@pr-commenter
Copy link

pr-commenter bot commented Jan 8, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/manual-instrumentation-framework
git_commit_date 1767720455 1767863066
git_commit_sha 92c84e2 478272c
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~478272cb03
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767864924 1767864924
ci_job_id 1335259937 1335259937
ci_pipeline_id 89624640 89624640
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-il90te4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-il90te4z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 9 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:tracing:Remote Config better
[-55.316µs; -13.869µs] or [-8.611%; -2.159%]		 607.830µs 642.423µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085144
Total [baseline] (10.824 s) : 0, 10823651
Agent [candidate] (1.085 s) : 0, 1084554
Total [candidate] (10.856 s) : 0, 10856307
section appsec
Agent [baseline] (1.266 s) : 0, 1265914
Total [baseline] (10.943 s) : 0, 10942704
Agent [candidate] (1.271 s) : 0, 1271267
Total [candidate] (10.982 s) : 0, 10982024
section iast
Agent [baseline] (1.234 s) : 0, 1233593
Total [baseline] (11.236 s) : 0, 11235525
Agent [candidate] (1.235 s) : 0, 1235354
Total [candidate] (11.227 s) : 0, 11227032
section profiling
Agent [baseline] (1.226 s) : 0, 1226390
Total [baseline] (10.924 s) : 0, 10923571
Agent [candidate] (1.226 s) : 0, 1225649
Total [candidate] (10.97 s) : 0, 10970264
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.266 s 180.77 ms (16.7%)
Agent iast 1.234 s 148.449 ms (13.7%)
Agent profiling 1.226 s 141.245 ms (13.0%)
Total tracing 10.824 s -
Total appsec 10.943 s 119.053 ms (1.1%)
Total iast 11.236 s 411.874 ms (3.8%)
Total profiling 10.924 s 99.92 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.271 s 186.712 ms (17.2%)
Agent iast 1.235 s 150.8 ms (13.9%)
Agent profiling 1.226 s 141.095 ms (13.0%)
Total tracing 10.856 s -
Total appsec 10.982 s 125.717 ms (1.2%)
Total iast 11.227 s 370.725 ms (3.4%)
Total profiling 10.97 s 113.957 ms (1.0%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (651.116 ms) : 0, 651116
BytebuddyAgent [candidate] (650.827 ms) : 0, 650827
GlobalTracer [baseline] (282.767 ms) : 0, 282767
GlobalTracer [candidate] (282.536 ms) : 0, 282536
AppSec [baseline] (32.55 ms) : 0, 32550
AppSec [candidate] (32.672 ms) : 0, 32672
Debugger [baseline] (67.67 ms) : 0, 67670
Debugger [candidate] (68.49 ms) : 0, 68490
Remote Config [baseline] (642.423 µs) : 0, 642
Remote Config [candidate] (607.83 µs) : 0, 608
Telemetry [baseline] (9.106 ms) : 0, 9106
Telemetry [candidate] (8.987 ms) : 0, 8987
Flare Poller [baseline] (4.625 ms) : 0, 4625
Flare Poller [candidate] (3.674 ms) : 0, 3674
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (691.862 ms) : 0, 691862
BytebuddyAgent [candidate] (693.785 ms) : 0, 693785
GlobalTracer [baseline] (258.548 ms) : 0, 258548
GlobalTracer [candidate] (259.741 ms) : 0, 259741
AppSec [baseline] (174.143 ms) : 0, 174143
AppSec [candidate] (173.822 ms) : 0, 173822
Debugger [baseline] (66.51 ms) : 0, 66510
Debugger [candidate] (68.403 ms) : 0, 68403
Remote Config [baseline] (757.584 µs) : 0, 758
Remote Config [candidate] (783.721 µs) : 0, 784
Telemetry [baseline] (9.317 ms) : 0, 9317
Telemetry [candidate] (9.485 ms) : 0, 9485
Flare Poller [baseline] (3.674 ms) : 0, 3674
Flare Poller [candidate] (3.83 ms) : 0, 3830
IAST [baseline] (24.518 ms) : 0, 24518
IAST [candidate] (24.849 ms) : 0, 24849
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (798.424 ms) : 0, 798424
BytebuddyAgent [candidate] (798.426 ms) : 0, 798426
GlobalTracer [baseline] (257.57 ms) : 0, 257570
GlobalTracer [candidate] (258.288 ms) : 0, 258288
AppSec [baseline] (32.73 ms) : 0, 32730
AppSec [candidate] (33.724 ms) : 0, 33724
Debugger [baseline] (68.062 ms) : 0, 68062
Debugger [candidate] (67.592 ms) : 0, 67592
Remote Config [baseline] (590.973 µs) : 0, 591
Remote Config [candidate] (718.032 µs) : 0, 718
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.657 ms) : 0, 8657
Flare Poller [baseline] (3.665 ms) : 0, 3665
Flare Poller [candidate] (3.647 ms) : 0, 3647
IAST [baseline] (27.154 ms) : 0, 27154
IAST [candidate] (27.364 ms) : 0, 27364
section profiling
crashtracking [baseline] (1.243 ms) : 0, 1243
crashtracking [candidate] (1.243 ms) : 0, 1243
BytebuddyAgent [baseline] (717.694 ms) : 0, 717694
BytebuddyAgent [candidate] (717.247 ms) : 0, 717247
GlobalTracer [baseline] (223.329 ms) : 0, 223329
GlobalTracer [candidate] (223.61 ms) : 0, 223610
AppSec [baseline] (32.755 ms) : 0, 32755
AppSec [candidate] (32.923 ms) : 0, 32923
Debugger [baseline] (70.028 ms) : 0, 70028
Debugger [candidate] (68.795 ms) : 0, 68795
Remote Config [baseline] (637.284 µs) : 0, 637
Remote Config [candidate] (641.874 µs) : 0, 642
Telemetry [baseline] (8.96 ms) : 0, 8960
Telemetry [candidate] (8.731 ms) : 0, 8731
Flare Poller [baseline] (3.779 ms) : 0, 3779
Flare Poller [candidate] (3.672 ms) : 0, 3672
ProfilingAgent [baseline] (96.929 ms) : 0, 96929
ProfilingAgent [candidate] (97.725 ms) : 0, 97725
Profiling [baseline] (97.519 ms) : 0, 97519
Profiling [candidate] (98.304 ms) : 0, 98304
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1083120
Total [baseline] (8.785 s) : 0, 8785258
Agent [candidate] (1.087 s) : 0, 1086996
Total [candidate] (8.742 s) : 0, 8741749
section iast
Agent [baseline] (1.224 s) : 0, 1223907
Total [baseline] (9.326 s) : 0, 9326123
Agent [candidate] (1.221 s) : 0, 1220936
Total [candidate] (9.365 s) : 0, 9365464
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent iast 1.224 s 140.787 ms (13.0%)
Total tracing 8.785 s -
Total iast 9.326 s 540.865 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent iast 1.221 s 133.94 ms (12.3%)
Total tracing 8.742 s -
Total iast 9.365 s 623.715 ms (7.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (651.172 ms) : 0, 651172
BytebuddyAgent [candidate] (652.846 ms) : 0, 652846
GlobalTracer [baseline] (281.992 ms) : 0, 281992
GlobalTracer [candidate] (283.44 ms) : 0, 283440
AppSec [baseline] (32.553 ms) : 0, 32553
AppSec [candidate] (32.638 ms) : 0, 32638
Debugger [baseline] (67.516 ms) : 0, 67516
Debugger [candidate] (67.832 ms) : 0, 67832
Remote Config [baseline] (633.804 µs) : 0, 634
Remote Config [candidate] (644.889 µs) : 0, 645
Telemetry [baseline] (8.927 ms) : 0, 8927
Telemetry [candidate] (9.02 ms) : 0, 9020
Flare Poller [baseline] (3.701 ms) : 0, 3701
Flare Poller [candidate] (3.816 ms) : 0, 3816
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (792.068 ms) : 0, 792068
BytebuddyAgent [candidate] (789.116 ms) : 0, 789116
GlobalTracer [baseline] (256.217 ms) : 0, 256217
GlobalTracer [candidate] (255.223 ms) : 0, 255223
AppSec [baseline] (33.636 ms) : 0, 33636
AppSec [candidate] (34.163 ms) : 0, 34163
Debugger [baseline] (65.537 ms) : 0, 65537
Debugger [candidate] (65.777 ms) : 0, 65777
Remote Config [baseline] (591.923 µs) : 0, 592
Remote Config [candidate] (577.686 µs) : 0, 578
Telemetry [baseline] (8.48 ms) : 0, 8480
Telemetry [candidate] (8.75 ms) : 0, 8750
Flare Poller [baseline] (3.571 ms) : 0, 3571
Flare Poller [candidate] (3.665 ms) : 0, 3665
IAST [baseline] (26.942 ms) : 0, 26942
IAST [candidate] (27.02 ms) : 0, 27020
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/manual-instrumentation-framework
git_commit_date 1767720455 1767863066
git_commit_sha 92c84e2 478272c
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~478272cb03
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767865415 1767865415
ci_job_id 1335259938 1335259938
ci_pipeline_id 89624640 89624640
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-9xgt14if 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-9xgt14if 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 15 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-175.116µs; -61.947µs] or [-10.179%; -3.601%]		 unstable
[-1099.348µs; -310.826µs] or [-21.525%; -6.086%]		 unstable
[-17.750op/s; +501.688op/s] or [-0.852%; +24.075%]		 1.602ms 4.402ms 2325.844op/s 1.720ms 5.107ms 2083.875op/s
scenario:load:petclinic:iast:high_load unsure
[-1019.790µs; -268.265µs] or [-5.602%; -1.474%]		 better
[-2.200ms; -0.888ms] or [-7.293%; -2.943%]		 unstable
[-15.715op/s; +34.277op/s] or [-6.264%; +13.663%]		 17.560ms 28.628ms 260.156op/s 18.204ms 30.172ms 250.875op/s
scenario:load:petclinic:tracing:high_load worse
[+556.797µs; +1367.319µs] or [+3.239%; +7.953%]		 worse
[+0.573ms; +1.808ms] or [+2.018%; +6.366%]		 unstable
[-37.726op/s; +13.413op/s] or [-14.265%; +5.072%]		 18.154ms 29.585ms 252.312op/s 17.192ms 28.394ms 264.469op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.171ms; +2.516ms] or [+6.946%; +14.929%]		 worse
[+0.982ms; +3.800ms] or [+3.457%; +13.376%]		 unstable
[-52.833op/s; +1.833op/s] or [-19.593%; +0.680%]		 18.696ms 30.798ms 244.156op/s 16.853ms 28.407ms 269.656op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.299 ms) : 17127, 17472
.   : milestone, 17299,
appsec (18.63 ms) : 18442, 18819
.   : milestone, 18630,
code_origins (17.97 ms) : 17788, 18151
.   : milestone, 17970,
iast (18.602 ms) : 18412, 18791
.   : milestone, 18602,
profiling (18.625 ms) : 18440, 18809
.   : milestone, 18625,
tracing (17.643 ms) : 17471, 17815
.   : milestone, 17643,
section candidate
no_agent (19.122 ms) : 18928, 19316
.   : milestone, 19122,
appsec (18.575 ms) : 18385, 18764
.   : milestone, 18575,
code_origins (17.765 ms) : 17592, 17938
.   : milestone, 17765,
iast (17.935 ms) : 17762, 18107
.   : milestone, 17935,
profiling (18.754 ms) : 18563, 18944
.   : milestone, 18754,
tracing (18.497 ms) : 18311, 18684
.   : milestone, 18497,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.299 ms [17.127 ms, 17.472 ms] -
appsec 18.63 ms [18.442 ms, 18.819 ms] 1.331 ms (7.7%)
code_origins 17.97 ms [17.788 ms, 18.151 ms] 670.139 µs (3.9%)
iast 18.602 ms [18.412 ms, 18.791 ms] 1.302 ms (7.5%)
profiling 18.625 ms [18.44 ms, 18.809 ms] 1.325 ms (7.7%)
tracing 17.643 ms [17.471 ms, 17.815 ms] 343.474 µs (2.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.122 ms [18.928 ms, 19.316 ms] -
appsec 18.575 ms [18.385 ms, 18.764 ms] -546.825 µs (-2.9%)
code_origins 17.765 ms [17.592 ms, 17.938 ms] -1.357 ms (-7.1%)
iast 17.935 ms [17.762 ms, 18.107 ms] -1.187 ms (-6.2%)
profiling 18.754 ms [18.563 ms, 18.944 ms] -368.258 µs (-1.9%)
tracing 18.497 ms [18.311 ms, 18.684 ms] -624.511 µs (-3.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.039 ms) : 3003, 3075
.   : milestone, 3039,
iast_FULL (5.877 ms) : 5818, 5936
.   : milestone, 5877,
iast_GLOBAL (3.597 ms) : 3542, 3652
.   : milestone, 3597,
profiling (2.172 ms) : 2152, 2192
.   : milestone, 2172,
tracing (1.808 ms) : 1794, 1823
.   : milestone, 1808,
section candidate
no_agent (1.189 ms) : 1177, 1201
.   : milestone, 1189,
iast (3.107 ms) : 3068, 3145
.   : milestone, 3107,
iast_FULL (5.74 ms) : 5683, 5796
.   : milestone, 5740,
iast_GLOBAL (3.59 ms) : 3534, 3647
.   : milestone, 3590,
profiling (1.939 ms) : 1923, 1956
.   : milestone, 1939,
tracing (1.825 ms) : 1809, 1841
.   : milestone, 1825,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.203 ms] -
iast 3.039 ms [3.003 ms, 3.075 ms] 1.848 ms (155.2%)
iast_FULL 5.877 ms [5.818 ms, 5.936 ms] 4.686 ms (393.4%)
iast_GLOBAL 3.597 ms [3.542 ms, 3.652 ms] 2.406 ms (202.0%)
profiling 2.172 ms [2.152 ms, 2.192 ms] 980.893 µs (82.4%)
tracing 1.808 ms [1.794 ms, 1.823 ms] 617.314 µs (51.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.189 ms [1.177 ms, 1.201 ms] -
iast 3.107 ms [3.068 ms, 3.145 ms] 1.918 ms (161.3%)
iast_FULL 5.74 ms [5.683 ms, 5.796 ms] 4.55 ms (382.6%)
iast_GLOBAL 3.59 ms [3.534 ms, 3.647 ms] 2.401 ms (201.9%)
profiling 1.939 ms [1.923 ms, 1.956 ms] 750.009 µs (63.1%)
tracing 1.825 ms [1.809 ms, 1.841 ms] 635.67 µs (53.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/manual-instrumentation-framework
git_commit_date 1767720455 1767863066
git_commit_sha 92c84e2 478272c
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~478272cb03
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767865212 1767865212
ci_job_id 1335259940 1335259940
ci_pipeline_id 89624640 89624640
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5j10pznh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5j10pznh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.421ms; -1.076ms] or [-38.180%; -28.910%]		 2.473ms 3.721ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1497
.   : milestone, 1485,
appsec (3.721 ms) : 3501, 3942
.   : milestone, 3721,
iast (2.228 ms) : 2162, 2293
.   : milestone, 2228,
iast_GLOBAL (2.277 ms) : 2212, 2342
.   : milestone, 2277,
profiling (2.096 ms) : 2043, 2150
.   : milestone, 2096,
tracing (2.063 ms) : 2011, 2114
.   : milestone, 2063,
section candidate
no_agent (1.484 ms) : 1472, 1495
.   : milestone, 1484,
appsec (2.473 ms) : 2420, 2525
.   : milestone, 2473,
iast (2.222 ms) : 2157, 2287
.   : milestone, 2222,
iast_GLOBAL (2.283 ms) : 2218, 2349
.   : milestone, 2283,
profiling (2.068 ms) : 2015, 2120
.   : milestone, 2068,
tracing (2.064 ms) : 2013, 2116
.   : milestone, 2064,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.497 ms] -
appsec 3.721 ms [3.501 ms, 3.942 ms] 2.236 ms (150.6%)
iast 2.228 ms [2.162 ms, 2.293 ms] 742.399 µs (50.0%)
iast_GLOBAL 2.277 ms [2.212 ms, 2.342 ms] 791.853 µs (53.3%)
profiling 2.096 ms [2.043 ms, 2.15 ms] 611.358 µs (41.2%)
tracing 2.063 ms [2.011 ms, 2.114 ms] 577.732 µs (38.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.495 ms] -
appsec 2.473 ms [2.42 ms, 2.525 ms] 989.259 µs (66.7%)
iast 2.222 ms [2.157 ms, 2.287 ms] 738.025 µs (49.7%)
iast_GLOBAL 2.283 ms [2.218 ms, 2.349 ms] 799.828 µs (53.9%)
profiling 2.068 ms [2.015 ms, 2.12 ms] 583.916 µs (39.4%)
tracing 2.064 ms [2.013 ms, 2.116 ms] 580.742 µs (39.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~478272cb03, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.749 s) : 15749000, 15749000
.   : milestone, 15749000,
appsec (14.733 s) : 14733000, 14733000
.   : milestone, 14733000,
iast (18.117 s) : 18117000, 18117000
.   : milestone, 18117000,
iast_GLOBAL (18.186 s) : 18186000, 18186000
.   : milestone, 18186000,
profiling (14.614 s) : 14614000, 14614000
.   : milestone, 14614000,
tracing (14.609 s) : 14609000, 14609000
.   : milestone, 14609000,
section candidate
no_agent (15.349 s) : 15349000, 15349000
.   : milestone, 15349000,
appsec (14.361 s) : 14361000, 14361000
.   : milestone, 14361000,
iast (18.194 s) : 18194000, 18194000
.   : milestone, 18194000,
iast_GLOBAL (17.764 s) : 17764000, 17764000
.   : milestone, 17764000,
profiling (14.528 s) : 14528000, 14528000
.   : milestone, 14528000,
tracing (14.705 s) : 14705000, 14705000
.   : milestone, 14705000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.749 s [15.749 s, 15.749 s] -
appsec 14.733 s [14.733 s, 14.733 s] -1.016 s (-6.5%)
iast 18.117 s [18.117 s, 18.117 s] 2.368 s (15.0%)
iast_GLOBAL 18.186 s [18.186 s, 18.186 s] 2.437 s (15.5%)
profiling 14.614 s [14.614 s, 14.614 s] -1.135 s (-7.2%)
tracing 14.609 s [14.609 s, 14.609 s] -1.14 s (-7.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.349 s [15.349 s, 15.349 s] -
appsec 14.361 s [14.361 s, 14.361 s] -988.0 ms (-6.4%)
iast 18.194 s [18.194 s, 18.194 s] 2.845 s (18.5%)
iast_GLOBAL 17.764 s [17.764 s, 17.764 s] 2.415 s (15.7%)
profiling 14.528 s [14.528 s, 14.528 s] -821.0 ms (-5.3%)
tracing 14.705 s [14.705 s, 14.705 s] -644.0 ms (-4.2%)

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Jan 8, 2026

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 13.53
agentless 45.18
agentlessCodeCoverage 84.27
agentlessLineCoverage 134.94

@daniel-mohedano daniel-mohedano marked this pull request as ready for review January 8, 2026 10:03
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner January 8, 2026 10:03
@daniel-mohedano daniel-mohedano merged commit a227cb1 into master Jan 8, 2026
568 of 570 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/manual-instrumentation-framework branch January 8, 2026 10:11
@github-actions github-actions bot added this to the 1.59.0 milestone Jan 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.59.0

Development

Successfully merging this pull request may close these issues.

3 participants

@daniel-mohedano @nikita-tkachenko-datadog