Skip to content

🍒 8865 - Add support for JUnit 5.13-RC1 #8928

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

🍒 8865 - Add support for JUnit 5.13-RC1 #8928

wants to merge 1 commit into from

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

Backport #8865 to release/v1.49.x

@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner June 5, 2025 11:32
@nikita-tkachenko-datadog nikita-tkachenko-datadog added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Jun 5, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog added this to the 1.49.1 milestone Jun 5, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog enabled auto-merge (squash) June 5, 2025 11:47
@nikita-tkachenko-datadog nikita-tkachenko-datadog enabled auto-merge (squash) June 5, 2025 11:47
@pr-commenter
Copy link

pr-commenter bot commented Jun 5, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita.tkachenko/backport-pr-8865
git_commit_date 1749044153 1749123155
git_commit_sha 7787af7 fdacac3
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~fdacac3b73
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749126096 1749126096
ci_job_id 969609406 969609406
ci_pipeline_id 67045317 67045317
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-o6ycphvs-project-304-concurrent-0-lbhbb70m 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-o6ycphvs-project-304-concurrent-0-lbhbb70m 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 56 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:ProfilingAgent better
[-8.723ms; -4.087ms] or [-8.381%; -3.927%]		 97.675ms 104.080ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+10.442ms; +20.749ms] or [+2.861%; +5.685%]		 380.573ms 364.978ms
scenario:startup:petclinic:profiling:AppSec better
[-9.410ms; -7.435ms] or [-15.153%; -11.973%]		 53.673ms 62.095ms
scenario:startup:petclinic:profiling:Profiling better
[-8.723ms; -4.087ms] or [-8.379%; -3.926%]		 97.699ms 104.104ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1024177
Total [baseline] (11.095 s) : 0, 11094727
Agent [candidate] (1.005 s) : 0, 1004836
Total [candidate] (11.111 s) : 0, 11111242
section appsec
Agent [baseline] (1.165 s) : 0, 1165010
Total [baseline] (11.21 s) : 0, 11209702
Agent [candidate] (1.153 s) : 0, 1153455
Total [candidate] (11.207 s) : 0, 11207003
section iast
Agent [baseline] (1.152 s) : 0, 1152214
Total [baseline] (11.451 s) : 0, 11451476
Agent [candidate] (1.148 s) : 0, 1147693
Total [candidate] (11.314 s) : 0, 11314236
section profiling
Agent [baseline] (1.283 s) : 0, 1282969
Total [baseline] (11.601 s) : 0, 11600743
Agent [candidate] (1.261 s) : 0, 1260820
Total [candidate] (11.387 s) : 0, 11386899
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.024 s -
Agent appsec 1.165 s 140.833 ms (13.8%)
Agent iast 1.152 s 128.037 ms (12.5%)
Agent profiling 1.283 s 258.793 ms (25.3%)
Total tracing 11.095 s -
Total appsec 11.21 s 114.975 ms (1.0%)
Total iast 11.451 s 356.749 ms (3.2%)
Total profiling 11.601 s 506.016 ms (4.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.005 s -
Agent appsec 1.153 s 148.619 ms (14.8%)
Agent iast 1.148 s 142.857 ms (14.2%)
Agent profiling 1.261 s 255.984 ms (25.5%)
Total tracing 11.111 s -
Total appsec 11.207 s 95.761 ms (0.9%)
Total iast 11.314 s 202.994 ms (1.8%)
Total profiling 11.387 s 275.657 ms (2.5%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.693 ms) : 0, 683693
BytebuddyAgent [candidate] (669.047 ms) : 0, 669047
GlobalTracer [baseline] (240.451 ms) : 0, 240451
GlobalTracer [candidate] (239.589 ms) : 0, 239589
AppSec [baseline] (56.585 ms) : 0, 56585
AppSec [candidate] (54.992 ms) : 0, 54992
Debugger [baseline] (6.198 ms) : 0, 6198
Debugger [candidate] (6.28 ms) : 0, 6280
Remote Config [baseline] (735.284 µs) : 0, 735
Remote Config [candidate] (706.48 µs) : 0, 706
Telemetry [baseline] (12.788 ms) : 0, 12788
Telemetry [candidate] (10.743 ms) : 0, 10743
section appsec
BytebuddyAgent [baseline] (702.433 ms) : 0, 702433
BytebuddyAgent [candidate] (691.366 ms) : 0, 691366
GlobalTracer [baseline] (237.963 ms) : 0, 237963
GlobalTracer [candidate] (236.827 ms) : 0, 236827
AppSec [baseline] (176.052 ms) : 0, 176052
AppSec [candidate] (176.819 ms) : 0, 176819
Debugger [baseline] (5.974 ms) : 0, 5974
Debugger [candidate] (5.922 ms) : 0, 5922
Remote Config [baseline] (623.326 µs) : 0, 623
Remote Config [candidate] (622.026 µs) : 0, 622
Telemetry [baseline] (7.351 ms) : 0, 7351
Telemetry [candidate] (7.355 ms) : 0, 7355
IAST [baseline] (21.964 ms) : 0, 21964
IAST [candidate] (21.847 ms) : 0, 21847
section iast
BytebuddyAgent [baseline] (802.53 ms) : 0, 802530
BytebuddyAgent [candidate] (797.668 ms) : 0, 797668
GlobalTracer [baseline] (231.557 ms) : 0, 231557
GlobalTracer [candidate] (231.813 ms) : 0, 231813
AppSec [baseline] (53.158 ms) : 0, 53158
AppSec [candidate] (56.962 ms) : 0, 56962
Debugger [baseline] (5.978 ms) : 0, 5978
Debugger [candidate] (5.976 ms) : 0, 5976
Remote Config [baseline] (609.354 µs) : 0, 609
Remote Config [candidate] (620.612 µs) : 0, 621
Telemetry [baseline] (7.899 ms) : 0, 7899
Telemetry [candidate] (7.99 ms) : 0, 7990
IAST [baseline] (26.904 ms) : 0, 26904
IAST [candidate] (22.928 ms) : 0, 22928
section profiling
BytebuddyAgent [baseline] (685.285 ms) : 0, 685285
BytebuddyAgent [candidate] (663.524 ms) : 0, 663524
GlobalTracer [baseline] (364.978 ms) : 0, 364978
GlobalTracer [candidate] (380.573 ms) : 0, 380573
AppSec [baseline] (62.095 ms) : 0, 62095
AppSec [candidate] (53.673 ms) : 0, 53673
Debugger [baseline] (6.136 ms) : 0, 6136
Debugger [candidate] (6.167 ms) : 0, 6167
Remote Config [baseline] (661.094 µs) : 0, 661
Remote Config [candidate] (660.164 µs) : 0, 660
Telemetry [baseline] (8.171 ms) : 0, 8171
Telemetry [candidate] (8.232 ms) : 0, 8232
ProfilingAgent [baseline] (104.08 ms) : 0, 104080
ProfilingAgent [candidate] (97.675 ms) : 0, 97675
Profiling [baseline] (104.104 ms) : 0, 104104
Profiling [candidate] (97.699 ms) : 0, 97699
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1021496
Total [baseline] (8.52 s) : 0, 8520290
Agent [candidate] (1.014 s) : 0, 1014353
Total [candidate] (8.533 s) : 0, 8532672
section iast
Agent [baseline] (1.148 s) : 0, 1148112
Total [baseline] (9.156 s) : 0, 9156396
Agent [candidate] (1.145 s) : 0, 1144927
Total [candidate] (9.237 s) : 0, 9236988
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.157 s) : 0, 1157246
Total [baseline] (9.192 s) : 0, 9191788
Agent [candidate] (1.134 s) : 0, 1133584
Total [candidate] (9.126 s) : 0, 9126356
section iast_TELEMETRY_OFF
Agent [baseline] (1.148 s) : 0, 1147527
Total [baseline] (9.249 s) : 0, 9248931
Agent [candidate] (1.15 s) : 0, 1149898
Total [candidate] (9.195 s) : 0, 9195418
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent iast 1.148 s 126.615 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.157 s 135.749 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.148 s 126.031 ms (12.3%)
Total tracing 8.52 s -
Total iast 9.156 s 636.106 ms (7.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.192 s 671.498 ms (7.9%)
Total iast_TELEMETRY_OFF 9.249 s 728.641 ms (8.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.014 s -
Agent iast 1.145 s 130.574 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.134 s 119.231 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.15 s 135.545 ms (13.4%)
Total tracing 8.533 s -
Total iast 9.237 s 704.316 ms (8.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.126 s 593.684 ms (7.0%)
Total iast_TELEMETRY_OFF 9.195 s 662.746 ms (7.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.902 ms) : 0, 681902
BytebuddyAgent [candidate] (675.525 ms) : 0, 675525
GlobalTracer [baseline] (240.073 ms) : 0, 240073
GlobalTracer [candidate] (240.767 ms) : 0, 240767
AppSec [baseline] (55.828 ms) : 0, 55828
AppSec [candidate] (54.981 ms) : 0, 54981
Debugger [baseline] (6.228 ms) : 0, 6228
Debugger [candidate] (6.274 ms) : 0, 6274
Remote Config [baseline] (740.938 µs) : 0, 741
Remote Config [candidate] (717.617 µs) : 0, 718
Telemetry [baseline] (13.179 ms) : 0, 13179
Telemetry [candidate] (12.423 ms) : 0, 12423
section iast
BytebuddyAgent [baseline] (800.336 ms) : 0, 800336
BytebuddyAgent [candidate] (796.188 ms) : 0, 796188
GlobalTracer [baseline] (230.373 ms) : 0, 230373
GlobalTracer [candidate] (231.326 ms) : 0, 231326
AppSec [baseline] (52.439 ms) : 0, 52439
AppSec [candidate] (56.511 ms) : 0, 56511
Debugger [baseline] (6.016 ms) : 0, 6016
Debugger [candidate] (5.943 ms) : 0, 5943
Remote Config [baseline] (585.362 µs) : 0, 585
Remote Config [candidate] (603.649 µs) : 0, 604
Telemetry [baseline] (7.896 ms) : 0, 7896
Telemetry [candidate] (7.877 ms) : 0, 7877
IAST [baseline] (26.996 ms) : 0, 26996
IAST [candidate] (22.794 ms) : 0, 22794
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (805.155 ms) : 0, 805155
BytebuddyAgent [candidate] (787.06 ms) : 0, 787060
GlobalTracer [baseline] (232.648 ms) : 0, 232648
GlobalTracer [candidate] (229.711 ms) : 0, 229711
AppSec [baseline] (54.423 ms) : 0, 54423
AppSec [candidate] (56.276 ms) : 0, 56276
Debugger [baseline] (6.117 ms) : 0, 6117
Debugger [candidate] (5.91 ms) : 0, 5910
Remote Config [baseline] (611.584 µs) : 0, 612
Remote Config [candidate] (588.66 µs) : 0, 589
Telemetry [baseline] (8.099 ms) : 0, 8099
Telemetry [candidate] (7.832 ms) : 0, 7832
IAST [baseline] (26.543 ms) : 0, 26543
IAST [candidate] (22.798 ms) : 0, 22798
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (799.114 ms) : 0, 799114
BytebuddyAgent [candidate] (799.883 ms) : 0, 799883
GlobalTracer [baseline] (230.757 ms) : 0, 230757
GlobalTracer [candidate] (231.823 ms) : 0, 231823
AppSec [baseline] (52.084 ms) : 0, 52084
AppSec [candidate] (57.304 ms) : 0, 57304
Debugger [baseline] (6.025 ms) : 0, 6025
Debugger [candidate] (6.006 ms) : 0, 6006
Remote Config [baseline] (601.952 µs) : 0, 602
Remote Config [candidate] (604.936 µs) : 0, 605
Telemetry [baseline] (7.876 ms) : 0, 7876
Telemetry [candidate] (7.828 ms) : 0, 7828
IAST [baseline] (27.521 ms) : 0, 27521
IAST [candidate] (22.656 ms) : 0, 22656
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-05T11:51:47 2025-06-05T11:59:22
git_branch master nikita.tkachenko/backport-pr-8865
git_commit_date 1749044153 1749123155
git_commit_sha 7787af7 fdacac3
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~fdacac3b73
start_time 2025-06-05T11:51:27 2025-06-05T11:59:02
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749125455 1749125455
ci_job_id 969609407 969609407
ci_pipeline_id 67045317 67045317
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-i3wcqa5q-project-304-concurrent-0-9mpetp5c 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-i3wcqa5q-project-304-concurrent-0-9mpetp5c 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant iast_FULL iast_FULL

Summary

Found 6 performance improvements and 2 performance regressions! Performance is the same for 3 metrics, 11 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec better
[-51.566ms; -50.355ms] or [-87.005%; -84.961%]		 unstable
[+502.967op/s; +524.339op/s] or [+603.355%; +628.993%]		 8.308ms 597.015op/s 59.268ms 83.362op/s
scenario:load:petclinic:appsec_no_iast better
[-57.194ms; -55.807ms] or [-84.334%; -82.288%]		 unstable
[+342.780op/s; +385.439op/s] or [+471.535%; +530.218%]		 11.318ms 436.804op/s 67.819ms 72.694op/s
scenario:load:petclinic:code_origins better
[-38.739ms; -36.141ms] or [-47.118%; -43.958%]		 unstable
[+23.289op/s; +61.854op/s] or [+41.694%; +110.735%]		 44.778ms 98.429op/s 82.218ms 55.857op/s
scenario:load:petclinic:iast better
[-39.588ms; -37.784ms] or [-52.316%; -49.931%]		 unstable
[+47.430op/s; +77.690op/s] or [+73.833%; +120.937%]		 36.985ms 126.800op/s 75.671ms 64.240op/s
scenario:load:petclinic:no_agent worse
[+804.963µs; +854.116µs] or [+10.296%; +10.925%]		 worse
[-77.461op/s; -49.523op/s] or [-12.200%; -7.800%]		 8.647ms 571.429op/s 7.818ms 634.921op/s
scenario:load:petclinic:profiling better
[-50.044ms; -48.943ms] or [-101.067%; -98.844%]		 unstable
[+14487.851op/s; +25314.522op/s] or [+14661.804%; +25618.470%]		 0.022ms 20000.000op/s 49.516ms 98.814op/s
scenario:load:petclinic:tracing better
[-3.829ms; -3.652ms] or [-30.982%; -29.548%]		 unstable
[+137.655op/s; +202.857op/s] or [+34.313%; +50.566%]		 8.619ms 571.429op/s 12.360ms 401.173op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (7.818 ms) : 7795, 7841
.   : milestone, 7818,
appsec (59.268 ms) : 58473, 60064
.   : milestone, 59268,
appsec_no_iast (67.819 ms) : 66909, 68728
.   : milestone, 67819,
code_origins (82.218 ms) : 80563, 83873
.   : milestone, 82218,
iast (75.671 ms) : 74546, 76796
.   : milestone, 75671,
profiling (49.516 ms) : 48793, 50239
.   : milestone, 49516,
tracing (12.36 ms) : 12246, 12473
.   : milestone, 12360,
section candidate
no_agent (8.647 ms) : 8625, 8670
.   : milestone, 8647,
appsec (8.308 ms) : 8282, 8333
.   : milestone, 8308,
appsec_no_iast (11.318 ms) : 11255, 11381
.   : milestone, 11318,
code_origins (44.778 ms) : 44358, 45197
.   : milestone, 44778,
iast (36.985 ms) : 36611, 37360
.   : milestone, 36985,
profiling (22.074 µs) : 16, 28
.   : milestone, 22,
tracing (8.619 ms) : 8591, 8647
.   : milestone, 8619,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 7.818 ms [7.795 ms, 7.841 ms] -
appsec 59.268 ms [58.473 ms, 60.064 ms] 51.45 ms (658.1%)
appsec_no_iast 67.819 ms [66.909 ms, 68.728 ms] 60.001 ms (767.5%)
code_origins 82.218 ms [80.563 ms, 83.873 ms] 74.4 ms (951.7%)
iast 75.671 ms [74.546 ms, 76.796 ms] 67.853 ms (867.9%)
profiling 49.516 ms [48.793 ms, 50.239 ms] 41.698 ms (533.4%)
tracing 12.36 ms [12.246 ms, 12.473 ms] 4.542 ms (58.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 8.647 ms [8.625 ms, 8.67 ms] -
appsec 8.308 ms [8.282 ms, 8.333 ms] -339.857 µs (-3.9%)
appsec_no_iast 11.318 ms [11.255 ms, 11.381 ms] 2.671 ms (30.9%)
code_origins 44.778 ms [44.358 ms, 45.197 ms] 36.13 ms (417.8%)
iast 36.985 ms [36.611 ms, 37.36 ms] 28.338 ms (327.7%)
profiling 22.074 µs [15.922 µs, 28.225 µs] -8.625 ms (-99.7%)
tracing 8.619 ms [8.591 ms, 8.647 ms] -28.494 µs (-0.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita.tkachenko/backport-pr-8865
git_commit_date 1749044153 1749123155
git_commit_sha 7787af7 fdacac3
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~fdacac3b73
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749125600 1749125600
ci_job_id 969609408 969609408
ci_pipeline_id 67045317 67045317
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-o6ycphvs-project-304-concurrent-1-63ky8vi8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-o6ycphvs-project-304-concurrent-1-63ky8vi8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.34 s) : 15340000, 15340000
.   : milestone, 15340000,
appsec (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
iast (19.117 s) : 19117000, 19117000
.   : milestone, 19117000,
iast_GLOBAL (18.206 s) : 18206000, 18206000
.   : milestone, 18206000,
profiling (15.164 s) : 15164000, 15164000
.   : milestone, 15164000,
tracing (14.877 s) : 14877000, 14877000
.   : milestone, 14877000,
section candidate
no_agent (15.205 s) : 15205000, 15205000
.   : milestone, 15205000,
appsec (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
iast (18.316 s) : 18316000, 18316000
.   : milestone, 18316000,
iast_GLOBAL (17.789 s) : 17789000, 17789000
.   : milestone, 17789000,
profiling (15.244 s) : 15244000, 15244000
.   : milestone, 15244000,
tracing (14.915 s) : 14915000, 14915000
.   : milestone, 14915000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.34 s [15.34 s, 15.34 s] -
appsec 14.976 s [14.976 s, 14.976 s] -364.0 ms (-2.4%)
iast 19.117 s [19.117 s, 19.117 s] 3.777 s (24.6%)
iast_GLOBAL 18.206 s [18.206 s, 18.206 s] 2.866 s (18.7%)
profiling 15.164 s [15.164 s, 15.164 s] -176.0 ms (-1.1%)
tracing 14.877 s [14.877 s, 14.877 s] -463.0 ms (-3.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.205 s [15.205 s, 15.205 s] -
appsec 14.831 s [14.831 s, 14.831 s] -374.0 ms (-2.5%)
iast 18.316 s [18.316 s, 18.316 s] 3.111 s (20.5%)
iast_GLOBAL 17.789 s [17.789 s, 17.789 s] 2.584 s (17.0%)
profiling 15.244 s [15.244 s, 15.244 s] 39.0 ms (0.3%)
tracing 14.915 s [14.915 s, 14.915 s] -290.0 ms (-1.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1486
.   : milestone, 1474,
appsec (2.401 ms) : 2352, 2449
.   : milestone, 2401,
iast (2.185 ms) : 2124, 2246
.   : milestone, 2185,
iast_GLOBAL (2.226 ms) : 2164, 2287
.   : milestone, 2226,
profiling (2.474 ms) : 2250, 2698
.   : milestone, 2474,
tracing (2.008 ms) : 1960, 2055
.   : milestone, 2008,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.4 ms) : 2351, 2448
.   : milestone, 2400,
iast (2.17 ms) : 2109, 2231
.   : milestone, 2170,
iast_GLOBAL (2.225 ms) : 2163, 2287
.   : milestone, 2225,
profiling (2.026 ms) : 1977, 2075
.   : milestone, 2026,
tracing (2.001 ms) : 1954, 2049
.   : milestone, 2001,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.486 ms] -
appsec 2.401 ms [2.352 ms, 2.449 ms] 926.731 µs (62.9%)
iast 2.185 ms [2.124 ms, 2.246 ms] 711.05 µs (48.2%)
iast_GLOBAL 2.226 ms [2.164 ms, 2.287 ms] 751.548 µs (51.0%)
profiling 2.474 ms [2.25 ms, 2.698 ms] 1.0 ms (67.9%)
tracing 2.008 ms [1.96 ms, 2.055 ms] 533.647 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.4 ms [2.351 ms, 2.448 ms] 926.127 µs (62.8%)
iast 2.17 ms [2.109 ms, 2.231 ms] 696.543 µs (47.3%)
iast_GLOBAL 2.225 ms [2.163 ms, 2.287 ms] 751.194 µs (51.0%)
profiling 2.026 ms [1.977 ms, 2.075 ms] 552.794 µs (37.5%)
tracing 2.001 ms [1.954 ms, 2.049 ms] 527.808 µs (35.8%)

auto-merge was automatically disabled June 5, 2025 13:49

Pull request was closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@daniel-mohedano daniel-mohedano daniel-mohedano approved these changes

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements
Projects
None yet
Milestone
1.49.1
Development

Successfully merging this pull request may close these issues.
2 participants
@nikita-tkachenko-datadog @daniel-mohedano