Skip to content

Add a smoke test for quarantine feature #8367

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Feb 11, 2025
Merged

Add a smoke test for quarantine feature #8367

merged 2 commits into from
Feb 11, 2025

Conversation

nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Feb 11, 2025 •
edited by atlassian bot
Loading

What Does This Do

Adds a smoke test for the quarantine feature.

Contributor Checklist

Jira ticket: SDTEST-1530

@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Feb 11, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review February 11, 2025 12:30
@pr-commenter
Copy link

pr-commenter bot commented Feb 11, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/quarantine-smoke-test
git_commit_date 1739276388 1739277219
git_commit_sha 652b465 0f31759
release_version 1.47.0-SNAPSHOT~652b46574b 1.47.0-SNAPSHOT~0f31759bf5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739280605 1739280605
ci_job_id 802732271 802732271
ci_pipeline_id 55520335 55520335
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-t7btoxr-project-304-concurrent-4-05e4t5nz 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-t7btoxr-project-304-concurrent-4-05e4t5nz 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046858
Total [baseline] (8.662 s) : 0, 8661945
Agent [candidate] (1.043 s) : 0, 1042694
Total [candidate] (8.651 s) : 0, 8651074
section iast
Agent [baseline] (1.187 s) : 0, 1186965
Total [baseline] (9.246 s) : 0, 9246374
Agent [candidate] (1.181 s) : 0, 1181186
Total [candidate] (9.243 s) : 0, 9242826
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.187 s) : 0, 1187231
Total [baseline] (9.232 s) : 0, 9232270
Agent [candidate] (1.173 s) : 0, 1172729
Total [candidate] (9.202 s) : 0, 9201608
section iast_TELEMETRY_OFF
Agent [baseline] (1.17 s) : 0, 1169731
Total [baseline] (9.23 s) : 0, 9230065
Agent [candidate] (1.172 s) : 0, 1171505
Total [candidate] (9.229 s) : 0, 9228616
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent iast 1.187 s 140.107 ms (13.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.187 s 140.373 ms (13.4%)
Agent iast_TELEMETRY_OFF 1.17 s 122.873 ms (11.7%)
Total tracing 8.662 s -
Total iast 9.246 s 584.43 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.232 s 570.326 ms (6.6%)
Total iast_TELEMETRY_OFF 9.23 s 568.12 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.181 s 138.491 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 130.035 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.172 s 128.81 ms (12.4%)
Total tracing 8.651 s -
Total iast 9.243 s 591.752 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.202 s 550.534 ms (6.4%)
Total iast_TELEMETRY_OFF 9.229 s 577.541 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.842 ms) : 0, 718842
BytebuddyAgent [candidate] (716.744 ms) : 0, 716744
GlobalTracer [baseline] (243.389 ms) : 0, 243390
GlobalTracer [candidate] (243.704 ms) : 0, 243704
AppSec [baseline] (55.232 ms) : 0, 55232
AppSec [candidate] (54.977 ms) : 0, 54977
Remote Config [baseline] (707.818 µs) : 0, 708
Remote Config [candidate] (703.742 µs) : 0, 704
Telemetry [baseline] (13.45 ms) : 0, 13450
Telemetry [candidate] (11.462 ms) : 0, 11462
section iast
BytebuddyAgent [baseline] (846.378 ms) : 0, 846378
BytebuddyAgent [candidate] (841.851 ms) : 0, 841851
GlobalTracer [baseline] (235.712 ms) : 0, 235712
GlobalTracer [candidate] (234.887 ms) : 0, 234887
IAST [baseline] (23.762 ms) : 0, 23762
IAST [candidate] (23.027 ms) : 0, 23027
AppSec [baseline] (56.137 ms) : 0, 56137
AppSec [candidate] (56.907 ms) : 0, 56907
Remote Config [baseline] (622.32 µs) : 0, 622
Remote Config [candidate] (616.359 µs) : 0, 616
Telemetry [baseline] (8.734 ms) : 0, 8734
Telemetry [candidate] (8.614 ms) : 0, 8614
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (845.612 ms) : 0, 845612
BytebuddyAgent [candidate] (834.427 ms) : 0, 834427
GlobalTracer [baseline] (235.74 ms) : 0, 235740
GlobalTracer [candidate] (233.85 ms) : 0, 233850
IAST [baseline] (24.828 ms) : 0, 24828
IAST [candidate] (22.816 ms) : 0, 22816
AppSec [baseline] (56.124 ms) : 0, 56124
AppSec [candidate] (57.084 ms) : 0, 57084
Remote Config [baseline] (626.328 µs) : 0, 626
Remote Config [candidate] (618.381 µs) : 0, 618
Telemetry [baseline] (8.897 ms) : 0, 8897
Telemetry [candidate] (8.707 ms) : 0, 8707
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (832.755 ms) : 0, 832755
BytebuddyAgent [candidate] (833.796 ms) : 0, 833796
GlobalTracer [baseline] (233.727 ms) : 0, 233727
GlobalTracer [candidate] (233.995 ms) : 0, 233995
IAST [baseline] (26.082 ms) : 0, 26082
IAST [candidate] (25.582 ms) : 0, 25582
AppSec [baseline] (52.864 ms) : 0, 52864
AppSec [candidate] (53.686 ms) : 0, 53686
Remote Config [baseline] (610.441 µs) : 0, 610
Remote Config [candidate] (608.261 µs) : 0, 608
Telemetry [baseline] (8.542 ms) : 0, 8542
Telemetry [candidate] (8.582 ms) : 0, 8582
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1041313
Total [baseline] (10.491 s) : 0, 10490586
Agent [candidate] (1.042 s) : 0, 1041859
Total [candidate] (10.491 s) : 0, 10491063
section appsec
Agent [baseline] (1.188 s) : 0, 1188149
Total [baseline] (10.792 s) : 0, 10792091
Agent [candidate] (1.188 s) : 0, 1188467
Total [candidate] (10.721 s) : 0, 10721294
section iast
Agent [baseline] (1.173 s) : 0, 1173100
Total [baseline] (10.995 s) : 0, 10995478
Agent [candidate] (1.182 s) : 0, 1182221
Total [candidate] (11.094 s) : 0, 11093976
section profiling
Agent [baseline] (1.269 s) : 0, 1268873
Total [baseline] (10.886 s) : 0, 10886354
Agent [candidate] (1.263 s) : 0, 1263486
Total [candidate] (10.86 s) : 0, 10860223
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.188 s 146.836 ms (14.1%)
Agent iast 1.173 s 131.786 ms (12.7%)
Agent profiling 1.269 s 227.559 ms (21.9%)
Total tracing 10.491 s -
Total appsec 10.792 s 301.505 ms (2.9%)
Total iast 10.995 s 504.892 ms (4.8%)
Total profiling 10.886 s 395.768 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent appsec 1.188 s 146.608 ms (14.1%)
Agent iast 1.182 s 140.362 ms (13.5%)
Agent profiling 1.263 s 221.627 ms (21.3%)
Total tracing 10.491 s -
Total appsec 10.721 s 230.232 ms (2.2%)
Total iast 11.094 s 602.913 ms (5.7%)
Total profiling 10.86 s 369.161 ms (3.5%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.025 ms) : 0, 715025
BytebuddyAgent [candidate] (715.737 ms) : 0, 715737
GlobalTracer [baseline] (242.977 ms) : 0, 242977
GlobalTracer [candidate] (243.207 ms) : 0, 243207
AppSec [baseline] (55.347 ms) : 0, 55347
AppSec [candidate] (54.956 ms) : 0, 54956
Remote Config [baseline] (710.839 µs) : 0, 711
Remote Config [candidate] (706.457 µs) : 0, 706
Telemetry [baseline] (12.102 ms) : 0, 12102
Telemetry [candidate] (12.057 ms) : 0, 12057
section appsec
BytebuddyAgent [baseline] (735.694 ms) : 0, 735694
BytebuddyAgent [candidate] (735.426 ms) : 0, 735426
GlobalTracer [baseline] (241.123 ms) : 0, 241123
GlobalTracer [candidate] (241.361 ms) : 0, 241361
AppSec [baseline] (176.02 ms) : 0, 176020
AppSec [candidate] (176.758 ms) : 0, 176758
Remote Config [baseline] (659.917 µs) : 0, 660
Remote Config [candidate] (660.091 µs) : 0, 660
Telemetry [baseline] (8.608 ms) : 0, 8608
Telemetry [candidate] (8.237 ms) : 0, 8237
IAST [baseline] (21.706 ms) : 0, 21706
IAST [candidate] (21.719 ms) : 0, 21719
section iast
BytebuddyAgent [baseline] (834.642 ms) : 0, 834642
BytebuddyAgent [candidate] (841.329 ms) : 0, 841329
GlobalTracer [baseline] (233.76 ms) : 0, 233760
GlobalTracer [candidate] (235.704 ms) : 0, 235704
AppSec [baseline] (57.262 ms) : 0, 57262
AppSec [candidate] (57.089 ms) : 0, 57089
Remote Config [baseline] (618.141 µs) : 0, 618
Remote Config [candidate] (630.269 µs) : 0, 630
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.786 ms) : 0, 8786
IAST [baseline] (22.833 ms) : 0, 22833
IAST [candidate] (23.25 ms) : 0, 23250
section profiling
ProfilingAgent [baseline] (96.235 ms) : 0, 96235
ProfilingAgent [candidate] (95.263 ms) : 0, 95263
BytebuddyAgent [baseline] (710.554 ms) : 0, 710554
BytebuddyAgent [candidate] (708.051 ms) : 0, 708051
GlobalTracer [baseline] (354.262 ms) : 0, 354262
GlobalTracer [candidate] (353.942 ms) : 0, 353942
AppSec [baseline] (55.698 ms) : 0, 55698
AppSec [candidate] (54.423 ms) : 0, 54423
Remote Config [baseline] (698.951 µs) : 0, 699
Remote Config [candidate] (718.096 µs) : 0, 718
Telemetry [baseline] (8.945 ms) : 0, 8945
Telemetry [candidate] (8.898 ms) : 0, 8898
Profiling [baseline] (96.26 ms) : 0, 96260
Profiling [candidate] (95.288 ms) : 0, 95288
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-11T12:47:15 2025-02-11T12:54:22
git_branch master nikita-tkachenko/quarantine-smoke-test
git_commit_date 1739276388 1739277219
git_commit_sha 652b465 0f31759
release_version 1.47.0-SNAPSHOT~652b46574b 1.47.0-SNAPSHOT~0f31759bf5
start_time 2025-02-11T12:47:01 2025-02-11T12:54:08
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739278823 1739278823
ci_job_id 802732272 802732272
ci_pipeline_id 55520335 55520335
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ybtya7df-project-304-concurrent-4-hg2vgbmw 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ybtya7df-project-304-concurrent-4-hg2vgbmw 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b
    dateFormat X
    axisFormat %s
section baseline
no_agent (392.529 µs) : 372, 413
.   : milestone, 393,
iast (521.794 µs) : 500, 544
.   : milestone, 522,
iast_FULL (751.474 µs) : 730, 773
.   : milestone, 751,
iast_GLOBAL (566.204 µs) : 543, 589
.   : milestone, 566,
iast_HARDCODED_SECRET_DISABLED (518.334 µs) : 497, 540
.   : milestone, 518,
iast_INACTIVE (471.079 µs) : 449, 493
.   : milestone, 471,
iast_TELEMETRY_OFF (506.413 µs) : 484, 529
.   : milestone, 506,
tracing (460.488 µs) : 439, 482
.   : milestone, 460,
section candidate
no_agent (387.416 µs) : 368, 407
.   : milestone, 387,
iast (516.119 µs) : 494, 538
.   : milestone, 516,
iast_FULL (757.141 µs) : 735, 779
.   : milestone, 757,
iast_GLOBAL (565.442 µs) : 543, 588
.   : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (512.009 µs) : 490, 534
.   : milestone, 512,
iast_INACTIVE (468.545 µs) : 447, 490
.   : milestone, 469,
iast_TELEMETRY_OFF (505.811 µs) : 483, 528
.   : milestone, 506,
tracing (458.861 µs) : 438, 480
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 392.529 µs [372.278 µs, 412.779 µs] -
iast 521.794 µs [499.871 µs, 543.718 µs] 129.266 µs (32.9%)
iast_FULL 751.474 µs [729.538 µs, 773.41 µs] 358.945 µs (91.4%)
iast_GLOBAL 566.204 µs [543.385 µs, 589.022 µs] 173.675 µs (44.2%)
iast_HARDCODED_SECRET_DISABLED 518.334 µs [496.714 µs, 539.954 µs] 125.805 µs (32.0%)
iast_INACTIVE 471.079 µs [449.292 µs, 492.866 µs] 78.55 µs (20.0%)
iast_TELEMETRY_OFF 506.413 µs [483.525 µs, 529.3 µs] 113.884 µs (29.0%)
tracing 460.488 µs [439.281 µs, 481.694 µs] 67.959 µs (17.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 387.416 µs [367.692 µs, 407.141 µs] -
iast 516.119 µs [494.377 µs, 537.86 µs] 128.702 µs (33.2%)
iast_FULL 757.141 µs [735.012 µs, 779.271 µs] 369.725 µs (95.4%)
iast_GLOBAL 565.442 µs [542.976 µs, 587.908 µs] 178.026 µs (46.0%)
iast_HARDCODED_SECRET_DISABLED 512.009 µs [490.33 µs, 533.688 µs] 124.592 µs (32.2%)
iast_INACTIVE 468.545 µs [447.412 µs, 489.677 µs] 81.128 µs (20.9%)
iast_TELEMETRY_OFF 505.811 µs [483.288 µs, 528.333 µs] 118.394 µs (30.6%)
tracing 458.861 µs [437.828 µs, 479.894 µs] 71.445 µs (18.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.374 ms) : 1355, 1394
.   : milestone, 1374,
appsec (1.745 ms) : 1722, 1769
.   : milestone, 1745,
appsec_no_iast (1.763 ms) : 1740, 1787
.   : milestone, 1763,
iast (1.514 ms) : 1489, 1538
.   : milestone, 1514,
profiling (1.529 ms) : 1506, 1552
.   : milestone, 1529,
tracing (1.505 ms) : 1480, 1530
.   : milestone, 1505,
section candidate
no_agent (1.372 ms) : 1351, 1392
.   : milestone, 1372,
appsec (1.759 ms) : 1735, 1783
.   : milestone, 1759,
appsec_no_iast (1.781 ms) : 1756, 1806
.   : milestone, 1781,
iast (1.534 ms) : 1509, 1560
.   : milestone, 1534,
profiling (1.521 ms) : 1498, 1544
.   : milestone, 1521,
tracing (1.495 ms) : 1471, 1520
.   : milestone, 1495,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.374 ms [1.355 ms, 1.394 ms] -
appsec 1.745 ms [1.722 ms, 1.769 ms] 370.8 µs (27.0%)
appsec_no_iast 1.763 ms [1.74 ms, 1.787 ms] 389.075 µs (28.3%)
iast 1.514 ms [1.489 ms, 1.538 ms] 139.437 µs (10.1%)
profiling 1.529 ms [1.506 ms, 1.552 ms] 154.546 µs (11.2%)
tracing 1.505 ms [1.48 ms, 1.53 ms] 130.426 µs (9.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.372 ms [1.351 ms, 1.392 ms] -
appsec 1.759 ms [1.735 ms, 1.783 ms] 387.05 µs (28.2%)
appsec_no_iast 1.781 ms [1.756 ms, 1.806 ms] 409.402 µs (29.8%)
iast 1.534 ms [1.509 ms, 1.56 ms] 162.59 µs (11.9%)
profiling 1.521 ms [1.498 ms, 1.544 ms] 149.149 µs (10.9%)
tracing 1.495 ms [1.471 ms, 1.52 ms] 123.629 µs (9.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/quarantine-smoke-test
git_commit_date 1739276388 1739277219
git_commit_sha 652b465 0f31759
release_version 1.47.0-SNAPSHOT~652b46574b 1.47.0-SNAPSHOT~0f31759bf5
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1739279499 1739279499
ci_job_id 802732273 802732273
ci_pipeline_id 55520335 55520335
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xw9vzabr-project-304-concurrent-4-s28vh7vc 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xw9vzabr-project-304-concurrent-4-s28vh7vc 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.284 s) : 15284000, 15284000
.   : milestone, 15284000,
appsec (15.11 s) : 15110000, 15110000
.   : milestone, 15110000,
iast (18.714 s) : 18714000, 18714000
.   : milestone, 18714000,
iast_GLOBAL (18.047 s) : 18047000, 18047000
.   : milestone, 18047000,
profiling (15.088 s) : 15088000, 15088000
.   : milestone, 15088000,
tracing (15.086 s) : 15086000, 15086000
.   : milestone, 15086000,
section candidate
no_agent (15.101 s) : 15101000, 15101000
.   : milestone, 15101000,
appsec (14.983 s) : 14983000, 14983000
.   : milestone, 14983000,
iast (18.475 s) : 18475000, 18475000
.   : milestone, 18475000,
iast_GLOBAL (18.026 s) : 18026000, 18026000
.   : milestone, 18026000,
profiling (14.937 s) : 14937000, 14937000
.   : milestone, 14937000,
tracing (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.284 s [15.284 s, 15.284 s] -
appsec 15.11 s [15.11 s, 15.11 s] -174.0 ms (-1.1%)
iast 18.714 s [18.714 s, 18.714 s] 3.43 s (22.4%)
iast_GLOBAL 18.047 s [18.047 s, 18.047 s] 2.763 s (18.1%)
profiling 15.088 s [15.088 s, 15.088 s] -196.0 ms (-1.3%)
tracing 15.086 s [15.086 s, 15.086 s] -198.0 ms (-1.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.101 s [15.101 s, 15.101 s] -
appsec 14.983 s [14.983 s, 14.983 s] -118.0 ms (-0.8%)
iast 18.475 s [18.475 s, 18.475 s] 3.374 s (22.3%)
iast_GLOBAL 18.026 s [18.026 s, 18.026 s] 2.925 s (19.4%)
profiling 14.937 s [14.937 s, 14.937 s] -164.0 ms (-1.1%)
tracing 15.006 s [15.006 s, 15.006 s] -95.0 ms (-0.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~0f31759bf5, baseline=1.47.0-SNAPSHOT~652b46574b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (2.354 ms) : 2311, 2397
.   : milestone, 2354,
iast (2.105 ms) : 2050, 2160
.   : milestone, 2105,
iast_GLOBAL (2.155 ms) : 2100, 2211
.   : milestone, 2155,
profiling (1.963 ms) : 1920, 2006
.   : milestone, 1963,
tracing (1.941 ms) : 1899, 1983
.   : milestone, 1941,
section candidate
no_agent (1.47 ms) : 1459, 1481
.   : milestone, 1470,
appsec (2.358 ms) : 2315, 2402
.   : milestone, 2358,
iast (2.105 ms) : 2050, 2160
.   : milestone, 2105,
iast_GLOBAL (2.142 ms) : 2087, 2197
.   : milestone, 2142,
profiling (1.97 ms) : 1926, 2015
.   : milestone, 1970,
tracing (1.94 ms) : 1898, 1982
.   : milestone, 1940,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 2.354 ms [2.311 ms, 2.397 ms] 886.353 µs (60.4%)
iast 2.105 ms [2.05 ms, 2.16 ms] 637.616 µs (43.5%)
iast_GLOBAL 2.155 ms [2.1 ms, 2.211 ms] 687.59 µs (46.9%)
profiling 1.963 ms [1.92 ms, 2.006 ms] 495.855 µs (33.8%)
tracing 1.941 ms [1.899 ms, 1.983 ms] 473.795 µs (32.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.481 ms] -
appsec 2.358 ms [2.315 ms, 2.402 ms] 888.409 µs (60.4%)
iast 2.105 ms [2.05 ms, 2.16 ms] 635.181 µs (43.2%)
iast_GLOBAL 2.142 ms [2.087 ms, 2.197 ms] 672.055 µs (45.7%)
profiling 1.97 ms [1.926 ms, 2.015 ms] 500.397 µs (34.0%)
tracing 1.94 ms [1.898 ms, 1.982 ms] 469.569 µs (31.9%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit f34e5f4 into master Feb 11, 2025
203 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/quarantine-smoke-test branch February 11, 2025 17:52
@github-actions github-actions bot added this to the 1.47.0 milestone Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@daniel-mohedano daniel-mohedano daniel-mohedano approved these changes

@juan-fernandez juan-fernandez Awaiting requested review from juan-fernandez juan-fernandez is a code owner automatically assigned from DataDog/ci-app-libraries-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.47.0
Development

Successfully merging this pull request may close these issues.
2 participants
@nikita-tkachenko-datadog @daniel-mohedano