Enable ZSTD compression for profiling #8862

MattAlp · 2025-05-21T15:25:16Z

What Does This Do

Enables the use of ZSTD for compression, sets it to the default algo for profile uploads.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: PROF-11793

github-actions · 2025-05-21T15:25:30Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-05-21T16:01:50Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mattalp/enable-zstd-profiling-compression
git_commit_date	1747911150	1747913795
git_commit_sha	`35cbdee`	`6e76ffb`
release_version	1.50.0-SNAPSHOT~35cbdee19c	1.50.0-SNAPSHOT~6e76ffb3de

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747916409	1747916409
ci_job_id	949890115	949890115
ci_pipeline_id	65844123	65844123
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-pycpjsjc-project-304-concurrent-0-nqkyce2g 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-pycpjsjc-project-304-concurrent-0-nqkyce2g 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022678
Total [baseline] (8.679 s) : 0, 8678726
Agent [candidate] (1.021 s) : 0, 1021053
Total [candidate] (8.661 s) : 0, 8660918
section iast
Agent [baseline] (1.149 s) : 0, 1148609
Total [baseline] (9.228 s) : 0, 9228275
Agent [candidate] (1.149 s) : 0, 1149455
Total [candidate] (9.222 s) : 0, 9222255
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.146 s) : 0, 1146283
Total [baseline] (9.221 s) : 0, 9220786
Agent [candidate] (1.146 s) : 0, 1145670
Total [candidate] (9.217 s) : 0, 9216630
section iast_TELEMETRY_OFF
Agent [baseline] (1.155 s) : 0, 1154652
Total [baseline] (9.251 s) : 0, 9250823
Agent [candidate] (1.144 s) : 0, 1144354
Total [candidate] (9.222 s) : 0, 9221853

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.023 s	-
Agent	iast	1.149 s	125.93 ms (12.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.146 s	123.604 ms (12.1%)
Agent	iast_TELEMETRY_OFF	1.155 s	131.973 ms (12.9%)
Total	tracing	8.679 s	-
Total	iast	9.228 s	549.549 ms (6.3%)
Total	iast_HARDCODED_SECRET_DISABLED	9.221 s	542.061 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.251 s	572.098 ms (6.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.021 s	-
Agent	iast	1.149 s	128.402 ms (12.6%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.146 s	124.617 ms (12.2%)
Agent	iast_TELEMETRY_OFF	1.144 s	123.301 ms (12.1%)
Total	tracing	8.661 s	-
Total	iast	9.222 s	561.338 ms (6.5%)
Total	iast_HARDCODED_SECRET_DISABLED	9.217 s	555.712 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.222 s	560.935 ms (6.5%)

gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.608 ms) : 0, 684608
BytebuddyAgent [candidate] (682.315 ms) : 0, 682315
GlobalTracer [baseline] (240.657 ms) : 0, 240657
GlobalTracer [candidate] (240.621 ms) : 0, 240621
AppSec [baseline] (54.831 ms) : 0, 54831
AppSec [candidate] (55.887 ms) : 0, 55887
Debugger [baseline] (8.378 ms) : 0, 8378
Debugger [candidate] (8.902 ms) : 0, 8902
Remote Config [baseline] (701.693 µs) : 0, 702
Remote Config [candidate] (689.2 µs) : 0, 689
Telemetry [baseline] (9.895 ms) : 0, 9895
Telemetry [candidate] (9.07 ms) : 0, 9070
section iast
BytebuddyAgent [baseline] (801.204 ms) : 0, 801204
BytebuddyAgent [candidate] (802.378 ms) : 0, 802378
GlobalTracer [baseline] (230.609 ms) : 0, 230609
GlobalTracer [candidate] (230.773 ms) : 0, 230773
IAST [baseline] (27.371 ms) : 0, 27371
IAST [candidate] (30.671 ms) : 0, 30671
AppSec [baseline] (51.443 ms) : 0, 51443
AppSec [candidate] (47.717 ms) : 0, 47717
Debugger [baseline] (5.943 ms) : 0, 5943
Debugger [candidate] (5.919 ms) : 0, 5919
Remote Config [baseline] (598.617 µs) : 0, 599
Remote Config [candidate] (590.747 µs) : 0, 591
Telemetry [baseline] (7.966 ms) : 0, 7966
Telemetry [candidate] (7.866 ms) : 0, 7866
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (799.581 ms) : 0, 799581
BytebuddyAgent [candidate] (798.937 ms) : 0, 798937
GlobalTracer [baseline] (229.862 ms) : 0, 229862
GlobalTracer [candidate] (230.021 ms) : 0, 230021
IAST [baseline] (27.408 ms) : 0, 27408
IAST [candidate] (28.235 ms) : 0, 28235
AppSec [baseline] (51.336 ms) : 0, 51336
AppSec [candidate] (50.562 ms) : 0, 50562
Debugger [baseline] (5.963 ms) : 0, 5963
Debugger [candidate] (5.908 ms) : 0, 5908
Remote Config [baseline] (596.11 µs) : 0, 596
Remote Config [candidate] (610.974 µs) : 0, 611
Telemetry [baseline] (8.016 ms) : 0, 8016
Telemetry [candidate] (7.843 ms) : 0, 7843
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (805.097 ms) : 0, 805097
BytebuddyAgent [candidate] (797.656 ms) : 0, 797656
GlobalTracer [baseline] (232.1 ms) : 0, 232100
GlobalTracer [candidate] (230.583 ms) : 0, 230583
IAST [baseline] (22.629 ms) : 0, 22629
IAST [candidate] (22.349 ms) : 0, 22349
AppSec [baseline] (56.71 ms) : 0, 56710
AppSec [candidate] (56.115 ms) : 0, 56115
Debugger [baseline] (5.984 ms) : 0, 5984
Debugger [candidate] (5.889 ms) : 0, 5889
Remote Config [baseline] (621.724 µs) : 0, 622
Remote Config [candidate] (604.049 µs) : 0, 604
Telemetry [baseline] (7.802 ms) : 0, 7802
Telemetry [candidate] (7.693 ms) : 0, 7693

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1026274
Total [baseline] (10.481 s) : 0, 10480885
Agent [candidate] (1.018 s) : 0, 1018143
Total [candidate] (10.513 s) : 0, 10512623
section appsec
Agent [baseline] (1.171 s) : 0, 1171233
Total [baseline] (10.72 s) : 0, 10719637
Agent [candidate] (1.168 s) : 0, 1168109
Total [candidate] (10.712 s) : 0, 10712391
section iast
Agent [baseline] (1.15 s) : 0, 1150075
Total [baseline] (10.948 s) : 0, 10948228
Agent [candidate] (1.15 s) : 0, 1150144
Total [candidate] (10.863 s) : 0, 10862838
section profiling
Agent [baseline] (1.266 s) : 0, 1266230
Total [baseline] (10.876 s) : 0, 10876313
Agent [candidate] (1.268 s) : 0, 1268483
Total [candidate] (10.818 s) : 0, 10818055

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.026 s	-
Agent	appsec	1.171 s	144.959 ms (14.1%)
Agent	iast	1.15 s	123.801 ms (12.1%)
Agent	profiling	1.266 s	239.956 ms (23.4%)
Total	tracing	10.481 s	-
Total	appsec	10.72 s	238.752 ms (2.3%)
Total	iast	10.948 s	467.343 ms (4.5%)
Total	profiling	10.876 s	395.428 ms (3.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.018 s	-
Agent	appsec	1.168 s	149.966 ms (14.7%)
Agent	iast	1.15 s	132.001 ms (13.0%)
Agent	profiling	1.268 s	250.34 ms (24.6%)
Total	tracing	10.513 s	-
Total	appsec	10.712 s	199.768 ms (1.9%)
Total	iast	10.863 s	350.215 ms (3.3%)
Total	profiling	10.818 s	305.432 ms (2.9%)

gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.82 ms) : 0, 686820
BytebuddyAgent [candidate] (682.108 ms) : 0, 682108
GlobalTracer [baseline] (241.912 ms) : 0, 241912
GlobalTracer [candidate] (240.04 ms) : 0, 240040
AppSec [baseline] (54.923 ms) : 0, 54923
AppSec [candidate] (54.99 ms) : 0, 54990
Debugger [baseline] (9.046 ms) : 0, 9046
Debugger [candidate] (7.575 ms) : 0, 7575
Remote Config [baseline] (703.561 µs) : 0, 704
Remote Config [candidate] (690.019 µs) : 0, 690
Telemetry [baseline] (9.125 ms) : 0, 9125
Telemetry [candidate] (9.146 ms) : 0, 9146
section appsec
BytebuddyAgent [baseline] (707.504 ms) : 0, 707504
BytebuddyAgent [candidate] (705.1 ms) : 0, 705100
GlobalTracer [baseline] (238.89 ms) : 0, 238890
GlobalTracer [candidate] (238.023 ms) : 0, 238023
IAST [baseline] (21.718 ms) : 0, 21718
IAST [candidate] (21.853 ms) : 0, 21853
AppSec [baseline] (176.227 ms) : 0, 176227
AppSec [candidate] (176.345 ms) : 0, 176345
Debugger [baseline] (5.921 ms) : 0, 5921
Debugger [candidate] (5.965 ms) : 0, 5965
Remote Config [baseline] (623.133 µs) : 0, 623
Remote Config [candidate] (623.168 µs) : 0, 623
Telemetry [baseline] (7.406 ms) : 0, 7406
Telemetry [candidate] (7.396 ms) : 0, 7396
section iast
BytebuddyAgent [baseline] (802.66 ms) : 0, 802660
BytebuddyAgent [candidate] (803.18 ms) : 0, 803180
GlobalTracer [baseline] (230.775 ms) : 0, 230775
GlobalTracer [candidate] (230.809 ms) : 0, 230809
IAST [baseline] (27.619 ms) : 0, 27619
IAST [candidate] (29.989 ms) : 0, 29989
AppSec [baseline] (50.999 ms) : 0, 50999
AppSec [candidate] (48.308 ms) : 0, 48308
Debugger [baseline] (5.93 ms) : 0, 5930
Debugger [candidate] (5.87 ms) : 0, 5870
Remote Config [baseline] (605.785 µs) : 0, 606
Remote Config [candidate] (591.711 µs) : 0, 592
Telemetry [baseline] (7.927 ms) : 0, 7927
Telemetry [candidate] (7.867 ms) : 0, 7867
section profiling
BytebuddyAgent [baseline] (674.577 ms) : 0, 674577
BytebuddyAgent [candidate] (674.96 ms) : 0, 674960
GlobalTracer [baseline] (359.948 ms) : 0, 359948
GlobalTracer [candidate] (361.113 ms) : 0, 361113
AppSec [baseline] (61.92 ms) : 0, 61920
AppSec [candidate] (62.319 ms) : 0, 62319
Debugger [baseline] (6.289 ms) : 0, 6289
Debugger [candidate] (6.364 ms) : 0, 6364
Remote Config [baseline] (655.516 µs) : 0, 656
Remote Config [candidate] (662.475 µs) : 0, 662
Telemetry [baseline] (8.236 ms) : 0, 8236
Telemetry [candidate] (8.199 ms) : 0, 8199
ProfilingAgent [baseline] (103.509 ms) : 0, 103509
ProfilingAgent [candidate] (104.037 ms) : 0, 104037
Profiling [baseline] (103.534 ms) : 0, 103534
Profiling [candidate] (104.06 ms) : 0, 104060

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-05-22T11:51:43	2025-05-22T11:59:27
git_branch	master	mattalp/enable-zstd-profiling-compression
git_commit_date	1747911150	1747913795
git_commit_sha	`35cbdee`	`6e76ffb`
release_version	1.50.0-SNAPSHOT~35cbdee19c	1.50.0-SNAPSHOT~6e76ffb3de
start_time	2025-05-22T11:51:29	2025-05-22T11:59:13

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747915565	1747915565
ci_job_id	949890116	949890116
ci_pipeline_id	65844123	65844123
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-pycpjsjc-project-304-concurrent-1-h0rv0rlc 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-pycpjsjc-project-304-concurrent-1-h0rv0rlc 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.351 ms) : 1332, 1371
.   : milestone, 1351,
appsec (1.741 ms) : 1717, 1764
.   : milestone, 1741,
appsec_no_iast (1.728 ms) : 1705, 1752
.   : milestone, 1728,
code_origins (1.669 ms) : 1642, 1695
.   : milestone, 1669,
iast (1.513 ms) : 1489, 1537
.   : milestone, 1513,
profiling (1.517 ms) : 1493, 1541
.   : milestone, 1517,
tracing (1.503 ms) : 1478, 1528
.   : milestone, 1503,
section candidate
no_agent (1.363 ms) : 1344, 1382
.   : milestone, 1363,
appsec (1.729 ms) : 1705, 1753
.   : milestone, 1729,
appsec_no_iast (1.723 ms) : 1700, 1747
.   : milestone, 1723,
code_origins (1.665 ms) : 1639, 1691
.   : milestone, 1665,
iast (1.504 ms) : 1479, 1529
.   : milestone, 1504,
profiling (1.543 ms) : 1519, 1568
.   : milestone, 1543,
tracing (1.496 ms) : 1472, 1521
.   : milestone, 1496,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.351 ms [1.332 ms, 1.371 ms]	-
appsec	1.741 ms [1.717 ms, 1.764 ms]	389.198 µs (28.8%)
appsec_no_iast	1.728 ms [1.705 ms, 1.752 ms]	376.843 µs (27.9%)
code_origins	1.669 ms [1.642 ms, 1.695 ms]	317.283 µs (23.5%)
iast	1.513 ms [1.489 ms, 1.537 ms]	161.209 µs (11.9%)
profiling	1.517 ms [1.493 ms, 1.541 ms]	165.349 µs (12.2%)
tracing	1.503 ms [1.478 ms, 1.528 ms]	151.712 µs (11.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.363 ms [1.344 ms, 1.382 ms]	-
appsec	1.729 ms [1.705 ms, 1.753 ms]	366.252 µs (26.9%)
appsec_no_iast	1.723 ms [1.7 ms, 1.747 ms]	360.514 µs (26.5%)
code_origins	1.665 ms [1.639 ms, 1.691 ms]	302.036 µs (22.2%)
iast	1.504 ms [1.479 ms, 1.529 ms]	140.751 µs (10.3%)
profiling	1.543 ms [1.519 ms, 1.568 ms]	180.281 µs (13.2%)
tracing	1.496 ms [1.472 ms, 1.521 ms]	133.329 µs (9.8%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (380.109 µs) : 360, 400
.   : milestone, 380,
iast (523.842 µs) : 502, 546
.   : milestone, 524,
iast_FULL (738.385 µs) : 716, 760
.   : milestone, 738,
iast_GLOBAL (562.824 µs) : 541, 584
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (525.252 µs) : 502, 548
.   : milestone, 525,
iast_INACTIVE (467.806 µs) : 445, 491
.   : milestone, 468,
iast_TELEMETRY_OFF (501.072 µs) : 478, 524
.   : milestone, 501,
tracing (459.979 µs) : 438, 482
.   : milestone, 460,
section candidate
no_agent (381.13 µs) : 361, 401
.   : milestone, 381,
iast (514.993 µs) : 493, 537
.   : milestone, 515,
iast_FULL (732.346 µs) : 710, 754
.   : milestone, 732,
iast_GLOBAL (572.261 µs) : 550, 595
.   : milestone, 572,
iast_HARDCODED_SECRET_DISABLED (523.17 µs) : 501, 546
.   : milestone, 523,
iast_INACTIVE (466.252 µs) : 444, 489
.   : milestone, 466,
iast_TELEMETRY_OFF (510.668 µs) : 488, 534
.   : milestone, 511,
tracing (455.416 µs) : 433, 477
.   : milestone, 455,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.109 µs [360.353 µs, 399.866 µs]	-
iast	523.842 µs [502.132 µs, 545.551 µs]	143.732 µs (37.8%)
iast_FULL	738.385 µs [716.465 µs, 760.305 µs]	358.276 µs (94.3%)
iast_GLOBAL	562.824 µs [541.272 µs, 584.376 µs]	182.715 µs (48.1%)
iast_HARDCODED_SECRET_DISABLED	525.252 µs [502.078 µs, 548.426 µs]	145.142 µs (38.2%)
iast_INACTIVE	467.806 µs [444.871 µs, 490.741 µs]	87.697 µs (23.1%)
iast_TELEMETRY_OFF	501.072 µs [477.974 µs, 524.171 µs]	120.963 µs (31.8%)
tracing	459.979 µs [437.871 µs, 482.087 µs]	79.87 µs (21.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	381.13 µs [361.401 µs, 400.859 µs]	-
iast	514.993 µs [493.313 µs, 536.673 µs]	133.863 µs (35.1%)
iast_FULL	732.346 µs [710.476 µs, 754.215 µs]	351.216 µs (92.2%)
iast_GLOBAL	572.261 µs [549.887 µs, 594.635 µs]	191.132 µs (50.1%)
iast_HARDCODED_SECRET_DISABLED	523.17 µs [500.71 µs, 545.63 µs]	142.04 µs (37.3%)
iast_INACTIVE	466.252 µs [443.731 µs, 488.774 µs]	85.123 µs (22.3%)
iast_TELEMETRY_OFF	510.668 µs [487.617 µs, 533.718 µs]	129.538 µs (34.0%)
tracing	455.416 µs [433.367 µs, 477.466 µs]	74.287 µs (19.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mattalp/enable-zstd-profiling-compression
git_commit_date	1747911150	1747913795
git_commit_sha	`35cbdee`	`6e76ffb`
release_version	1.50.0-SNAPSHOT~35cbdee19c	1.50.0-SNAPSHOT~6e76ffb3de

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1747916050	1747916050
ci_job_id	949890117	949890117
ci_pipeline_id	65844123	65844123
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-pycpjsjc-project-304-concurrent-2-zwmjae84 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-pycpjsjc-project-304-concurrent-2-zwmjae84 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.787 s) : 14787000, 14787000
.   : milestone, 14787000,
appsec (15.079 s) : 15079000, 15079000
.   : milestone, 15079000,
iast (19.059 s) : 19059000, 19059000
.   : milestone, 19059000,
iast_GLOBAL (18.299 s) : 18299000, 18299000
.   : milestone, 18299000,
profiling (15.277 s) : 15277000, 15277000
.   : milestone, 15277000,
tracing (15.044 s) : 15044000, 15044000
.   : milestone, 15044000,
section candidate
no_agent (15.478 s) : 15478000, 15478000
.   : milestone, 15478000,
appsec (15.178 s) : 15178000, 15178000
.   : milestone, 15178000,
iast (18.608 s) : 18608000, 18608000
.   : milestone, 18608000,
iast_GLOBAL (18.011 s) : 18011000, 18011000
.   : milestone, 18011000,
profiling (15.532 s) : 15532000, 15532000
.   : milestone, 15532000,
tracing (14.931 s) : 14931000, 14931000
.   : milestone, 14931000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.787 s [14.787 s, 14.787 s]	-
appsec	15.079 s [15.079 s, 15.079 s]	292.0 ms (2.0%)
iast	19.059 s [19.059 s, 19.059 s]	4.272 s (28.9%)
iast_GLOBAL	18.299 s [18.299 s, 18.299 s]	3.512 s (23.8%)
profiling	15.277 s [15.277 s, 15.277 s]	490.0 ms (3.3%)
tracing	15.044 s [15.044 s, 15.044 s]	257.0 ms (1.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.478 s [15.478 s, 15.478 s]	-
appsec	15.178 s [15.178 s, 15.178 s]	-300.0 ms (-1.9%)
iast	18.608 s [18.608 s, 18.608 s]	3.13 s (20.2%)
iast_GLOBAL	18.011 s [18.011 s, 18.011 s]	2.533 s (16.4%)
profiling	15.532 s [15.532 s, 15.532 s]	54.0 ms (0.3%)
tracing	14.931 s [14.931 s, 14.931 s]	-547.0 ms (-3.5%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~6e76ffb3de, baseline=1.50.0-SNAPSHOT~35cbdee19c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (2.403 ms) : 2355, 2452
.   : milestone, 2403,
iast (2.185 ms) : 2123, 2247
.   : milestone, 2185,
iast_GLOBAL (2.23 ms) : 2169, 2292
.   : milestone, 2230,
profiling (2.033 ms) : 1984, 2082
.   : milestone, 2033,
tracing (2.015 ms) : 1967, 2063
.   : milestone, 2015,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.403 ms) : 2354, 2452
.   : milestone, 2403,
iast (2.178 ms) : 2116, 2239
.   : milestone, 2178,
iast_GLOBAL (2.227 ms) : 2165, 2289
.   : milestone, 2227,
profiling (2.033 ms) : 1984, 2082
.   : milestone, 2033,
tracing (2.006 ms) : 1958, 2053
.   : milestone, 2006,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.488 ms]	-
appsec	2.403 ms [2.355 ms, 2.452 ms]	926.501 µs (62.7%)
iast	2.185 ms [2.123 ms, 2.247 ms]	708.493 µs (48.0%)
iast_GLOBAL	2.23 ms [2.169 ms, 2.292 ms]	753.67 µs (51.0%)
profiling	2.033 ms [1.984 ms, 2.082 ms]	556.249 µs (37.7%)
tracing	2.015 ms [1.967 ms, 2.063 ms]	538.53 µs (36.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	2.403 ms [2.354 ms, 2.452 ms]	931.873 µs (63.3%)
iast	2.178 ms [2.116 ms, 2.239 ms]	706.421 µs (48.0%)
iast_GLOBAL	2.227 ms [2.165 ms, 2.289 ms]	755.593 µs (51.4%)
profiling	2.033 ms [1.984 ms, 2.082 ms]	561.914 µs (38.2%)
tracing	2.006 ms [1.958 ms, 2.053 ms]	534.519 µs (36.3%)

...iling-controller/src/main/java/com/datadog/profiling/controller/ProfilerSettingsSupport.java

dd-java-agent/agent-profiling/profiling-uploader/build.gradle

dd-trace-api/src/main/java/datadog/trace/api/config/ProfilingConfig.java

…onfig.java Co-authored-by: Jaroslav Bachorik <[email protected]>

…m:DataDog/dd-trace-java into mattalp/enable-zstd-profiling-compression

dd-trace-api/src/main/java/datadog/trace/api/config/ProfilingConfig.java

...ofiling/profiling-uploader/src/main/java/com/datadog/profiling/uploader/CompressionType.java

bric3 · 2025-05-22T14:05:26Z

dd-java-agent/agent-profiling/profiling-uploader/build.gradle


  implementation libs.okhttp
  implementation libs.lz4
+  implementation group: 'io.airlift', name: 'aircompressor', version: '2.0.2'


nitpick: Ideally I'd rather add this library through the version catalog ?

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.49.0` -> `1.50.0` | --- ### Release Notes <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.50.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.50.0): 1.50.0 ### Deprecation Notice > \[!NOTE] > `DD_RUNTIME_ID_ENABLED` has been deprecated and will be removed in future releases. Please use `DD_RUNTIME_METRICS_RUNTIME_ID_ENABLED` instead. ### Components #### Application Security Management (WAF) - 🐛 Add String length truncation limit to ObjectIntrospector and update truncation metrics ([#8825](DataDog/dd-trace-java#8825) - [@jandro996](https://github.com/jandro996)) - 🐛 Adapt standalone ASM to support API Security ([#8804](DataDog/dd-trace-java#8804) - [@jandro996](https://github.com/jandro996)) - ✨ Add appsec.waf.input\_truncated metric ([#8791](DataDog/dd-trace-java#8791) - [@jandro996](https://github.com/jandro996)) - ✨ Extended appsec request body collection ([#8748](DataDog/dd-trace-java#8748) - [@jandro996](https://github.com/jandro996)) - ✨ Extended appsec request/response headers collection ([#8724](DataDog/dd-trace-java#8724) - [@jandro996](https://github.com/jandro996)) #### Build & Tooling - ✨ Add artifacts to public s3 bucket ([#8947](DataDog/dd-trace-java#8947) - [@randomanderson](https://github.com/randomanderson)) #### Continuous Integration Visibility - ✨ Improve PR information building ([#8908](DataDog/dd-trace-java#8908) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Truncate span stack traces when Test Optimization is enabled ([#8903](DataDog/dd-trace-java#8903) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Ensure auto-detected service name is the same for every process in the same build ([#8902](DataDog/dd-trace-java#8902) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - 🐛 Use tag as fallback in api requests if no branch is available ([#8876](DataDog/dd-trace-java#8876) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add support for JUnit 5.13-RC1 ([#8865](DataDog/dd-trace-java#8865), [#8871](DataDog/dd-trace-java#8871) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Implement attempt to fix v3 and v4 and bump capability version ([#8824](DataDog/dd-trace-java#8824) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - 🧹 Align retry logic for all test framework instrumentations ([#8803](DataDog/dd-trace-java#8803) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - 🐛 Always build ci workspace without trailing separator ([#8788](DataDog/dd-trace-java#8788) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add commit discrepancies telemetry when building repository git information ([#8763](DataDog/dd-trace-java#8763) - [@daniel-mohedano](https://github.com/daniel-mohedano)) #### Data Streams Monitoring - 💡 Surface process tags in dsm payloads and use them for base hash calculation ([#8836](DataDog/dd-trace-java#8836) - [@amarziali](https://github.com/amarziali)) #### Dynamic Instrumentation - ✨ Optimized allocations for collection filter functions ([#8896](DataDog/dd-trace-java#8896) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix SymDB upload size check ([#8887](DataDog/dd-trace-java#8887) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Add support for Set in filter function ([#8873](DataDog/dd-trace-java#8873) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Add support for isDefined in log template ([#8859](DataDog/dd-trace-java#8859) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Fix Max captured frames for Exception Replay ([#8856](DataDog/dd-trace-java#8856) - [@jpbempel](https://github.com/jpbempel)) - 🐛 Remove static inherited fields collection ([#8832](DataDog/dd-trace-java#8832) - [@jpbempel](https://github.com/jpbempel)) - 💡 Add process tags to dynamic instrumentation intake payload ([#8779](DataDog/dd-trace-java#8779) - [@amarziali](https://github.com/amarziali)) #### GraalVM native-image - ✨ Add support for GraalVM Native GC metrics ([#8913](DataDog/dd-trace-java#8913) - [@ygree](https://github.com/ygree)) - ✨ Add JMXFetch support for GraalVM Native ([#8569](DataDog/dd-trace-java#8569) - [@ygree](https://github.com/ygree)) #### JMX fetch - ✨ Add support for GraalVM Native GC metrics ([#8913](DataDog/dd-trace-java#8913) - [@ygree](https://github.com/ygree)) #### Library Injection - ✨ Deny oracle db jvm based tools ([#8909](DataDog/dd-trace-java#8909) - [@bric3](https://github.com/bric3)) #### OpenTracing - 🐛 Fix OT packaging for exception replay ([#8912](DataDog/dd-trace-java#8912) - [@jpbempel](https://github.com/jpbempel)) #### Profiling - ✨ Bump ddprof to 1.27.0 ([#8893](DataDog/dd-trace-java#8893) - [@jbachorik](https://github.com/jbachorik)) - Properly handle the adaptive sampling interval overflow by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#213 - Fix [#200](DataDog/dd-trace-java#200) Crash related to aligned\_alloc and free in context by [@yanglong1010](https://github.com/yanglong1010) in DataDog/java-profiler#208 - Explicitly initialize empty context page by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#210 - Re-connect crash recursion protection with VM stackwalker by [@jbachorik](https://github.com/jbachorik) in DataDog/java-profiler#214 - ✨ Enable ZSTD compression for profiling ([#8862](DataDog/dd-trace-java#8862) - [@MattAlp](https://github.com/MattAlp)) - ✨ Extend JPS re-implementation to J9 family ([#8813](DataDog/dd-trace-java#8813) - [@MattAlp](https://github.com/MattAlp)) - 💡 Collect process tags for profiling upload requests ([#8780](DataDog/dd-trace-java#8780) - [@amarziali](https://github.com/amarziali)) #### Telemetry - 💡 Surface process tags on telemetry payloads ([#8837](DataDog/dd-trace-java#8837) - [@amarziali](https://github.com/amarziali)) #### Trace context propagation - ✨ Migrating all HttpClient Instrumentations to Inject Full Context ([#8826](DataDog/dd-trace-java#8826) - [@mhlidd](https://github.com/mhlidd)) - ✨ Migrating all HttpServer Instrumentations to Extract full Context ([#8820](DataDog/dd-trace-java#8820) - [@mhlidd](https://github.com/mhlidd)) - ✨ Add context API support OTel propagators ([#8770](DataDog/dd-trace-java#8770) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Tracer core - ✨⚡ Skip JAXB generated classes classloader ([#9003](DataDog/dd-trace-java#9003) - [@bric3](https://github.com/bric3)) - ✨ Add DD\_RUNTIME\_METRICS\_RUNTIME\_ID\_ENABLED alias for runtime id generation ([#8981](DataDog/dd-trace-java#8981) - [@amarziali](https://github.com/amarziali)) - 🐛 Use resolved address for peer.hostname when available without hitting the cache ([#8915](DataDog/dd-trace-java#8915) - [@amarziali](https://github.com/amarziali)) - 💡 Surface server name process tag for tomcat ([#8894](DataDog/dd-trace-java#8894) - [@amarziali](https://github.com/amarziali)) - 💡 Surface websphere cell and server name on process tags ([#8880](DataDog/dd-trace-java#8880) - [@amarziali](https://github.com/amarziali)) - ✨ Added special lightweight pre-main class that skips installation on incompatible JVMs. ([#8855](DataDog/dd-trace-java#8855) - [@AlexeyKuznetsov-DD](https://github.com/AlexeyKuznetsov-DD)) - 💡 Add entrypoint type to process tags ([#8839](DataDog/dd-trace-java#8839) - [@amarziali](https://github.com/amarziali)) - ✨ Extend JPS re-implementation to J9 family ([#8813](DataDog/dd-trace-java#8813) - [@MattAlp](https://github.com/MattAlp)) - ✨ Notify listeners when the scope top changes after switching scope stacks ([#8797](DataDog/dd-trace-java#8797) - [@mcculls](https://github.com/mcculls)) - ✨ Read hsperfdata for Java PIDs if jvmstat is unavailable ([#8792](DataDog/dd-trace-java#8792) - [@MattAlp](https://github.com/MattAlp)) - 🐛 Turn JDK socket support on by default ([#8752](DataDog/dd-trace-java#8752) - [@sarahchen6](https://github.com/sarahchen6)) - ✨ Simplify context propagation ([#8719](DataDog/dd-trace-java#8719) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Add JSON parsing support ([#8579](DataDog/dd-trace-java#8579) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Tracer internal logging - ✨ Fix printing format of span identifiers ([#8897](DataDog/dd-trace-java#8897) - [@vandonr](https://github.com/vandonr)) #### Tracer public API - 💡 Track the source of installation ([#8956](DataDog/dd-trace-java#8956) - [@mabdinur](https://github.com/mabdinur)) - ✨ Enforce size limit on application\_monitoring.yaml files ([#8789](DataDog/dd-trace-java#8789) - [@mtoffl01](https://github.com/mtoffl01)) - ✨ Enabling baggage cache to support limits and non-ascii characters ([#8713](DataDog/dd-trace-java#8713) - [@mhlidd](https://github.com/mhlidd)) ### Instrumentations #### AWS Lambda instrumentation - ✨ Pass Lambda Request ID to Extension ([#8814](DataDog/dd-trace-java#8814) - [@nhulston](https://github.com/nhulston)) #### Core Java language instrumentation - ✨ Ensure ClassloadingInstrumentation is always applied even with `DD_TRACE_ENABLED=false` ([#8863](DataDog/dd-trace-java#8863) - [@mcculls](https://github.com/mcculls)) #### Eclipse Vert.x instrumentation - 🐛 Do not override route with / in vertx instrumentation ([#8881](DataDog/dd-trace-java#8881) - [@vandonr](https://github.com/vandonr)) #### IBM Liberty - 🐛 Fix error mark on http status for IBM liberty ([#8822](DataDog/dd-trace-java#8822) - [@amarziali](https://github.com/amarziali)) #### JDBC instrumentation - 🐛 Do not prepend DBM <> APM trace comment in SQLCommenter if there is a pg plan hint ([#8864](DataDog/dd-trace-java#8864) - [@edengorevoy](https://github.com/edengorevoy)) #### JMS instrumentation - ✨ Add jms as an extra integration name where there is JMS involved ([#8933](DataDog/dd-trace-java#8933) - [@vandonr](https://github.com/vandonr)) #### Kotlin instrumentation - ✨ Enable kotlin\_coroutine integration by default ([#8848](DataDog/dd-trace-java#8848) - [@mcculls](https://github.com/mcculls)) - 🧹 Rework Kotlin coroutines instrumentation around coroutine context ([#8774](DataDog/dd-trace-java#8774) - [@mcculls](https://github.com/mcculls)) #### OpenTelemetry instrumentation - 🐛 Support WithSpan inheritContext attribute ([#8858](DataDog/dd-trace-java#8858) - [@amarziali](https://github.com/amarziali)) - ✨ Add context API support OTel propagators ([#8770](DataDog/dd-trace-java#8770) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Play Framework instrumentation - 🐛 Fix the Play Framework's span resource name priority so that the client JAX-RS 404 cannot override it ([#8591](DataDog/dd-trace-java#8591) - [@ygree](https://github.com/ygree)) #### Quarkus Instrumentation - 🐛 Ignore quarkus jaxrs stubs and cdi wrapper proxies ([#8891](DataDog/dd-trace-java#8891) - [@amarziali](https://github.com/amarziali)) #### ServiceTalk - ✨ Improve ServiceTalk Captured Context API Instrumentation for v0.42.56+ ([#8821](DataDog/dd-trace-java#8821) - [@ygree](https://github.com/ygree)) #### Spring instrumentation - ✨ Supporting Baggage for Instrumentations used in Weblog Tests ([#8773](DataDog/dd-trace-java#8773) - [@mhlidd](https://github.com/mhlidd)) #### WebSocket Instrumentation - 💡 Trace websocket for spring webflux reactive handlers ([#8831](DataDog/dd-trace-java#8831) - [@amarziali](https://github.com/amarziali)) - 💡:test\_tube: WebSocket support for Netty ([#8632](DataDog/dd-trace-java#8632) - [@ValentinZakharov](https://github.com/ValentinZakharov)) #### Zio Instrumentation - 🧹 Cleanup Zio fiber instrumentation to avoid repeated activation of continuation ([#8798](DataDog/dd-trace-java#8798) - [@mcculls](https://github.com/mcculls)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 9207366cdb6a1bd098082305d354a0a3c4622d7a

MattAlp added 2 commits May 19, 2025 16:54

Enable use of zstd (using default level) for profile upload compression

58c778f

Deprecate previous profiling compression flag

83e210d

MattAlp requested review from a team as code owners May 21, 2025 15:25

MattAlp requested a review from smola May 21, 2025 15:25

MattAlp added comp: profiling Profiling type: enhancement Enhancements and improvements labels May 21, 2025

Bump max tracer size to 32 mb

b16250d

jbachorik reviewed May 21, 2025

View reviewed changes

MattAlp and others added 7 commits May 21, 2025 14:31

Update dd-trace-api/src/main/java/datadog/trace/api/config/ProfilingC…

89f2fb0

…onfig.java Co-authored-by: Jaroslav Bachorik <[email protected]>

Nits

6ec4951

Merge branch 'mattalp/enable-zstd-profiling-compression' of github.co…

41cd691

…m:DataDog/dd-trace-java into mattalp/enable-zstd-profiling-compression

Nits

9590171

Merge branch 'master' into mattalp/enable-zstd-profiling-compression

4aa5300

Revert defaults briefly for org2

b48351e

Merge branch 'mattalp/enable-zstd-profiling-compression' of github.co…

4f55f9a

…m:DataDog/dd-trace-java into mattalp/enable-zstd-profiling-compression

MattAlp requested a review from jbachorik May 21, 2025 20:51

Include ZSTD tests

d0e1566

jbachorik reviewed May 22, 2025

View reviewed changes

dd-trace-api/src/main/java/datadog/trace/api/config/ProfilingConfig.java Outdated Show resolved Hide resolved

jbachorik reviewed May 22, 2025

View reviewed changes

...ofiling/profiling-uploader/src/main/java/com/datadog/profiling/uploader/CompressionType.java Outdated Show resolved Hide resolved

Straggling comments and log line zstd-reversion

6e76ffb

jbachorik approved these changes May 22, 2025

View reviewed changes

MattAlp merged commit df76e30 into master May 22, 2025
788 of 790 checks passed

MattAlp deleted the mattalp/enable-zstd-profiling-compression branch May 22, 2025 13:05

github-actions bot added this to the 1.50.0 milestone May 22, 2025

bric3 reviewed May 22, 2025

View reviewed changes

MattAlp mentioned this pull request May 22, 2025

Add zstd scenario to profile uploading tests #8869

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Enable ZSTD compression for profiling #8862

Enable ZSTD compression for profiling #8862

Uh oh!

MattAlp commented May 21, 2025 •

edited by atlassian bot

Loading

Uh oh!

github-actions bot commented May 21, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented May 21, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bric3 May 22, 2025

Uh oh!

Uh oh!

Enable ZSTD compression for profiling #8862

Enable ZSTD compression for profiling #8862

Uh oh!

Conversation

MattAlp commented May 21, 2025 • edited by atlassian bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented May 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented May 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bric3 May 22, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

MattAlp commented May 21, 2025 •

edited by atlassian bot

Loading

github-actions bot commented May 21, 2025 •

edited

Loading

pr-commenter bot commented May 21, 2025 •

edited

Loading