Skip to content

Limit heap size for Gradle daemons forked by the smoke tests #10089

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
nikita-tkachenko-datadog wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Limit heap size for Gradle daemons forked by the smoke tests #10089

nikita-tkachenko-datadog wants to merge 5 commits into from
+2 −5

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Dec 5, 2025

What Does This Do

Limits heap size to 256mb for the processes forked by CI Visibility smoke tests (Gradle daemons, Maven builds, JUnit console runs).

Motivation

The projects built in the smoke tests are tiny, and 256 mb heap should be sufficient for the build systems.
We have seen some Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) errors before that, we suspect, are caused by running out of memory.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner December 5, 2025 13:16
@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility run-tests: all Run all tests labels Dec 5, 2025
@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 58.31
agentEvpProxy 57.94

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 37.47
agentless 45.40
agentlessCodeCoverage 46.13
agentlessLineCoverage 76.17

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 11.03
agentless 10.83
agentlessCodeCoverage 17.88

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - netflix-zuul

Job Status: failed

Scenario Overhead (%)
agent 93.57
agentless 100.03
agentlessCodeCoverage 103.17
agentlessLineCoverage 116.73

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 19.45
agentless 20.49
agentlessCodeCoverage 20.15
agentlessLineCoverage 31.38

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 12.57
agentless 12.85
agentlessCodeCoverage 15.29
agentlessLineCoverage 19.14

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 18.65
agentless 17.33
agentlessCodeCoverage 20.36
agentlessLineCoverage 36.42

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 11.31
agentless 5.89
agentlessCodeCoverage 9.80
agentlessLineCoverage 29.05

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - jolokia

Job Status: failed

Scenario Overhead (%)
agent 94.59
agentless 96.37
agentlessCodeCoverage 99.83
agentlessLineCoverage 103.75

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 48.72
agentless 17.95
agentlessCodeCoverage 121.21
agentlessLineCoverage 152.57

@pr-commenter
Copy link

pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-daemon-smoke-tests
git_commit_date 1765276026 1765276456
git_commit_sha 85ac4c8 ba5f1fb
release_version 1.57.0-SNAPSHOT~85ac4c84ae 1.57.0-SNAPSHOT~ba5f1fb43a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765278195 1765278195
ci_job_id 1278810928 1278810928
ci_pipeline_id 85531522 85531522
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-sln66wnl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-sln66wnl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.078 s) : 0, 1078177
Total [baseline] (8.735 s) : 0, 8735259
Agent [candidate] (1.082 s) : 0, 1081726
Total [candidate] (8.761 s) : 0, 8760719
section iast
Agent [baseline] (1.219 s) : 0, 1219467
Total [baseline] (9.431 s) : 0, 9431058
Agent [candidate] (1.227 s) : 0, 1226929
Total [candidate] (9.432 s) : 0, 9432216
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent iast 1.219 s 141.29 ms (13.1%)
Total tracing 8.735 s -
Total iast 9.431 s 695.799 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent iast 1.227 s 145.203 ms (13.4%)
Total tracing 8.761 s -
Total iast 9.432 s 671.497 ms (7.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.177 ms) : 0, 1177
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (647.369 ms) : 0, 647369
BytebuddyAgent [candidate] (649.726 ms) : 0, 649726
GlobalTracer [baseline] (280.895 ms) : 0, 280895
GlobalTracer [candidate] (282.39 ms) : 0, 282390
AppSec [baseline] (32.439 ms) : 0, 32439
AppSec [candidate] (32.478 ms) : 0, 32478
Debugger [baseline] (67.217 ms) : 0, 67217
Debugger [candidate] (66.802 ms) : 0, 66802
Remote Config [baseline] (652.854 µs) : 0, 653
Remote Config [candidate] (676.273 µs) : 0, 676
Telemetry [baseline] (9.018 ms) : 0, 9018
Telemetry [candidate] (9.085 ms) : 0, 9085
Flare Poller [baseline] (3.806 ms) : 0, 3806
Flare Poller [candidate] (3.786 ms) : 0, 3786
section iast
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (789.146 ms) : 0, 789146
BytebuddyAgent [candidate] (795.091 ms) : 0, 795091
GlobalTracer [baseline] (254.896 ms) : 0, 254896
GlobalTracer [candidate] (256.556 ms) : 0, 256556
IAST [baseline] (26.783 ms) : 0, 26783
IAST [candidate] (26.999 ms) : 0, 26999
AppSec [baseline] (34.772 ms) : 0, 34772
AppSec [candidate] (35.205 ms) : 0, 35205
Debugger [baseline] (64.938 ms) : 0, 64938
Debugger [candidate] (64.095 ms) : 0, 64095
Remote Config [baseline] (571.313 µs) : 0, 571
Remote Config [candidate] (554.934 µs) : 0, 555
Telemetry [baseline] (8.342 ms) : 0, 8342
Telemetry [candidate] (8.327 ms) : 0, 8327
Flare Poller [baseline] (3.442 ms) : 0, 3442
Flare Poller [candidate] (3.421 ms) : 0, 3421
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1082579
Total [baseline] (10.871 s) : 0, 10870605
Agent [candidate] (1.083 s) : 0, 1083377
Total [candidate] (10.818 s) : 0, 10817820
section appsec
Agent [baseline] (1.264 s) : 0, 1263854
Total [baseline] (11.134 s) : 0, 11133565
Agent [candidate] (1.275 s) : 0, 1274949
Total [candidate] (11.134 s) : 0, 11133921
section iast
Agent [baseline] (1.225 s) : 0, 1225487
Total [baseline] (11.189 s) : 0, 11189412
Agent [candidate] (1.224 s) : 0, 1224255
Total [candidate] (11.113 s) : 0, 11113263
section profiling
Agent [baseline] (1.212 s) : 0, 1212403
Total [baseline] (11.081 s) : 0, 11081004
Agent [candidate] (1.205 s) : 0, 1205426
Total [candidate] (11.058 s) : 0, 11057557
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.264 s 181.275 ms (16.7%)
Agent iast 1.225 s 142.908 ms (13.2%)
Agent profiling 1.212 s 129.824 ms (12.0%)
Total tracing 10.871 s -
Total appsec 11.134 s 262.961 ms (2.4%)
Total iast 11.189 s 318.807 ms (2.9%)
Total profiling 11.081 s 210.399 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.275 s 191.572 ms (17.7%)
Agent iast 1.224 s 140.878 ms (13.0%)
Agent profiling 1.205 s 122.049 ms (11.3%)
Total tracing 10.818 s -
Total appsec 11.134 s 316.101 ms (2.9%)
Total iast 11.113 s 295.443 ms (2.7%)
Total profiling 11.058 s 239.737 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (649.19 ms) : 0, 649190
BytebuddyAgent [candidate] (650.034 ms) : 0, 650034
GlobalTracer [baseline] (282.298 ms) : 0, 282298
GlobalTracer [candidate] (282.438 ms) : 0, 282438
AppSec [baseline] (32.384 ms) : 0, 32384
AppSec [candidate] (32.431 ms) : 0, 32431
Debugger [baseline] (68.626 ms) : 0, 68626
Debugger [candidate] (68.271 ms) : 0, 68271
Remote Config [baseline] (653.383 µs) : 0, 653
Remote Config [candidate] (655.745 µs) : 0, 656
Telemetry [baseline] (8.971 ms) : 0, 8971
Telemetry [candidate] (9.066 ms) : 0, 9066
Flare Poller [baseline] (3.762 ms) : 0, 3762
Flare Poller [candidate] (3.763 ms) : 0, 3763
section appsec
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (689.408 ms) : 0, 689408
BytebuddyAgent [candidate] (695.444 ms) : 0, 695444
GlobalTracer [baseline] (259.022 ms) : 0, 259022
GlobalTracer [candidate] (261.256 ms) : 0, 261256
IAST [baseline] (24.489 ms) : 0, 24489
IAST [candidate] (24.756 ms) : 0, 24756
AppSec [baseline] (174.379 ms) : 0, 174379
AppSec [candidate] (175.571 ms) : 0, 175571
Debugger [baseline] (66.386 ms) : 0, 66386
Debugger [candidate] (67.198 ms) : 0, 67198
Remote Config [baseline] (696.153 µs) : 0, 696
Remote Config [candidate] (731.392 µs) : 0, 731
Telemetry [baseline] (8.897 ms) : 0, 8897
Telemetry [candidate] (9.04 ms) : 0, 9040
Flare Poller [baseline] (3.866 ms) : 0, 3866
Flare Poller [candidate] (3.948 ms) : 0, 3948
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (791.982 ms) : 0, 791982
BytebuddyAgent [candidate] (791.484 ms) : 0, 791484
GlobalTracer [baseline] (255.981 ms) : 0, 255981
GlobalTracer [candidate] (256.157 ms) : 0, 256157
IAST [baseline] (26.929 ms) : 0, 26929
IAST [candidate] (26.963 ms) : 0, 26963
AppSec [baseline] (34.765 ms) : 0, 34765
AppSec [candidate] (34.527 ms) : 0, 34527
Debugger [baseline] (66.794 ms) : 0, 66794
Debugger [candidate] (66.134 ms) : 0, 66134
Remote Config [baseline] (563.567 µs) : 0, 564
Remote Config [candidate] (562.065 µs) : 0, 562
Telemetry [baseline] (8.427 ms) : 0, 8427
Telemetry [candidate] (8.415 ms) : 0, 8415
Flare Poller [baseline] (3.456 ms) : 0, 3456
Flare Poller [candidate] (3.468 ms) : 0, 3468
section profiling
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (707.219 ms) : 0, 707219
BytebuddyAgent [candidate] (702.307 ms) : 0, 702307
GlobalTracer [baseline] (222.119 ms) : 0, 222119
GlobalTracer [candidate] (221.308 ms) : 0, 221308
AppSec [baseline] (32.514 ms) : 0, 32514
AppSec [candidate] (32.201 ms) : 0, 32201
Debugger [baseline] (68.238 ms) : 0, 68238
Debugger [candidate] (68.055 ms) : 0, 68055
Remote Config [baseline] (658.907 µs) : 0, 659
Remote Config [candidate] (609.796 µs) : 0, 610
Telemetry [baseline] (8.996 ms) : 0, 8996
Telemetry [candidate] (9.086 ms) : 0, 9086
Flare Poller [baseline] (3.729 ms) : 0, 3729
Flare Poller [candidate] (3.815 ms) : 0, 3815
ProfilingAgent [baseline] (97.677 ms) : 0, 97677
ProfilingAgent [candidate] (97.36 ms) : 0, 97360
Profiling [baseline] (98.248 ms) : 0, 98248
Profiling [candidate] (97.942 ms) : 0, 97942
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-daemon-smoke-tests
git_commit_date 1765276026 1765276456
git_commit_sha 85ac4c8 ba5f1fb
release_version 1.57.0-SNAPSHOT~85ac4c84ae 1.57.0-SNAPSHOT~ba5f1fb43a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765278689 1765278689
ci_job_id 1278810930 1278810930
ci_pipeline_id 85531522 85531522
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-29xoy7jg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-29xoy7jg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:appsec:high_load better
[-1.756ms; -0.854ms] or [-9.025%; -4.388%]		 unsure
[-1.913ms; -0.495ms] or [-6.173%; -1.597%]		 unstable
[-9.917op/s; +39.105op/s] or [-4.187%; +16.509%]		 18.158ms 29.786ms 251.469op/s 19.463ms 30.990ms 236.875op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.197 ms) : 1186, 1209
.   : milestone, 1197,
iast (3.25 ms) : 3215, 3284
.   : milestone, 3250,
iast_FULL (5.561 ms) : 5506, 5616
.   : milestone, 5561,
iast_GLOBAL (3.562 ms) : 3515, 3610
.   : milestone, 3562,
profiling (1.994 ms) : 1976, 2011
.   : milestone, 1994,
tracing (1.843 ms) : 1828, 1859
.   : milestone, 1843,
section candidate
no_agent (1.19 ms) : 1178, 1201
.   : milestone, 1190,
iast (3.131 ms) : 3097, 3165
.   : milestone, 3131,
iast_FULL (5.496 ms) : 5443, 5549
.   : milestone, 5496,
iast_GLOBAL (3.675 ms) : 3612, 3738
.   : milestone, 3675,
profiling (2.167 ms) : 2147, 2188
.   : milestone, 2167,
tracing (1.781 ms) : 1767, 1796
.   : milestone, 1781,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.197 ms [1.186 ms, 1.209 ms] -
iast 3.25 ms [3.215 ms, 3.284 ms] 2.052 ms (171.4%)
iast_FULL 5.561 ms [5.506 ms, 5.616 ms] 4.364 ms (364.4%)
iast_GLOBAL 3.562 ms [3.515 ms, 3.61 ms] 2.365 ms (197.5%)
profiling 1.994 ms [1.976 ms, 2.011 ms] 796.265 µs (66.5%)
tracing 1.843 ms [1.828 ms, 1.859 ms] 645.847 µs (53.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.19 ms [1.178 ms, 1.201 ms] -
iast 3.131 ms [3.097 ms, 3.165 ms] 1.941 ms (163.1%)
iast_FULL 5.496 ms [5.443 ms, 5.549 ms] 4.306 ms (361.9%)
iast_GLOBAL 3.675 ms [3.612 ms, 3.738 ms] 2.485 ms (208.8%)
profiling 2.167 ms [2.147 ms, 2.188 ms] 977.52 µs (82.1%)
tracing 1.781 ms [1.767 ms, 1.796 ms] 591.284 µs (49.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.182 ms) : 17997, 18367
.   : milestone, 18182,
appsec (19.704 ms) : 19505, 19904
.   : milestone, 19704,
code_origins (17.74 ms) : 17565, 17914
.   : milestone, 17740,
iast (17.773 ms) : 17595, 17951
.   : milestone, 17773,
profiling (19.51 ms) : 19307, 19713
.   : milestone, 19510,
tracing (17.694 ms) : 17521, 17867
.   : milestone, 17694,
section candidate
no_agent (19.054 ms) : 18861, 19247
.   : milestone, 19054,
appsec (18.558 ms) : 18371, 18744
.   : milestone, 18558,
code_origins (17.807 ms) : 17631, 17984
.   : milestone, 17807,
iast (17.681 ms) : 17505, 17856
.   : milestone, 17681,
profiling (19.295 ms) : 19102, 19488
.   : milestone, 19295,
tracing (17.425 ms) : 17254, 17596
.   : milestone, 17425,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.182 ms [17.997 ms, 18.367 ms] -
appsec 19.704 ms [19.505 ms, 19.904 ms] 1.523 ms (8.4%)
code_origins 17.74 ms [17.565 ms, 17.914 ms] -442.201 µs (-2.4%)
iast 17.773 ms [17.595 ms, 17.951 ms] -409.018 µs (-2.2%)
profiling 19.51 ms [19.307 ms, 19.713 ms] 1.328 ms (7.3%)
tracing 17.694 ms [17.521 ms, 17.867 ms] -488.016 µs (-2.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.054 ms [18.861 ms, 19.247 ms] -
appsec 18.558 ms [18.371 ms, 18.744 ms] -496.002 µs (-2.6%)
code_origins 17.807 ms [17.631 ms, 17.984 ms] -1.246 ms (-6.5%)
iast 17.681 ms [17.505 ms, 17.856 ms] -1.373 ms (-7.2%)
profiling 19.295 ms [19.102 ms, 19.488 ms] 241.379 µs (1.3%)
tracing 17.425 ms [17.254 ms, 17.596 ms] -1.629 ms (-8.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-daemon-smoke-tests
git_commit_date 1765276026 1765276456
git_commit_sha 85ac4c8 ba5f1fb
release_version 1.57.0-SNAPSHOT~85ac4c84ae 1.57.0-SNAPSHOT~ba5f1fb43a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765278461 1765278461
ci_job_id 1278810932 1278810932
ci_pipeline_id 85531522 85531522
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-wajjth9o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-wajjth9o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.899 s) : 14899000, 14899000
.   : milestone, 14899000,
appsec (14.493 s) : 14493000, 14493000
.   : milestone, 14493000,
iast (18.43 s) : 18430000, 18430000
.   : milestone, 18430000,
iast_GLOBAL (18.094 s) : 18094000, 18094000
.   : milestone, 18094000,
profiling (14.448 s) : 14448000, 14448000
.   : milestone, 14448000,
tracing (14.784 s) : 14784000, 14784000
.   : milestone, 14784000,
section candidate
no_agent (15.064 s) : 15064000, 15064000
.   : milestone, 15064000,
appsec (14.575 s) : 14575000, 14575000
.   : milestone, 14575000,
iast (18.052 s) : 18052000, 18052000
.   : milestone, 18052000,
iast_GLOBAL (18.074 s) : 18074000, 18074000
.   : milestone, 18074000,
profiling (14.659 s) : 14659000, 14659000
.   : milestone, 14659000,
tracing (14.734 s) : 14734000, 14734000
.   : milestone, 14734000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.899 s [14.899 s, 14.899 s] -
appsec 14.493 s [14.493 s, 14.493 s] -406.0 ms (-2.7%)
iast 18.43 s [18.43 s, 18.43 s] 3.531 s (23.7%)
iast_GLOBAL 18.094 s [18.094 s, 18.094 s] 3.195 s (21.4%)
profiling 14.448 s [14.448 s, 14.448 s] -451.0 ms (-3.0%)
tracing 14.784 s [14.784 s, 14.784 s] -115.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.064 s [15.064 s, 15.064 s] -
appsec 14.575 s [14.575 s, 14.575 s] -489.0 ms (-3.2%)
iast 18.052 s [18.052 s, 18.052 s] 2.988 s (19.8%)
iast_GLOBAL 18.074 s [18.074 s, 18.074 s] 3.01 s (20.0%)
profiling 14.659 s [14.659 s, 14.659 s] -405.0 ms (-2.7%)
tracing 14.734 s [14.734 s, 14.734 s] -330.0 ms (-2.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~ba5f1fb43a, baseline=1.57.0-SNAPSHOT~85ac4c84ae
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.684 ms) : 3469, 3899
.   : milestone, 3684,
iast (2.23 ms) : 2166, 2294
.   : milestone, 2230,
iast_GLOBAL (2.267 ms) : 2202, 2331
.   : milestone, 2267,
profiling (2.075 ms) : 2023, 2127
.   : milestone, 2075,
tracing (2.057 ms) : 2006, 2107
.   : milestone, 2057,
section candidate
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (3.725 ms) : 3504, 3945
.   : milestone, 3725,
iast (2.224 ms) : 2159, 2289
.   : milestone, 2224,
iast_GLOBAL (2.279 ms) : 2214, 2344
.   : milestone, 2279,
profiling (2.096 ms) : 2041, 2150
.   : milestone, 2096,
tracing (2.057 ms) : 2006, 2108
.   : milestone, 2057,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 3.684 ms [3.469 ms, 3.899 ms] 2.203 ms (148.8%)
iast 2.23 ms [2.166 ms, 2.294 ms] 749.293 µs (50.6%)
iast_GLOBAL 2.267 ms [2.202 ms, 2.331 ms] 786.072 µs (53.1%)
profiling 2.075 ms [2.023 ms, 2.127 ms] 594.02 µs (40.1%)
tracing 2.057 ms [2.006 ms, 2.107 ms] 576.19 µs (38.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.475 ms, 1.498 ms] -
appsec 3.725 ms [3.504 ms, 3.945 ms] 2.238 ms (150.6%)
iast 2.224 ms [2.159 ms, 2.289 ms] 737.461 µs (49.6%)
iast_GLOBAL 2.279 ms [2.214 ms, 2.344 ms] 792.765 µs (53.3%)
profiling 2.096 ms [2.041 ms, 2.15 ms] 609.159 µs (41.0%)
tracing 2.057 ms [2.006 ms, 2.108 ms] 570.619 µs (38.4%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility comp: testing Testing run-tests: all Run all tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@nikita-tkachenko-datadog @AlexeyKuznetsov-DD