Skip to content

Avoid preferences lock file contention for tests due to spawned child processes #10083

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
AlexeyKuznetsov-DD merged 13 commits into from
Dec 8, 2025
Merged

Avoid preferences lock file contention for tests due to spawned child processes #10083

AlexeyKuznetsov-DD merged 13 commits into from
Dec 8, 2025
+66 −8

Conversation

@bric3
Copy link
Contributor

@bric3 bric3 commented Dec 4, 2025 •
edited
Loading

What Does This Do

Prevents

Couldn't flush user prefs: java.util.prefs.BackingStoreException: Couldn't get file lock.

that is observed after bumping the Gradle Daemon JDK to 21, see:

Motivation

CI stability

Additional Notes

CI builds intermittently (very often) fail with Java Preferences API file locking errors:

Couldn't flush user prefs: java.util.prefs.BackingStoreException: Couldn't get file lock.

In particular it was spotted smoke jobs that ran the following tests

  • MetricProbesIntegrationTest (:dd-smoke-tests:debugger-integration-tests)
  • SpringBootGrpcCompletableFutureTest (:dd-smoke-tests:springboot-grpc)
  • Gradle tests (:dd-smoke-tests:gradle)
  • And generally tests that spawn child JVMs

Java's FileSystemPreferences stores user preferences in a shared directory:

  userRootDir = new File(
      System.getProperty("java.util.prefs.userRoot",
                        System.getProperty("user.home")),
      ".java/.userPrefs"
  );

When java.util.prefs.userRoot is not set, all JVMs default to $HOME/.java/.userPrefs/. While there's no stack trace, looking at the code suggest the following :

  1. This code is triggered, the preferences system depends on the OS, on Linux the implementation is FilePreferencesSystem. This message Couldn't flush user prefs: java.util.prefs.BackingStoreException: Couldn't get file lock. can only be created via this call stack

    FilePreferencesSystem.sync()
FilePreferencesSystem.flush()
FilePreferencesSystem.syncWorld()

  2. The sync method calls FilePreferencesSystem.lockFile, which tries to acquire a file lock which actually a named lock file: $HOME/.java/.userPrefs/.user.lock.non-root-user. This method will try 5 times at most each time using an exponential backoff strategy. Looking at thew code and the error suggest it is not a permission issue which is confirmed by looking at the folder permissions on the runner:

    $ ls -lah $HOME/.java/.userPrefs
drwx------ 3 non-root-user non-root-group 4.0K Dec  8 13:28 .
drwxr-xr-x 3 non-root-user non-root-group 4.0K Dec  8 13:27 ..
drwxr-xr-x 3 non-root-user non-root-group 4.0K Dec  8 13:28 org
-rw------- 1 non-root-user non-root-group    0 Dec  8 13:28 .user.lock.non-root-user
-rw------- 1 non-root-user non-root-group    0 Dec  8 13:28 .userRootModFile.non-root-user

    Also nothing fancy on the native part.

  3. FilePreferencesSystem has a static initializer that register in addShutdownHook a timer task and a shutdown hook that call FilePreferencesSystem.syncWorld().

Our project don't have to rely on preferences, but third party lib or build tool might use it. Also this error only happens for the user preferences only, which can be accessed via java.util.prefs.Preferences.userRoot(), looking for that there's a couple of them, groovy, spring-beans, gradle (to workaround a Groovy Classloader leak) ...yet without hard evidence this code path is actually run, I can't incriminate them.

Note, another avenue might be to disable user preferences for tests, for example by passing a custom preference factory.

-Djava.util.prefs.PreferencesFactory=com.datadog.util.prefs.NoOpPreferencesFactory

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3 bric3 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Dec 4, 2025
@pr-commenter
Copy link

pr-commenter bot commented Dec 4, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/change-preferences-dir-for-tests
git_commit_date 1764970693 1765230350
git_commit_sha 823cec6 bc84896
release_version 1.57.0-SNAPSHOT~823cec6aa6 1.57.0-SNAPSHOT~bc8489613b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765232287 1765232287
ci_job_id 1277618465 1277618465
ci_pipeline_id 85424438 85424438
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5kof63ho 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5kof63ho 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.09 s) : 0, 1089580
Total [baseline] (8.788 s) : 0, 8788452
Agent [candidate] (1.091 s) : 0, 1090799
Total [candidate] (8.781 s) : 0, 8780989
section iast
Agent [baseline] (1.226 s) : 0, 1225568
Total [baseline] (9.487 s) : 0, 9486879
Agent [candidate] (1.226 s) : 0, 1226107
Total [candidate] (9.489 s) : 0, 9489417
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent iast 1.226 s 135.989 ms (12.5%)
Total tracing 8.788 s -
Total iast 9.487 s 698.428 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent iast 1.226 s 135.308 ms (12.4%)
Total tracing 8.781 s -
Total iast 9.489 s 708.428 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (653.55 ms) : 0, 653550
BytebuddyAgent [candidate] (656.897 ms) : 0, 656897
GlobalTracer [baseline] (284.543 ms) : 0, 284543
GlobalTracer [candidate] (283.986 ms) : 0, 283986
AppSec [baseline] (32.719 ms) : 0, 32719
AppSec [candidate] (32.592 ms) : 0, 32592
Debugger [baseline] (68.215 ms) : 0, 68215
Debugger [candidate] (67.054 ms) : 0, 67054
Remote Config [baseline] (640.755 µs) : 0, 641
Remote Config [candidate] (633.118 µs) : 0, 633
Telemetry [baseline] (9.108 ms) : 0, 9108
Telemetry [candidate] (8.852 ms) : 0, 8852
Flare Poller [baseline] (3.727 ms) : 0, 3727
Flare Poller [candidate] (3.662 ms) : 0, 3662
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (791.614 ms) : 0, 791614
BytebuddyAgent [candidate] (792.927 ms) : 0, 792927
GlobalTracer [baseline] (256.149 ms) : 0, 256149
GlobalTracer [candidate] (256.247 ms) : 0, 256247
IAST [baseline] (27.221 ms) : 0, 27221
IAST [candidate] (27.023 ms) : 0, 27023
AppSec [baseline] (35.724 ms) : 0, 35724
AppSec [candidate] (35.701 ms) : 0, 35701
Debugger [baseline] (65.7 ms) : 0, 65700
Debugger [candidate] (64.99 ms) : 0, 64990
Remote Config [baseline] (547.248 µs) : 0, 547
Remote Config [candidate] (546.704 µs) : 0, 547
Telemetry [baseline] (8.441 ms) : 0, 8441
Telemetry [candidate] (8.442 ms) : 0, 8442
Flare Poller [baseline] (3.454 ms) : 0, 3454
Flare Poller [candidate] (3.486 ms) : 0, 3486
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.083 s) : 0, 1082913
Total [baseline] (10.826 s) : 0, 10825672
Agent [candidate] (1.083 s) : 0, 1083124
Total [candidate] (10.843 s) : 0, 10842734
section appsec
Agent [baseline] (1.268 s) : 0, 1267885
Total [baseline] (11.179 s) : 0, 11179176
Agent [candidate] (1.278 s) : 0, 1277846
Total [candidate] (11.223 s) : 0, 11223418
section iast
Agent [baseline] (1.231 s) : 0, 1230995
Total [baseline] (11.301 s) : 0, 11301031
Agent [candidate] (1.225 s) : 0, 1225102
Total [candidate] (11.136 s) : 0, 11135914
section profiling
Agent [baseline] (1.218 s) : 0, 1218027
Total [baseline] (11.013 s) : 0, 11012760
Agent [candidate] (1.207 s) : 0, 1207062
Total [candidate] (11.144 s) : 0, 11144484
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.268 s 184.972 ms (17.1%)
Agent iast 1.231 s 148.082 ms (13.7%)
Agent profiling 1.218 s 135.114 ms (12.5%)
Total tracing 10.826 s -
Total appsec 11.179 s 353.504 ms (3.3%)
Total iast 11.301 s 475.359 ms (4.4%)
Total profiling 11.013 s 187.088 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.278 s 194.722 ms (18.0%)
Agent iast 1.225 s 141.979 ms (13.1%)
Agent profiling 1.207 s 123.939 ms (11.4%)
Total tracing 10.843 s -
Total appsec 11.223 s 380.685 ms (3.5%)
Total iast 11.136 s 293.18 ms (2.7%)
Total profiling 11.144 s 301.751 ms (2.8%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (649.401 ms) : 0, 649401
BytebuddyAgent [candidate] (649.395 ms) : 0, 649395
GlobalTracer [baseline] (282.439 ms) : 0, 282439
GlobalTracer [candidate] (282.908 ms) : 0, 282908
AppSec [baseline] (32.401 ms) : 0, 32401
AppSec [candidate] (32.382 ms) : 0, 32382
Debugger [baseline] (68.431 ms) : 0, 68431
Debugger [candidate] (68.289 ms) : 0, 68289
Remote Config [baseline] (642.51 µs) : 0, 643
Remote Config [candidate] (635.337 µs) : 0, 635
Telemetry [baseline] (8.995 ms) : 0, 8995
Telemetry [candidate] (9.002 ms) : 0, 9002
Flare Poller [baseline] (3.69 ms) : 0, 3690
Flare Poller [candidate] (3.697 ms) : 0, 3697
section appsec
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (691.081 ms) : 0, 691081
BytebuddyAgent [candidate] (697.168 ms) : 0, 697168
GlobalTracer [baseline] (259.974 ms) : 0, 259974
GlobalTracer [candidate] (262.738 ms) : 0, 262738
IAST [baseline] (24.61 ms) : 0, 24610
IAST [candidate] (25.042 ms) : 0, 25042
AppSec [baseline] (175.594 ms) : 0, 175594
AppSec [candidate] (175.019 ms) : 0, 175019
Debugger [baseline] (66.226 ms) : 0, 66226
Debugger [candidate] (67.326 ms) : 0, 67326
Remote Config [baseline] (698.67 µs) : 0, 699
Remote Config [candidate] (694.824 µs) : 0, 695
Telemetry [baseline] (8.98 ms) : 0, 8980
Telemetry [candidate] (8.894 ms) : 0, 8894
Flare Poller [baseline] (3.873 ms) : 0, 3873
Flare Poller [candidate] (3.881 ms) : 0, 3881
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (793.884 ms) : 0, 793884
BytebuddyAgent [candidate] (791.147 ms) : 0, 791147
GlobalTracer [baseline] (257.778 ms) : 0, 257778
GlobalTracer [candidate] (256.021 ms) : 0, 256021
IAST [baseline] (27.368 ms) : 0, 27368
IAST [candidate] (27.204 ms) : 0, 27204
AppSec [baseline] (35.663 ms) : 0, 35663
AppSec [candidate] (35.502 ms) : 0, 35502
Debugger [baseline] (66.815 ms) : 0, 66815
Debugger [candidate] (66.05 ms) : 0, 66050
Remote Config [baseline] (579.034 µs) : 0, 579
Remote Config [candidate] (545.999 µs) : 0, 546
Telemetry [baseline] (8.64 ms) : 0, 8640
Telemetry [candidate] (8.472 ms) : 0, 8472
Flare Poller [baseline] (3.505 ms) : 0, 3505
Flare Poller [candidate] (3.469 ms) : 0, 3469
section profiling
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (708.935 ms) : 0, 708935
BytebuddyAgent [candidate] (702.053 ms) : 0, 702053
GlobalTracer [baseline] (223.669 ms) : 0, 223669
GlobalTracer [candidate] (221.707 ms) : 0, 221707
AppSec [baseline] (32.938 ms) : 0, 32938
AppSec [candidate] (32.318 ms) : 0, 32318
Debugger [baseline] (69.041 ms) : 0, 69041
Debugger [candidate] (68.674 ms) : 0, 68674
Remote Config [baseline] (638.333 µs) : 0, 638
Remote Config [candidate] (651.386 µs) : 0, 651
Telemetry [baseline] (8.96 ms) : 0, 8960
Telemetry [candidate] (9.038 ms) : 0, 9038
Flare Poller [baseline] (3.762 ms) : 0, 3762
Flare Poller [candidate] (3.81 ms) : 0, 3810
ProfilingAgent [baseline] (98.451 ms) : 0, 98451
ProfilingAgent [candidate] (97.959 ms) : 0, 97959
Profiling [baseline] (99.031 ms) : 0, 99031
Profiling [candidate] (98.54 ms) : 0, 98540
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/change-preferences-dir-for-tests
git_commit_date 1764970693 1765230350
git_commit_sha 823cec6 bc84896
release_version 1.57.0-SNAPSHOT~823cec6aa6 1.57.0-SNAPSHOT~bc8489613b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765232760 1765232760
ci_job_id 1277618467 1277618467
ci_pipeline_id 85424438 85424438
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hkzqb9bi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hkzqb9bi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load unsure
[+3.707µs; +180.713µs] or [+0.150%; +7.294%]		 worse
[+176.456µs; +616.305µs] or [+2.457%; +8.583%]		 unstable
[-237.820op/s; +88.570op/s] or [-16.307%; +6.073%]		 2.570ms 7.577ms 1383.750op/s 2.477ms 7.180ms 1458.375op/s
scenario:load:petclinic:tracing:high_load worse
[+0.819ms; +1.788ms] or [+4.805%; +10.488%]		 unsure
[+0.459ms; +1.975ms] or [+1.620%; +6.976%]		 unstable
[-42.065op/s; +12.502op/s] or [-15.816%; +4.701%]		 18.351ms 29.535ms 251.188op/s 17.047ms 28.318ms 265.969op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.910ms; +1.715ms] or [+5.305%; +9.992%]		 worse
[+0.655ms; +2.271ms] or [+2.302%; +7.986%]		 unstable
[-43.959op/s; +9.834op/s] or [-16.547%; +3.702%]		 18.473ms 29.898ms 248.594op/s 17.161ms 28.436ms 265.656op/s
scenario:load:petclinic:profiling:high_load better
[-2.164ms; -1.052ms] or [-10.875%; -5.286%]		 better
[-3.208ms; -1.125ms] or [-10.039%; -3.519%]		 unstable
[-5.980op/s; +45.417op/s] or [-2.589%; +19.667%]		 18.289ms 29.792ms 250.656op/s 19.897ms 31.958ms 230.938op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.199 ms) : 1187, 1211
.   : milestone, 1199,
iast (3.136 ms) : 3098, 3173
.   : milestone, 3136,
iast_FULL (5.917 ms) : 5857, 5976
.   : milestone, 5917,
iast_GLOBAL (3.636 ms) : 3581, 3691
.   : milestone, 3636,
profiling (2.119 ms) : 2100, 2137
.   : milestone, 2119,
tracing (1.824 ms) : 1809, 1839
.   : milestone, 1824,
section candidate
no_agent (1.211 ms) : 1199, 1223
.   : milestone, 1211,
iast (3.308 ms) : 3261, 3356
.   : milestone, 3308,
iast_FULL (5.891 ms) : 5831, 5951
.   : milestone, 5891,
iast_GLOBAL (3.631 ms) : 3574, 3688
.   : milestone, 3631,
profiling (1.92 ms) : 1905, 1936
.   : milestone, 1920,
tracing (1.766 ms) : 1752, 1780
.   : milestone, 1766,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.199 ms [1.187 ms, 1.211 ms] -
iast 3.136 ms [3.098 ms, 3.173 ms] 1.937 ms (161.5%)
iast_FULL 5.917 ms [5.857 ms, 5.976 ms] 4.717 ms (393.3%)
iast_GLOBAL 3.636 ms [3.581 ms, 3.691 ms] 2.437 ms (203.2%)
profiling 2.119 ms [2.1 ms, 2.137 ms] 919.356 µs (76.7%)
tracing 1.824 ms [1.809 ms, 1.839 ms] 624.863 µs (52.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.211 ms [1.199 ms, 1.223 ms] -
iast 3.308 ms [3.261 ms, 3.356 ms] 2.097 ms (173.1%)
iast_FULL 5.891 ms [5.831 ms, 5.951 ms] 4.68 ms (386.4%)
iast_GLOBAL 3.631 ms [3.574 ms, 3.688 ms] 2.42 ms (199.8%)
profiling 1.92 ms [1.905 ms, 1.936 ms] 708.951 µs (58.5%)
tracing 1.766 ms [1.752 ms, 1.78 ms] 554.473 µs (45.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.095 ms) : 17909, 18281
.   : milestone, 18095,
appsec (18.658 ms) : 18472, 18845
.   : milestone, 18658,
code_origins (17.563 ms) : 17387, 17738
.   : milestone, 17563,
iast (17.706 ms) : 17526, 17886
.   : milestone, 17706,
profiling (20.218 ms) : 20007, 20429
.   : milestone, 20218,
tracing (17.545 ms) : 17371, 17719
.   : milestone, 17545,
section candidate
no_agent (18.981 ms) : 18793, 19169
.   : milestone, 18981,
appsec (18.481 ms) : 18294, 18668
.   : milestone, 18481,
code_origins (18.777 ms) : 18586, 18969
.   : milestone, 18777,
iast (17.675 ms) : 17502, 17848
.   : milestone, 17675,
profiling (18.62 ms) : 18434, 18807
.   : milestone, 18620,
tracing (18.579 ms) : 18390, 18767
.   : milestone, 18579,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.095 ms [17.909 ms, 18.281 ms] -
appsec 18.658 ms [18.472 ms, 18.845 ms] 563.203 µs (3.1%)
code_origins 17.563 ms [17.387 ms, 17.738 ms] -532.518 µs (-2.9%)
iast 17.706 ms [17.526 ms, 17.886 ms] -389.185 µs (-2.2%)
profiling 20.218 ms [20.007 ms, 20.429 ms] 2.123 ms (11.7%)
tracing 17.545 ms [17.371 ms, 17.719 ms] -550.519 µs (-3.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.981 ms [18.793 ms, 19.169 ms] -
appsec 18.481 ms [18.294 ms, 18.668 ms] -500.182 µs (-2.6%)
code_origins 18.777 ms [18.586 ms, 18.969 ms] -203.715 µs (-1.1%)
iast 17.675 ms [17.502 ms, 17.848 ms] -1.306 ms (-6.9%)
profiling 18.62 ms [18.434 ms, 18.807 ms] -360.906 µs (-1.9%)
tracing 18.579 ms [18.39 ms, 18.767 ms] -402.424 µs (-2.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/change-preferences-dir-for-tests
git_commit_date 1764970693 1765230350
git_commit_sha 823cec6 bc84896
release_version 1.57.0-SNAPSHOT~823cec6aa6 1.57.0-SNAPSHOT~bc8489613b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765232466 1765232466
ci_job_id 1277618470 1277618470
ci_pipeline_id 85424438 85424438
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-lgeloyff 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-lgeloyff 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.694 ms) : 3477, 3911
.   : milestone, 3694,
iast (2.204 ms) : 2140, 2268
.   : milestone, 2204,
iast_GLOBAL (2.247 ms) : 2182, 2311
.   : milestone, 2247,
profiling (2.064 ms) : 2012, 2116
.   : milestone, 2064,
tracing (2.039 ms) : 1989, 2090
.   : milestone, 2039,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.643 ms) : 3429, 3858
.   : milestone, 3643,
iast (2.212 ms) : 2147, 2276
.   : milestone, 2212,
iast_GLOBAL (2.25 ms) : 2185, 2315
.   : milestone, 2250,
profiling (2.084 ms) : 2030, 2138
.   : milestone, 2084,
tracing (2.052 ms) : 2001, 2103
.   : milestone, 2052,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.694 ms [3.477 ms, 3.911 ms] 2.22 ms (150.6%)
iast 2.204 ms [2.14 ms, 2.268 ms] 729.876 µs (49.5%)
iast_GLOBAL 2.247 ms [2.182 ms, 2.311 ms] 772.966 µs (52.4%)
profiling 2.064 ms [2.012 ms, 2.116 ms] 590.122 µs (40.0%)
tracing 2.039 ms [1.989 ms, 2.09 ms] 565.428 µs (38.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.643 ms [3.429 ms, 3.858 ms] 2.17 ms (147.4%)
iast 2.212 ms [2.147 ms, 2.276 ms] 738.831 µs (50.2%)
iast_GLOBAL 2.25 ms [2.185 ms, 2.315 ms] 776.84 µs (52.7%)
profiling 2.084 ms [2.03 ms, 2.138 ms] 611.058 µs (41.5%)
tracing 2.052 ms [2.001 ms, 2.103 ms] 579.028 µs (39.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~bc8489613b, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.993 s) : 14993000, 14993000
.   : milestone, 14993000,
appsec (14.554 s) : 14554000, 14554000
.   : milestone, 14554000,
iast (18.126 s) : 18126000, 18126000
.   : milestone, 18126000,
iast_GLOBAL (17.849 s) : 17849000, 17849000
.   : milestone, 17849000,
profiling (14.425 s) : 14425000, 14425000
.   : milestone, 14425000,
tracing (14.593 s) : 14593000, 14593000
.   : milestone, 14593000,
section candidate
no_agent (15.014 s) : 15014000, 15014000
.   : milestone, 15014000,
appsec (14.572 s) : 14572000, 14572000
.   : milestone, 14572000,
iast (18.077 s) : 18077000, 18077000
.   : milestone, 18077000,
iast_GLOBAL (18.06 s) : 18060000, 18060000
.   : milestone, 18060000,
profiling (14.528 s) : 14528000, 14528000
.   : milestone, 14528000,
tracing (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.993 s [14.993 s, 14.993 s] -
appsec 14.554 s [14.554 s, 14.554 s] -439.0 ms (-2.9%)
iast 18.126 s [18.126 s, 18.126 s] 3.133 s (20.9%)
iast_GLOBAL 17.849 s [17.849 s, 17.849 s] 2.856 s (19.0%)
profiling 14.425 s [14.425 s, 14.425 s] -568.0 ms (-3.8%)
tracing 14.593 s [14.593 s, 14.593 s] -400.0 ms (-2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.014 s [15.014 s, 15.014 s] -
appsec 14.572 s [14.572 s, 14.572 s] -442.0 ms (-2.9%)
iast 18.077 s [18.077 s, 18.077 s] 3.063 s (20.4%)
iast_GLOBAL 18.06 s [18.06 s, 18.06 s] 3.046 s (20.3%)
profiling 14.528 s [14.528 s, 14.528 s] -486.0 ms (-3.2%)
tracing 14.975 s [14.975 s, 14.975 s] -39.0 ms (-0.3%)

@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from 1c2f93a to d2f2c41 Compare December 5, 2025 17:58
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from d2f2c41 to 4945696 Compare December 5, 2025 18:03
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from a433916 to 73c6a72 Compare December 8, 2025 09:51
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from 73c6a72 to e5e2125 Compare December 8, 2025 10:01
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from e5e2125 to caecd3f Compare December 8, 2025 11:27
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from caecd3f to 8daa903 Compare December 8, 2025 11:33
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from 8daa903 to 337b3c6 Compare December 8, 2025 11:36
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from 337b3c6 to 61567f8 Compare December 8, 2025 12:19
@bric3 bric3 force-pushed the bdu/change-preferences-dir-for-tests branch from 61567f8 to 8cefb2e Compare December 8, 2025 13:05
@bric3
fix: Don't use the the shared tempdir as it is shared for every test
a8a85d1 
This causes all tests to use the same user preference folder,
possibly increasing the chance of this issue happening.
@bric3
fix: Emit gradle properties per test run
2a15199 
Previous code, was generating a single gradle properties file per test.
@bric3 bric3 marked this pull request as ready for review December 8, 2025 17:05
@bric3 bric3 requested review from a team as code owners December 8, 2025 17:05
@bric3 bric3 requested review from TonyCTHsu, dougqh, jpbempel and nikita-tkachenko-datadog and removed request for a team December 8, 2025 17:05
@bric3 bric3 enabled auto-merge (squash) December 8, 2025 19:53
@bric3 bric3 added the type: bug Bug report and fix label Dec 8, 2025
@bric3 bric3 changed the title Try using a test task specific folder for user preference to avoid file locks Avoid preferences lock file contention for tests due to spawned child processes Dec 8, 2025
@bric3 bric3 disabled auto-merge December 8, 2025 20:12
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD enabled auto-merge (squash) December 8, 2025 20:50
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD force-pushed the bdu/change-preferences-dir-for-tests branch from ed7930d to bc84896 Compare December 8, 2025 21:46
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD merged commit aff0473 into master Dec 8, 2025
701 of 703 checks passed
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the bdu/change-preferences-dir-for-tests branch December 8, 2025 22:52
@github-actions github-actions bot added this to the 1.57.0 milestone Dec 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@jpbempel jpbempel Awaiting requested review from jpbempel jpbempel is a code owner automatically assigned from DataDog/debugger-java

@nikita-tkachenko-datadog nikita-tkachenko-datadog Awaiting requested review from nikita-tkachenko-datadog nikita-tkachenko-datadog is a code owner automatically assigned from DataDog/ci-app-libraries-java

@TonyCTHsu TonyCTHsu Awaiting requested review from TonyCTHsu TonyCTHsu was automatically assigned from DataDog/apm-release-platform

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

3 participants

@bric3 @AlexeyKuznetsov-DD