-
Notifications
You must be signed in to change notification settings - Fork 312
Exclude non Temurin JDK for structured concurrency smoke tests #9532
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
AlexeyKuznetsov-DD
approved these changes
Sep 15, 2025
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 13 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060909
Total [baseline] (8.666 s) : 0, 8665876
Agent [candidate] (1.062 s) : 0, 1062437
Total [candidate] (8.625 s) : 0, 8625052
section iast
Agent [baseline] (1.199 s) : 0, 1199035
Total [baseline] (9.339 s) : 0, 9338750
Agent [candidate] (1.187 s) : 0, 1186865
Total [candidate] (9.288 s) : 0, 9287517
gantt
title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (733.0 ms) : 0, 733000
BytebuddyAgent [candidate] (733.414 ms) : 0, 733414
GlobalTracer [baseline] (252.075 ms) : 0, 252075
GlobalTracer [candidate] (252.435 ms) : 0, 252435
AppSec [baseline] (30.603 ms) : 0, 30603
AppSec [candidate] (30.718 ms) : 0, 30718
Debugger [baseline] (6.355 ms) : 0, 6355
Debugger [candidate] (6.388 ms) : 0, 6388
Remote Config [baseline] (690.926 µs) : 0, 691
Remote Config [candidate] (706.679 µs) : 0, 707
Telemetry [baseline] (15.756 ms) : 0, 15756
Telemetry [candidate] (16.248 ms) : 0, 16248
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (859.31 ms) : 0, 859310
BytebuddyAgent [candidate] (850.196 ms) : 0, 850196
GlobalTracer [baseline] (247.473 ms) : 0, 247473
GlobalTracer [candidate] (245.368 ms) : 0, 245368
AppSec [baseline] (26.49 ms) : 0, 26490
AppSec [candidate] (26.23 ms) : 0, 26230
Debugger [baseline] (6.126 ms) : 0, 6126
Debugger [candidate] (6.032 ms) : 0, 6032
Remote Config [baseline] (620.484 µs) : 0, 620
Remote Config [candidate] (588.662 µs) : 0, 589
Telemetry [baseline] (8.359 ms) : 0, 8359
Telemetry [candidate] (8.127 ms) : 0, 8127
IAST [baseline] (28.177 ms) : 0, 28177
IAST [candidate] (27.885 ms) : 0, 27885
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070961
Total [baseline] (10.679 s) : 0, 10678887
Agent [candidate] (1.069 s) : 0, 1069068
Total [candidate] (10.857 s) : 0, 10857338
section appsec
Agent [baseline] (1.237 s) : 0, 1236858
Total [baseline] (10.971 s) : 0, 10971462
Agent [candidate] (1.233 s) : 0, 1232993
Total [candidate] (11.001 s) : 0, 11001276
section iast
Agent [baseline] (1.208 s) : 0, 1207806
Total [baseline] (10.956 s) : 0, 10956024
Agent [candidate] (1.191 s) : 0, 1191420
Total [candidate] (10.304 s) : 0, 10303598
section profiling
Agent [baseline] (1.209 s) : 0, 1208638
Total [baseline] (10.904 s) : 0, 10904297
Agent [candidate] (1.216 s) : 0, 1215573
Total [candidate] (10.86 s) : 0, 10860211
gantt
title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.483 ms) : 0, 1483
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (742.373 ms) : 0, 742373
BytebuddyAgent [candidate] (738.003 ms) : 0, 738003
GlobalTracer [baseline] (253.707 ms) : 0, 253707
GlobalTracer [candidate] (254.154 ms) : 0, 254154
AppSec [baseline] (30.796 ms) : 0, 30796
AppSec [candidate] (30.967 ms) : 0, 30967
Debugger [baseline] (6.427 ms) : 0, 6427
Debugger [candidate] (6.419 ms) : 0, 6419
Remote Config [baseline] (706.312 µs) : 0, 706
Remote Config [candidate] (700.877 µs) : 0, 701
Telemetry [baseline] (14.14 ms) : 0, 14140
Telemetry [candidate] (16.168 ms) : 0, 16168
section appsec
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (757.487 ms) : 0, 757487
BytebuddyAgent [candidate] (754.609 ms) : 0, 754609
GlobalTracer [baseline] (246.388 ms) : 0, 246388
GlobalTracer [candidate] (245.171 ms) : 0, 245171
AppSec [baseline] (171.209 ms) : 0, 171209
AppSec [candidate] (170.823 ms) : 0, 170823
Debugger [baseline] (6.051 ms) : 0, 6051
Debugger [candidate] (6.037 ms) : 0, 6037
Remote Config [baseline] (643.779 µs) : 0, 644
Remote Config [candidate] (627.224 µs) : 0, 627
Telemetry [baseline] (8.532 ms) : 0, 8532
Telemetry [candidate] (9.297 ms) : 0, 9297
IAST [baseline] (23.867 ms) : 0, 23867
IAST [candidate] (23.811 ms) : 0, 23811
section iast
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (866.079 ms) : 0, 866079
BytebuddyAgent [candidate] (853.012 ms) : 0, 853012
GlobalTracer [baseline] (247.119 ms) : 0, 247119
GlobalTracer [candidate] (246.116 ms) : 0, 246116
AppSec [baseline] (26.447 ms) : 0, 26447
AppSec [candidate] (25.348 ms) : 0, 25348
Debugger [baseline] (6.12 ms) : 0, 6120
Debugger [candidate] (6.091 ms) : 0, 6091
Remote Config [baseline] (615.77 µs) : 0, 616
Remote Config [candidate] (597.792 µs) : 0, 598
Telemetry [baseline] (8.362 ms) : 0, 8362
Telemetry [candidate] (8.288 ms) : 0, 8288
IAST [baseline] (30.255 ms) : 0, 30255
IAST [candidate] (29.524 ms) : 0, 29524
section profiling
ProfilingAgent [baseline] (107.85 ms) : 0, 107850
ProfilingAgent [candidate] (107.815 ms) : 0, 107815
crashtracking [baseline] (1.436 ms) : 0, 1436
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (761.174 ms) : 0, 761174
BytebuddyAgent [candidate] (766.351 ms) : 0, 766351
GlobalTracer [baseline] (232.825 ms) : 0, 232825
GlobalTracer [candidate] (234.25 ms) : 0, 234250
AppSec [baseline] (31.244 ms) : 0, 31244
AppSec [candidate] (30.726 ms) : 0, 30726
Debugger [baseline] (9.061 ms) : 0, 9061
Debugger [candidate] (7.355 ms) : 0, 7355
Remote Config [baseline] (742.158 µs) : 0, 742
Remote Config [candidate] (717.722 µs) : 0, 718
Telemetry [baseline] (13.413 ms) : 0, 13413
Telemetry [candidate] (15.753 ms) : 0, 15753
Profiling [baseline] (108.519 ms) : 0, 108519
Profiling [candidate] (108.464 ms) : 0, 108464
LoadParameters
See matching parameters
SummaryFound 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section baseline
no_agent (4.395 ms) : 4345, 4446
. : milestone, 4395,
iast (9.881 ms) : 9713, 10048
. : milestone, 9881,
iast_FULL (14.869 ms) : 14571, 15167
. : milestone, 14869,
iast_GLOBAL (10.098 ms) : 9913, 10283
. : milestone, 10098,
profiling (8.754 ms) : 8618, 8890
. : milestone, 8754,
tracing (7.806 ms) : 7687, 7925
. : milestone, 7806,
section candidate
no_agent (4.254 ms) : 4204, 4305
. : milestone, 4254,
iast (9.468 ms) : 9312, 9624
. : milestone, 9468,
iast_FULL (14.48 ms) : 14194, 14767
. : milestone, 14480,
iast_GLOBAL (10.516 ms) : 10333, 10700
. : milestone, 10516,
profiling (8.462 ms) : 8330, 8594
. : milestone, 8462,
tracing (7.807 ms) : 7690, 7924
. : milestone, 7807,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section baseline
no_agent (37.39 ms) : 37090, 37691
. : milestone, 37390,
appsec (48.281 ms) : 47864, 48698
. : milestone, 48281,
code_origins (45.837 ms) : 45441, 46234
. : milestone, 45837,
iast (46.086 ms) : 45687, 46486
. : milestone, 46086,
profiling (50.718 ms) : 50233, 51204
. : milestone, 50718,
tracing (44.136 ms) : 43759, 44513
. : milestone, 44136,
section candidate
no_agent (36.039 ms) : 35758, 36319
. : milestone, 36039,
appsec (47.383 ms) : 46981, 47785
. : milestone, 47383,
code_origins (45.373 ms) : 44990, 45757
. : milestone, 45373,
iast (45.956 ms) : 45553, 46359
. : milestone, 45956,
profiling (48.409 ms) : 47956, 48861
. : milestone, 48409,
tracing (45.522 ms) : 45128, 45917
. : milestone, 45522,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section baseline
no_agent (15.532 s) : 15532000, 15532000
. : milestone, 15532000,
appsec (14.988 s) : 14988000, 14988000
. : milestone, 14988000,
iast (18.439 s) : 18439000, 18439000
. : milestone, 18439000,
iast_GLOBAL (18.145 s) : 18145000, 18145000
. : milestone, 18145000,
profiling (15.356 s) : 15356000, 15356000
. : milestone, 15356000,
tracing (15.034 s) : 15034000, 15034000
. : milestone, 15034000,
section candidate
no_agent (14.815 s) : 14815000, 14815000
. : milestone, 14815000,
appsec (14.867 s) : 14867000, 14867000
. : milestone, 14867000,
iast (18.383 s) : 18383000, 18383000
. : milestone, 18383000,
iast_GLOBAL (18.203 s) : 18203000, 18203000
. : milestone, 18203000,
profiling (16.211 s) : 16211000, 16211000
. : milestone, 16211000,
tracing (15.046 s) : 15046000, 15046000
. : milestone, 15046000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~3897cbee64, baseline=1.54.0-SNAPSHOT~dacc5a50ca
dateFormat X
axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
. : milestone, 1469,
appsec (3.708 ms) : 3489, 3927
. : milestone, 3708,
iast (2.193 ms) : 2131, 2256
. : milestone, 2193,
iast_GLOBAL (2.23 ms) : 2167, 2292
. : milestone, 2230,
profiling (2.042 ms) : 1991, 2093
. : milestone, 2042,
tracing (2.012 ms) : 1963, 2061
. : milestone, 2012,
section candidate
no_agent (1.469 ms) : 1458, 1481
. : milestone, 1469,
appsec (3.733 ms) : 3516, 3950
. : milestone, 3733,
iast (2.191 ms) : 2128, 2254
. : milestone, 2191,
iast_GLOBAL (2.238 ms) : 2175, 2301
. : milestone, 2238,
profiling (2.033 ms) : 1982, 2083
. : milestone, 2033,
tracing (2.007 ms) : 1958, 2055
. : milestone, 2007,
|
mhlidd
pushed a commit
that referenced
this pull request
Sep 15, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
inst: java
Core Java language instrumentation
tag: no release notes
Changes to exclude from release notes
type: bug
Bug report and fix
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR excludes non Temurin JDK from smoke test jobs as the hardcoded forked JVM spawn to run the test application is a Temurin based and won't start with non standard JVM args.
Motivation
Smoke test CI jobs for IBM / Semuru are failing.
Additional Notes
Thanks @AlexeyKuznetsov-DD for the highlight!
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]