-
Notifications
You must be signed in to change notification settings - Fork 312
Disable skipping tests based on git changes #9078
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
AlexeyKuznetsov-DD
approved these changes
Jul 1, 2025
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (997.131 ms) : 0, 997131
Total [baseline] (8.605 s) : 0, 8605131
Agent [candidate] (999.788 ms) : 0, 999788
Total [candidate] (8.585 s) : 0, 8585106
section iast
Agent [baseline] (1.134 s) : 0, 1133732
Total [baseline] (9.286 s) : 0, 9285574
Agent [candidate] (1.137 s) : 0, 1136878
Total [candidate] (9.296 s) : 0, 9296302
gantt
title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.014 ms) : 0, 688014
BytebuddyAgent [candidate] (690.376 ms) : 0, 690376
GlobalTracer [baseline] (242.241 ms) : 0, 242241
GlobalTracer [candidate] (243.234 ms) : 0, 243234
AppSec [baseline] (30.437 ms) : 0, 30437
AppSec [candidate] (30.451 ms) : 0, 30451
Debugger [baseline] (6.057 ms) : 0, 6057
Debugger [candidate] (6.016 ms) : 0, 6016
Remote Config [baseline] (678.823 µs) : 0, 679
Remote Config [candidate] (680.12 µs) : 0, 680
Telemetry [baseline] (8.223 ms) : 0, 8223
Telemetry [candidate] (8.212 ms) : 0, 8212
section iast
BytebuddyAgent [baseline] (809.556 ms) : 0, 809556
BytebuddyAgent [candidate] (811.179 ms) : 0, 811179
GlobalTracer [baseline] (233.369 ms) : 0, 233369
GlobalTracer [candidate] (234.529 ms) : 0, 234529
AppSec [baseline] (27.689 ms) : 0, 27689
AppSec [candidate] (27.811 ms) : 0, 27811
Debugger [baseline] (5.842 ms) : 0, 5842
Debugger [candidate] (6.753 ms) : 0, 6753
Remote Config [baseline] (598.034 µs) : 0, 598
Remote Config [candidate] (580.376 µs) : 0, 580
Telemetry [baseline] (7.959 ms) : 0, 7959
Telemetry [candidate] (8.022 ms) : 0, 8022
IAST [baseline] (27.963 ms) : 0, 27963
IAST [candidate] (27.178 ms) : 0, 27178
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (998.505 ms) : 0, 998505
Total [baseline] (10.685 s) : 0, 10685294
Agent [candidate] (1.005 s) : 0, 1005466
Total [candidate] (10.703 s) : 0, 10702787
section appsec
Agent [baseline] (1.187 s) : 0, 1187482
Total [baseline] (10.774 s) : 0, 10773603
Agent [candidate] (1.179 s) : 0, 1178567
Total [candidate] (10.726 s) : 0, 10726343
section iast
Agent [baseline] (1.145 s) : 0, 1144602
Total [baseline] (10.902 s) : 0, 10901542
Agent [candidate] (1.14 s) : 0, 1140427
Total [candidate] (10.96 s) : 0, 10959738
section profiling
Agent [baseline] (1.251 s) : 0, 1251274
Total [baseline] (11.072 s) : 0, 11071518
Agent [candidate] (1.25 s) : 0, 1249881
Total [candidate] (11.035 s) : 0, 11035380
gantt
title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.211 ms) : 0, 689211
BytebuddyAgent [candidate] (694.968 ms) : 0, 694968
GlobalTracer [baseline] (243.126 ms) : 0, 243126
GlobalTracer [candidate] (244.045 ms) : 0, 244045
AppSec [baseline] (30.373 ms) : 0, 30373
AppSec [candidate] (30.504 ms) : 0, 30504
Debugger [baseline] (6.051 ms) : 0, 6051
Debugger [candidate] (6.088 ms) : 0, 6088
Remote Config [baseline] (686.375 µs) : 0, 686
Remote Config [candidate] (688.075 µs) : 0, 688
Telemetry [baseline] (8.261 ms) : 0, 8261
Telemetry [candidate] (8.289 ms) : 0, 8289
section appsec
BytebuddyAgent [baseline] (719.325 ms) : 0, 719325
BytebuddyAgent [candidate] (712.575 ms) : 0, 712575
GlobalTracer [baseline] (238.572 ms) : 0, 238572
GlobalTracer [candidate] (236.972 ms) : 0, 236972
AppSec [baseline] (171.523 ms) : 0, 171523
AppSec [candidate] (171.596 ms) : 0, 171596
Debugger [baseline] (5.814 ms) : 0, 5814
Debugger [candidate] (5.797 ms) : 0, 5797
Remote Config [baseline] (623.275 µs) : 0, 623
Remote Config [candidate] (602.864 µs) : 0, 603
Telemetry [baseline] (8.163 ms) : 0, 8163
Telemetry [candidate] (8.126 ms) : 0, 8126
IAST [baseline] (22.437 ms) : 0, 22437
IAST [candidate] (22.055 ms) : 0, 22055
section iast
BytebuddyAgent [baseline] (817.382 ms) : 0, 817382
BytebuddyAgent [candidate] (813.395 ms) : 0, 813395
GlobalTracer [baseline] (235.429 ms) : 0, 235429
GlobalTracer [candidate] (235.554 ms) : 0, 235554
AppSec [baseline] (28.782 ms) : 0, 28782
AppSec [candidate] (29.579 ms) : 0, 29579
Debugger [baseline] (5.902 ms) : 0, 5902
Debugger [candidate] (5.905 ms) : 0, 5905
Remote Config [baseline] (600.337 µs) : 0, 600
Remote Config [candidate] (587.346 µs) : 0, 587
Telemetry [baseline] (8.07 ms) : 0, 8070
Telemetry [candidate] (8.025 ms) : 0, 8025
IAST [baseline] (27.433 ms) : 0, 27433
IAST [candidate] (26.498 ms) : 0, 26498
section profiling
BytebuddyAgent [baseline] (680.895 ms) : 0, 680895
BytebuddyAgent [candidate] (681.129 ms) : 0, 681129
GlobalTracer [baseline] (364.339 ms) : 0, 364339
GlobalTracer [candidate] (362.852 ms) : 0, 362852
AppSec [baseline] (31.916 ms) : 0, 31916
AppSec [candidate] (30.988 ms) : 0, 30988
Debugger [baseline] (11.259 ms) : 0, 11259
Debugger [candidate] (10.544 ms) : 0, 10544
Remote Config [baseline] (662.879 µs) : 0, 663
Remote Config [candidate] (2.499 ms) : 0, 2499
Telemetry [baseline] (9.535 ms) : 0, 9535
Telemetry [candidate] (9.625 ms) : 0, 9625
ProfilingAgent [baseline] (103.897 ms) : 0, 103897
ProfilingAgent [candidate] (103.649 ms) : 0, 103649
Profiling [baseline] (103.922 ms) : 0, 103922
Profiling [candidate] (103.673 ms) : 0, 103673
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 4 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section baseline
no_agent (36.227 ms) : 35937, 36516
. : milestone, 36227,
appsec (46.743 ms) : 46310, 47177
. : milestone, 46743,
code_origins (45.502 ms) : 45109, 45896
. : milestone, 45502,
iast (42.784 ms) : 42409, 43159
. : milestone, 42784,
profiling (46.959 ms) : 46549, 47369
. : milestone, 46959,
tracing (43.846 ms) : 43484, 44208
. : milestone, 43846,
section candidate
no_agent (38.253 ms) : 37946, 38561
. : milestone, 38253,
appsec (45.694 ms) : 45302, 46086
. : milestone, 45694,
code_origins (45.955 ms) : 45542, 46369
. : milestone, 45955,
iast (44.79 ms) : 44398, 45182
. : milestone, 44790,
profiling (48.618 ms) : 48128, 49107
. : milestone, 48618,
tracing (43.117 ms) : 42746, 43487
. : milestone, 43117,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section baseline
no_agent (4.398 ms) : 4349, 4447
. : milestone, 4398,
iast (9.053 ms) : 8901, 9205
. : milestone, 9053,
iast_FULL (14.489 ms) : 14200, 14778
. : milestone, 14489,
iast_GLOBAL (9.957 ms) : 9777, 10137
. : milestone, 9957,
profiling (8.643 ms) : 8512, 8774
. : milestone, 8643,
tracing (7.685 ms) : 7577, 7794
. : milestone, 7685,
section candidate
no_agent (4.606 ms) : 4550, 4661
. : milestone, 4606,
iast (9.132 ms) : 8978, 9286
. : milestone, 9132,
iast_FULL (14.364 ms) : 14076, 14651
. : milestone, 14364,
iast_GLOBAL (10.299 ms) : 10116, 10483
. : milestone, 10299,
profiling (8.68 ms) : 8540, 8821
. : milestone, 8680,
tracing (7.937 ms) : 7808, 8067
. : milestone, 7937,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section baseline
no_agent (15.025 s) : 15025000, 15025000
. : milestone, 15025000,
appsec (14.811 s) : 14811000, 14811000
. : milestone, 14811000,
iast (18.481 s) : 18481000, 18481000
. : milestone, 18481000,
iast_GLOBAL (18.364 s) : 18364000, 18364000
. : milestone, 18364000,
profiling (15.241 s) : 15241000, 15241000
. : milestone, 15241000,
tracing (14.976 s) : 14976000, 14976000
. : milestone, 14976000,
section candidate
no_agent (14.723 s) : 14723000, 14723000
. : milestone, 14723000,
appsec (14.644 s) : 14644000, 14644000
. : milestone, 14644000,
iast (18.337 s) : 18337000, 18337000
. : milestone, 18337000,
iast_GLOBAL (18.218 s) : 18218000, 18218000
. : milestone, 18218000,
profiling (15.371 s) : 15371000, 15371000
. : milestone, 15371000,
tracing (14.793 s) : 14793000, 14793000
. : milestone, 14793000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~a0d1cf370a, baseline=1.51.0-SNAPSHOT~e68b605ec4
dateFormat X
axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
. : milestone, 1473,
appsec (2.399 ms) : 2350, 2448
. : milestone, 2399,
iast (2.182 ms) : 2120, 2244
. : milestone, 2182,
iast_GLOBAL (2.252 ms) : 2189, 2315
. : milestone, 2252,
profiling (2.05 ms) : 2000, 2101
. : milestone, 2050,
tracing (2.006 ms) : 1958, 2054
. : milestone, 2006,
section candidate
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (2.401 ms) : 2351, 2450
. : milestone, 2401,
iast (2.192 ms) : 2130, 2254
. : milestone, 2192,
iast_GLOBAL (2.233 ms) : 2170, 2295
. : milestone, 2233,
profiling (2.042 ms) : 1992, 2092
. : milestone, 2042,
tracing (2.003 ms) : 1955, 2051
. : milestone, 2003,
|
smola
added a commit
that referenced
this pull request
Jul 2, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Disable #9039
Motivation
We hit GitHub API rate limits too easily. This needs either being called just once per pipeline in an early step, or use pure git heuristics.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]