Implement Config Inversion with Default Strictness of `Warning` #9539

mhlidd · 2025-09-15T21:29:37Z

What Does This Do

This PR implements basic Config Inversion, aiming to document all DD/OTEL environment variables used in the repo in a supported-configurations.json file.

Components:

ConfigInversionStrictStyle.java
- Enum for how strict to run Config Inversion with.
- Options are Strict which does not allow any usage of an unknown DD/OTEL environment variable, Warning which allows the usage but sends telemetry about unknown environment variables, and Test which allows the usage of unknown environment variables without sending telemetry.
- Default value for Strictness is Warning
ConfigHelper.java
- Layer of abstraction between Environment Variable Source and Environment Component that directly compares data loaded from supported-configurations.json to ensure the environment variable queried for is "known"
- Determines what behavior to take given the ConfigInversionStrictStyle that is set.

Motivation

This PR supports the general Config Inversion theme that has already been implemented in dd-trace-js and currently being implemented in dd-trace-go and dd-trace-rb. Here is the RFC that documents what this project entails.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-09-15T22:10:22Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/config_inversion_base
git_commit_date	1758219687	1758242881
git_commit_sha	`1052f49`	`105e2d0`
release_version	1.54.0-SNAPSHOT~1052f4935d	1.54.0-SNAPSHOT~105e2d0f3f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758244746	1758244746
ci_job_id	1137477887	1137477887
ci_pipeline_id	76940079	76940079
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-24hl8rn2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-24hl8rn2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 9 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065657
Total [baseline] (10.71 s) : 0, 10709997
Agent [candidate] (1.061 s) : 0, 1061324
Total [candidate] (10.821 s) : 0, 10820987
section appsec
Agent [baseline] (1.248 s) : 0, 1248405
Total [baseline] (11.094 s) : 0, 11093830
Agent [candidate] (1.238 s) : 0, 1237924
Total [candidate] (11.099 s) : 0, 11098686
section iast
Agent [baseline] (1.192 s) : 0, 1191595
Total [baseline] (11.025 s) : 0, 11024538
Agent [candidate] (1.191 s) : 0, 1191251
Total [candidate] (11.029 s) : 0, 11028834
section profiling
Agent [baseline] (1.211 s) : 0, 1211456
Total [baseline] (10.958 s) : 0, 10957920
Agent [candidate] (1.22 s) : 0, 1219582
Total [candidate] (10.971 s) : 0, 10971481

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.248 s	182.748 ms (17.1%)
Agent	iast	1.192 s	125.938 ms (11.8%)
Agent	profiling	1.211 s	145.799 ms (13.7%)
Total	tracing	10.71 s	-
Total	appsec	11.094 s	383.833 ms (3.6%)
Total	iast	11.025 s	314.541 ms (2.9%)
Total	profiling	10.958 s	247.923 ms (2.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.061 s	-
Agent	appsec	1.238 s	176.6 ms (16.6%)
Agent	iast	1.191 s	129.927 ms (12.2%)
Agent	profiling	1.22 s	158.259 ms (14.9%)
Total	tracing	10.821 s	-
Total	appsec	11.099 s	277.699 ms (2.6%)
Total	iast	11.029 s	207.847 ms (1.9%)
Total	profiling	10.971 s	150.494 ms (1.4%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (735.608 ms) : 0, 735608
BytebuddyAgent [candidate] (732.992 ms) : 0, 732992
GlobalTracer [baseline] (253.383 ms) : 0, 253383
GlobalTracer [candidate] (252.768 ms) : 0, 252768
AppSec [baseline] (30.572 ms) : 0, 30572
AppSec [candidate] (30.611 ms) : 0, 30611
Debugger [baseline] (6.393 ms) : 0, 6393
Debugger [candidate] (6.409 ms) : 0, 6409
Remote Config [baseline] (688.824 µs) : 0, 689
Remote Config [candidate] (685.725 µs) : 0, 686
Telemetry [baseline] (16.411 ms) : 0, 16411
Telemetry [candidate] (15.337 ms) : 0, 15337
section appsec
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.476 ms) : 0, 1476
BytebuddyAgent [baseline] (763.211 ms) : 0, 763211
BytebuddyAgent [candidate] (758.07 ms) : 0, 758070
GlobalTracer [baseline] (250.078 ms) : 0, 250078
GlobalTracer [candidate] (246.428 ms) : 0, 246428
AppSec [baseline] (172.64 ms) : 0, 172640
AppSec [candidate] (171.592 ms) : 0, 171592
Debugger [baseline] (6.132 ms) : 0, 6132
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (645.339 µs) : 0, 645
Remote Config [candidate] (620.539 µs) : 0, 621
Telemetry [baseline] (8.661 ms) : 0, 8661
Telemetry [candidate] (8.521 ms) : 0, 8521
IAST [baseline] (24.154 ms) : 0, 24154
IAST [candidate] (23.918 ms) : 0, 23918
section iast
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (851.662 ms) : 0, 851662
BytebuddyAgent [candidate] (851.781 ms) : 0, 851781
GlobalTracer [baseline] (246.85 ms) : 0, 246850
GlobalTracer [candidate] (248.041 ms) : 0, 248041
AppSec [baseline] (28.243 ms) : 0, 28243
AppSec [candidate] (24.501 ms) : 0, 24501
Debugger [baseline] (6.063 ms) : 0, 6063
Debugger [candidate] (6.064 ms) : 0, 6064
Remote Config [baseline] (619.234 µs) : 0, 619
Remote Config [candidate] (602.185 µs) : 0, 602
Telemetry [baseline] (8.154 ms) : 0, 8154
Telemetry [candidate] (8.138 ms) : 0, 8138
IAST [baseline] (27.402 ms) : 0, 27402
IAST [candidate] (29.654 ms) : 0, 29654
section profiling
ProfilingAgent [baseline] (108.711 ms) : 0, 108711
ProfilingAgent [candidate] (110.07 ms) : 0, 110070
crashtracking [baseline] (1.44 ms) : 0, 1440
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (761.914 ms) : 0, 761914
BytebuddyAgent [candidate] (766.749 ms) : 0, 766749
GlobalTracer [baseline] (233.62 ms) : 0, 233620
GlobalTracer [candidate] (234.658 ms) : 0, 234658
AppSec [baseline] (30.623 ms) : 0, 30623
AppSec [candidate] (30.741 ms) : 0, 30741
Debugger [baseline] (12.312 ms) : 0, 12312
Debugger [candidate] (13.869 ms) : 0, 13869
Remote Config [baseline] (1.485 ms) : 0, 1485
Remote Config [candidate] (718.598 µs) : 0, 719
Telemetry [baseline] (10.211 ms) : 0, 10211
Telemetry [candidate] (9.538 ms) : 0, 9538
Profiling [baseline] (109.344 ms) : 0, 109344
Profiling [candidate] (110.676 ms) : 0, 110676

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1064332
Total [baseline] (8.689 s) : 0, 8689047
Agent [candidate] (1.064 s) : 0, 1064008
Total [candidate] (8.633 s) : 0, 8633044
section iast
Agent [baseline] (1.19 s) : 0, 1190450
Total [baseline] (9.293 s) : 0, 9292670
Agent [candidate] (1.193 s) : 0, 1192725
Total [candidate] (9.326 s) : 0, 9326343

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	iast	1.19 s	126.118 ms (11.8%)
Total	tracing	8.689 s	-
Total	iast	9.293 s	603.623 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.064 s	-
Agent	iast	1.193 s	128.717 ms (12.1%)
Total	tracing	8.633 s	-
Total	iast	9.326 s	693.299 ms (8.0%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (734.143 ms) : 0, 734143
BytebuddyAgent [candidate] (733.988 ms) : 0, 733988
GlobalTracer [baseline] (253.767 ms) : 0, 253767
GlobalTracer [candidate] (253.14 ms) : 0, 253140
AppSec [baseline] (30.655 ms) : 0, 30655
AppSec [candidate] (30.626 ms) : 0, 30626
Debugger [baseline] (6.418 ms) : 0, 6418
Debugger [candidate] (6.412 ms) : 0, 6412
Remote Config [baseline] (698.825 µs) : 0, 699
Remote Config [candidate] (690.672 µs) : 0, 691
Telemetry [baseline] (16.082 ms) : 0, 16082
Telemetry [candidate] (16.603 ms) : 0, 16603
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (851.712 ms) : 0, 851712
BytebuddyAgent [candidate] (853.8 ms) : 0, 853800
GlobalTracer [baseline] (244.853 ms) : 0, 244853
GlobalTracer [candidate] (246.641 ms) : 0, 246641
IAST [baseline] (30.955 ms) : 0, 30955
IAST [candidate] (30.464 ms) : 0, 30464
AppSec [baseline] (25.483 ms) : 0, 25483
AppSec [candidate] (24.633 ms) : 0, 24633
Debugger [baseline] (6.101 ms) : 0, 6101
Debugger [candidate] (6.048 ms) : 0, 6048
Remote Config [baseline] (598.259 µs) : 0, 598
Remote Config [candidate] (592.891 µs) : 0, 593
Telemetry [baseline] (8.349 ms) : 0, 8349
Telemetry [candidate] (8.124 ms) : 0, 8124

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/config_inversion_base
git_commit_date	1758219687	1758242881
git_commit_sha	`1052f49`	`105e2d0`
release_version	1.54.0-SNAPSHOT~1052f4935d	1.54.0-SNAPSHOT~105e2d0f3f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1758244402	1758244402
ci_job_id	1137477888	1137477888
ci_pipeline_id	76940079	76940079
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-3-i9wos5sg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-3-i9wos5sg 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+201.043µs; +552.860µs] or [+2.180%; +5.995%]	unstable [-86.299op/s; +47.299op/s] or [-17.155%; +9.402%]	9.600ms	483.562op/s	9.223ms	503.062op/s
scenario:load:insecure-bank:iast_FULL:high_load	better [-922.983µs; -301.444µs] or [-6.254%; -2.043%]	unstable [-23.194op/s; +50.757op/s] or [-7.346%; +16.075%]	14.146ms	329.531op/s	14.758ms	315.750op/s
scenario:load:petclinic:no_agent:high_load	better [-1.771ms; -1.113ms] or [-4.585%; -2.880%]	unstable [-3.773op/s; +13.123op/s] or [-3.118%; +10.844%]	37.194ms	125.688op/s	38.636ms	121.013op/s
scenario:load:petclinic:profiling:high_load	worse [+1.058ms; +2.005ms] or [+2.276%; +4.312%]	unstable [-10.569op/s; +4.219op/s] or [-10.504%; +4.193%]	48.027ms	97.450op/s	46.496ms	100.625op/s
scenario:load:petclinic:tracing:high_load	better [-2.891ms; -2.035ms] or [-6.275%; -4.417%]	unstable [-1.894op/s; +13.394op/s] or [-1.865%; +13.193%]	43.613ms	107.275op/s	46.077ms	101.525op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.332 ms) : 4281, 4383
.   : milestone, 4332,
iast (9.518 ms) : 9362, 9673
.   : milestone, 9518,
iast_FULL (14.758 ms) : 14463, 15054
.   : milestone, 14758,
iast_GLOBAL (10.557 ms) : 10372, 10742
.   : milestone, 10557,
profiling (9.223 ms) : 9076, 9369
.   : milestone, 9223,
tracing (7.845 ms) : 7736, 7953
.   : milestone, 7845,
section candidate
no_agent (4.22 ms) : 4170, 4270
.   : milestone, 4220,
iast (9.384 ms) : 9231, 9537
.   : milestone, 9384,
iast_FULL (14.146 ms) : 13864, 14428
.   : milestone, 14146,
iast_GLOBAL (10.44 ms) : 10247, 10633
.   : milestone, 10440,
profiling (9.6 ms) : 9421, 9779
.   : milestone, 9600,
tracing (8.002 ms) : 7882, 8122
.   : milestone, 8002,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.332 ms [4.281 ms, 4.383 ms]	-
iast	9.518 ms [9.362 ms, 9.673 ms]	5.186 ms (119.7%)
iast_FULL	14.758 ms [14.463 ms, 15.054 ms]	10.426 ms (240.7%)
iast_GLOBAL	10.557 ms [10.372 ms, 10.742 ms]	6.225 ms (143.7%)
profiling	9.223 ms [9.076 ms, 9.369 ms]	4.891 ms (112.9%)
tracing	7.845 ms [7.736 ms, 7.953 ms]	3.513 ms (81.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.22 ms [4.17 ms, 4.27 ms]	-
iast	9.384 ms [9.231 ms, 9.537 ms]	5.164 ms (122.4%)
iast_FULL	14.146 ms [13.864 ms, 14.428 ms]	9.926 ms (235.2%)
iast_GLOBAL	10.44 ms [10.247 ms, 10.633 ms]	6.22 ms (147.4%)
profiling	9.6 ms [9.421 ms, 9.779 ms]	5.38 ms (127.5%)
tracing	8.002 ms [7.882 ms, 8.122 ms]	3.782 ms (89.6%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.636 ms) : 38318, 38954
.   : milestone, 38636,
appsec (48.218 ms) : 47784, 48651
.   : milestone, 48218,
code_origins (45.706 ms) : 45314, 46098
.   : milestone, 45706,
iast (46.001 ms) : 45594, 46407
.   : milestone, 46001,
profiling (46.496 ms) : 46068, 46923
.   : milestone, 46496,
tracing (46.077 ms) : 45657, 46496
.   : milestone, 46077,
section candidate
no_agent (37.194 ms) : 36900, 37488
.   : milestone, 37194,
appsec (49.474 ms) : 49062, 49887
.   : milestone, 49474,
code_origins (46.705 ms) : 46310, 47101
.   : milestone, 46705,
iast (44.847 ms) : 44460, 45233
.   : milestone, 44847,
profiling (48.027 ms) : 47576, 48479
.   : milestone, 48027,
tracing (43.613 ms) : 43239, 43988
.   : milestone, 43613,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	38.636 ms [38.318 ms, 38.954 ms]	-
appsec	48.218 ms [47.784 ms, 48.651 ms]	9.582 ms (24.8%)
code_origins	45.706 ms [45.314 ms, 46.098 ms]	7.07 ms (18.3%)
iast	46.001 ms [45.594 ms, 46.407 ms]	7.365 ms (19.1%)
profiling	46.496 ms [46.068 ms, 46.923 ms]	7.86 ms (20.3%)
tracing	46.077 ms [45.657 ms, 46.496 ms]	7.441 ms (19.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.194 ms [36.9 ms, 37.488 ms]	-
appsec	49.474 ms [49.062 ms, 49.887 ms]	12.281 ms (33.0%)
code_origins	46.705 ms [46.31 ms, 47.101 ms]	9.512 ms (25.6%)
iast	44.847 ms [44.46 ms, 45.233 ms]	7.653 ms (20.6%)
profiling	48.027 ms [47.576 ms, 48.479 ms]	10.833 ms (29.1%)
tracing	43.613 ms [43.239 ms, 43.988 ms]	6.419 ms (17.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/config_inversion_base
git_commit_date	1758219687	1758242881
git_commit_sha	`1052f49`	`105e2d0`
release_version	1.54.0-SNAPSHOT~1052f4935d	1.54.0-SNAPSHOT~105e2d0f3f

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1758244874	1758244874
ci_job_id	1137477889	1137477889
ci_pipeline_id	76940079	76940079
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-1zhmj6iq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-1zhmj6iq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.497 s) : 15497000, 15497000
.   : milestone, 15497000,
appsec (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
iast (18.62 s) : 18620000, 18620000
.   : milestone, 18620000,
iast_GLOBAL (18.15 s) : 18150000, 18150000
.   : milestone, 18150000,
profiling (16.055 s) : 16055000, 16055000
.   : milestone, 16055000,
tracing (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
section candidate
no_agent (15.285 s) : 15285000, 15285000
.   : milestone, 15285000,
appsec (14.702 s) : 14702000, 14702000
.   : milestone, 14702000,
iast (18.629 s) : 18629000, 18629000
.   : milestone, 18629000,
iast_GLOBAL (18.087 s) : 18087000, 18087000
.   : milestone, 18087000,
profiling (15.318 s) : 15318000, 15318000
.   : milestone, 15318000,
tracing (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.497 s [15.497 s, 15.497 s]	-
appsec	15.028 s [15.028 s, 15.028 s]	-469.0 ms (-3.0%)
iast	18.62 s [18.62 s, 18.62 s]	3.123 s (20.2%)
iast_GLOBAL	18.15 s [18.15 s, 18.15 s]	2.653 s (17.1%)
profiling	16.055 s [16.055 s, 16.055 s]	558.0 ms (3.6%)
tracing	15.057 s [15.057 s, 15.057 s]	-440.0 ms (-2.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.285 s [15.285 s, 15.285 s]	-
appsec	14.702 s [14.702 s, 14.702 s]	-583.0 ms (-3.8%)
iast	18.629 s [18.629 s, 18.629 s]	3.344 s (21.9%)
iast_GLOBAL	18.087 s [18.087 s, 18.087 s]	2.802 s (18.3%)
profiling	15.318 s [15.318 s, 15.318 s]	33.0 ms (0.2%)
tracing	15.023 s [15.023 s, 15.023 s]	-262.0 ms (-1.7%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~105e2d0f3f, baseline=1.54.0-SNAPSHOT~1052f4935d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (3.734 ms) : 3515, 3953
.   : milestone, 3734,
iast (2.205 ms) : 2142, 2267
.   : milestone, 2205,
iast_GLOBAL (2.262 ms) : 2199, 2326
.   : milestone, 2262,
profiling (2.058 ms) : 2007, 2108
.   : milestone, 2058,
tracing (2.046 ms) : 1997, 2096
.   : milestone, 2046,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (3.71 ms) : 3496, 3925
.   : milestone, 3710,
iast (2.216 ms) : 2153, 2279
.   : milestone, 2216,
iast_GLOBAL (2.262 ms) : 2198, 2325
.   : milestone, 2262,
profiling (2.052 ms) : 2002, 2103
.   : milestone, 2052,
tracing (2.034 ms) : 1985, 2083
.   : milestone, 2034,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.471 ms, 1.494 ms]	-
appsec	3.734 ms [3.515 ms, 3.953 ms]	2.251 ms (151.8%)
iast	2.205 ms [2.142 ms, 2.267 ms]	721.641 µs (48.7%)
iast_GLOBAL	2.262 ms [2.199 ms, 2.326 ms]	779.519 µs (52.6%)
profiling	2.058 ms [2.007 ms, 2.108 ms]	574.825 µs (38.8%)
tracing	2.046 ms [1.997 ms, 2.096 ms]	563.236 µs (38.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.467 ms, 1.49 ms]	-
appsec	3.71 ms [3.496 ms, 3.925 ms]	2.232 ms (151.0%)
iast	2.216 ms [2.153 ms, 2.279 ms]	737.188 µs (49.9%)
iast_GLOBAL	2.262 ms [2.198 ms, 2.325 ms]	783.102 µs (53.0%)
profiling	2.052 ms [2.002 ms, 2.103 ms]	574.028 µs (38.8%)
tracing	2.034 ms [1.985 ms, 2.083 ms]	555.266 µs (37.6%)

datadog-official · 2025-09-16T18:23:19Z

🎯 Code Coverage
• Patch Coverage: 66.67%
• Total Coverage: 57.83%

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 105e2d0 | Docs | Was this helpful? Give us feedback!}

github-actions · 2025-09-18T15:13:54Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

…nversion_base

mhlidd force-pushed the mhlidd/config_inversion_base branch 2 times, most recently from 1a576ea to 512b2c6 Compare September 15, 2025 21:34

mhlidd changed the title ~~Mhlidd/config inversion base~~ Implement Config Inversion with Default Strictness of Warning Sep 17, 2025

mhlidd marked this pull request as ready for review September 18, 2025 15:13

mhlidd requested review from a team as code owners September 18, 2025 15:13

mhlidd requested review from AlexeyKuznetsov-DD and mcculls and removed request for a team September 18, 2025 15:13

mhlidd added type: enhancement Enhancements and improvements type: documentation comp: api Tracer public API labels Sep 18, 2025

mhlidd requested a review from PerfectSlayer September 18, 2025 15:15

mhlidd mentioned this pull request Sep 18, 2025

Adding supported-configurations.json file #9563

Open

mhlidd changed the base branch from master to mhlidd/config_inversion_plugins September 18, 2025 21:25

mhlidd force-pushed the mhlidd/config_inversion_base branch from aa18112 to 606dfd0 Compare September 18, 2025 21:32

mhlidd changed the base branch from mhlidd/config_inversion_plugins to mhlidd/migrate_config-utils_tests September 18, 2025 22:06

mhlidd added 7 commits September 18, 2025 15:07

config inversion init

1e41f36

migrating config-utils tests

30069bb

undo move of test files that rely on inject*config

5ff3e33

adding deprecation handling

b314695

updating tests

2da0906

spotless

24afc25

updating code coverage

7cea99b

mhlidd force-pushed the mhlidd/config_inversion_base branch from 606dfd0 to 7cea99b Compare September 18, 2025 22:09

mhlidd added 2 commits September 18, 2025 17:07

Merge branch 'mhlidd/migrate_config-utils_tests' into mhlidd/config_i…

d3b95c1

…nversion_base

Merge branch 'mhlidd/migrate_config-utils_tests' into mhlidd/config_i…

105e2d0

…nversion_base

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Implement Config Inversion with Default Strictness of `Warning` #9539

Implement Config Inversion with Default Strictness of `Warning` #9539

mhlidd commented Sep 15, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Sep 15, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Sep 16, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading

Uh oh!

github-actions bot commented Sep 18, 2025

Uh oh!

Uh oh!

Implement Config Inversion with Default Strictness of Warning #9539

Are you sure you want to change the base?

Implement Config Inversion with Default Strictness of Warning #9539

Conversation

mhlidd commented Sep 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Sep 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

datadog-official bot commented Sep 16, 2025 • edited by datadog-datadog-prod-us1 bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Sep 18, 2025

Uh oh!

Uh oh!

Implement Config Inversion with Default Strictness of `Warning` #9539

Implement Config Inversion with Default Strictness of `Warning` #9539

mhlidd commented Sep 15, 2025 •

edited

Loading

pr-commenter bot commented Sep 15, 2025 •

edited

Loading

datadog-official bot commented Sep 16, 2025 •

edited by datadog-datadog-prod-us1 bot

Loading