test: This is a test of #35905 #35913

Gudahtt · 2025-09-12T17:29:11Z

Description

This is a test for the workflow changes in #35905

Changelog

CHANGELOG entry: null

Related issues

This is a combination of #35905 and #35906

Manual testing steps

N/A

Screenshots/Recordings

N/A

Pre-merge author checklist

I've followed MetaMask Contributor Docs and MetaMask Extension Coding Standards.
I've completed the PR template to the best of my ability
I’ve included tests if applicable
I’ve documented my code using JSDoc format if applicable
I’ve applied the right labels on the PR (see labeling guidelines). Not required for external contributors.

Pre-merge reviewer checklist

I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

The script responsible for determining how to split up tests in a given workflow was failing when I tried to add a new workflow. It didn't seem to handle the case where a workflow had zero past runs. It has been updated to use a naive fallback splitting algorithm in this case.

Add a new test workflow for E2E tests using `dist` builds. Currently this workflow has just one test suite in it, the vault decryption test. More will be added in later PRs. This was split out from #31435

metamaskbot · 2025-09-12T17:54:54Z

📊 Page Load Benchmark Results

Current Commit: 9356cbf | Date: 9/12/2025

📄 Localhost MetaMask Test Dapp

Samples: 100

Summary

pageLoadTime-> current mean value: 1.04s (±70ms) 🟡 | historical mean value: 1.05s ⬇️ (historical data)
domContentLoaded-> current mean value: 729ms (±67ms) 🟢 | historical mean value: 736ms ⬇️ (historical data)
firstContentfulPaint-> current mean value: 75ms (±15ms) 🟢 | historical mean value: 79ms ⬇️ (historical data)

📈 Detailed Results

Metric	Mean	Std Dev	Min	Max	P95	P99
pageLoadTime	1.04s	70ms	997ms	1.32s	1.26s	1.32s
domContentLoaded	729ms	67ms	691ms	991ms	931ms	991ms
firstPaint	75ms	15ms	56ms	204ms	84ms	204ms
firstContentfulPaint	75ms	15ms	56ms	204ms	84ms	204ms
largestContentfulPaint	0ms	0ms	0ms	0ms	0ms	0ms

Results generated automatically by MetaMask CI

metamaskbot · 2025-09-12T17:55:08Z

Builds ready [9356cbf]

builds: chrome, firefox
builds (beta): chrome, firefox
builds (flask): chrome, firefox
builds (test): chrome, firefox
builds (test-flask): chrome, firefox
build viz: Build System
bundle size: Bundle Size Stats
user-actions-benchmark: User Actions Stats
storybook: Storybook
typescript migration: Dashboard
all artifacts
bundle viz:
- background: 0, 1, 2, 3, 4, 5, 6, 7, 8
- common: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12
- ui: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15
- content-script: 0
- offscreen: 0

UI Startup Metrics (1228 ± 60 ms)

Platform	BuildType	Page	Metric	Mean (ms)	Min (ms)	Max (ms)	Std Dev (ms)	P 75 (ms)	P 95 (ms)
Chrome	Browserify	Home	uiStartup	1228	1118	1455	60	1261	1324
			load	1062	960	1239	57	1093	1169
			domContentLoaded	1055	949	1224	57	1085	1162
			domInteractive	18	14	54	7	17	39
			firstPaint	674	110	1220	425	1074	1139
			backgroundConnect	250	238	283	8	254	264
			firstReactRender	25	17	55	7	26	38
			getState	14	5	37	7	16	29
			initialActions	5	0	43	5	6	12
			loadScripts	811	706	985	56	840	914
			setupStore	9	6	26	3	10	15
	Webpack	Home	uiStartup	1931	1459	2465	279	2136	2412
			load	1551	1179	1905	212	1710	1871
			domContentLoaded	1538	1174	1899	212	1696	1863
			domInteractive	17	12	118	14	14	52
			firstPaint	158	70	392	58	173	264
			backgroundConnect	35	16	347	46	30	58
			firstReactRender	91	35	348	88	74	319
			getState	27	5	289	64	13	274
			initialActions	5	2	16	3	6	12
			loadScripts	1534	1170	1897	210	1692	1851
			setupStore	22	6	299	54	13	28
Firefox	Browserify	Home	uiStartup	1433	1238	1936	118	1482	1649
			load	1241	1087	1577	83	1297	1384
			domContentLoaded	1241	1087	1576	83	1296	1383
			domInteractive	109	34	371	61	121	263
			firstPaint	NaN	NaN	NaN	NaN	NaN	NaN
			backgroundConnect	38	18	190	29	37	106
			firstReactRender	28	23	66	6	30	34
			getState	8	3	111	12	6	20
			initialActions	4	1	48	6	3	10
			loadScripts	1211	1063	1401	75	1266	1336
			setupStore	9	5	74	8	8	27
	Webpack	Home	uiStartup	1571	1384	1941	154	1678	1872
			load	1341	1167	1686	133	1452	1598
			domContentLoaded	1341	1166	1686	133	1452	1598
			domInteractive	109	33	310	67	97	290
			firstPaint	NaN	NaN	NaN	NaN	NaN	NaN
			backgroundConnect	32	22	89	8	36	40
			firstReactRender	43	36	56	4	46	50
			getState	7	3	162	16	6	9
			initialActions	3	1	24	3	3	6
			loadScripts	1318	1149	1666	134	1432	1574
			setupStore	10	5	142	15	9	17

Benchmark value 251 exceeds gate value 10 for chrome browserify home mean backgroundConnect
Benchmark value 25 exceeds gate value 23 for chrome browserify home mean firstReactRender
Benchmark value 5 exceeds gate value 1 for chrome browserify home mean initialActions
Benchmark value 265 exceeds gate value 18 for chrome browserify home p95 backgroundConnect
Benchmark value 12 exceeds gate value 1.2 for chrome browserify home p95 initialActions
Benchmark value 274 exceeds gate value 195 for chrome webpack home p95 getState
Benchmark value 12 exceeds gate value 7 for chrome webpack home p95 initialActions
Benchmark value 1433 exceeds gate value 1405 for firefox browserify home mean uiStartup
Benchmark value 1241 exceeds gate value 1239 for firefox browserify home mean domContentLoaded
Benchmark value 38 exceeds gate value 25 for firefox browserify home mean backgroundConnect
Benchmark value 29 exceeds gate value 25 for firefox browserify home mean firstReactRender
Benchmark value 4 exceeds gate value 1 for firefox browserify home mean initialActions
Benchmark value 10 exceeds gate value 9 for firefox browserify home mean setupStore
Benchmark value 263 exceeds gate value 195 for firefox browserify home p95 domInteractive
Benchmark value 106 exceeds gate value 70 for firefox browserify home p95 backgroundConnect
Benchmark value 10 exceeds gate value 2 for firefox browserify home p95 initialActions
Benchmark value 109 exceeds gate value 100 for firefox webpack home mean domInteractive
Benchmark value 32 exceeds gate value 26 for firefox webpack home mean backgroundConnect
Benchmark value 44 exceeds gate value 38 for firefox webpack home mean firstReactRender
Benchmark value 3 exceeds gate value 1 for firefox webpack home mean initialActions
Benchmark value 290 exceeds gate value 156 for firefox webpack home p95 domInteractive
Benchmark value 6 exceeds gate value 2 for firefox webpack home p95 initialActions
Sum of mean exceeds: 321ms | Sum of p95 exceeds: 591.8ms
Sum of all benchmark exceeds: 912.8ms

Bundle size diffs [🚨 Warning! Bundle size has increased!]

background: 32.42 KiB (0.72%)
ui: -3 Bytes (0%)
common: 1.69 KiB (0.02%)

metamaskbot · 2025-09-12T18:32:38Z

📊 Page Load Benchmark Results

Current Commit: bcc974a | Date: 9/12/2025

📄 Localhost MetaMask Test Dapp

Samples: 100

Summary

pageLoadTime-> current mean value: 1.05s (±71ms) 🟡 | historical mean value: 1.05s ⬇️ (historical data)
domContentLoaded-> current mean value: 738ms (±85ms) 🟢 | historical mean value: 736ms ⬆️ (historical data)
firstContentfulPaint-> current mean value: 79ms (±43ms) 🟢 | historical mean value: 79ms ⬆️ (historical data)

📈 Detailed Results

Metric	Mean	Std Dev	Min	Max	P95	P99
pageLoadTime	1.05s	71ms	1.01s	1.34s	1.26s	1.34s
domContentLoaded	738ms	85ms	696ms	1.30s	939ms	1.30s
firstPaint	79ms	43ms	60ms	508ms	84ms	508ms
firstContentfulPaint	79ms	43ms	60ms	508ms	84ms	508ms
largestContentfulPaint	0ms	0ms	0ms	0ms	0ms	0ms

Results generated automatically by MetaMask CI

metamaskbot · 2025-09-12T18:32:48Z

Builds ready [bcc974a]

builds: chrome, firefox
builds (beta): chrome, firefox
builds (flask): chrome, firefox
builds (test): chrome, firefox
builds (test-flask): chrome, firefox
build viz: Build System
bundle size: Bundle Size Stats
user-actions-benchmark: User Actions Stats
storybook: Storybook
typescript migration: Dashboard
all artifacts
bundle viz:
- background: 0, 1, 2, 3, 4, 5, 6, 7, 8
- common: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12
- ui: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15
- content-script: 0
- offscreen: 0

UI Startup Metrics (1236 ± 69 ms)

Platform	BuildType	Page	Metric	Mean (ms)	Min (ms)	Max (ms)	Std Dev (ms)	P 75 (ms)	P 95 (ms)
Chrome	Browserify	Home	uiStartup	1236	1092	1470	69	1281	1344
			load	1072	965	1269	63	1116	1185
			domContentLoaded	1065	958	1262	63	1110	1178
			domInteractive	18	13	50	7	17	38
			firstPaint	603	73	1271	437	1072	1161
			backgroundConnect	248	234	269	7	251	263
			firstReactRender	24	18	41	5	28	35
			getState	14	5	42	7	16	28
			initialActions	5	0	63	7	6	15
			loadScripts	824	721	1012	61	872	927
			setupStore	10	5	27	4	11	19
	Webpack	Home	uiStartup	1996	1456	2720	290	2182	2495
			load	1597	1168	2089	221	1755	1910
			domContentLoaded	1590	1161	2078	220	1745	1899
			domInteractive	17	12	99	12	15	47
			firstPaint	163	61	508	64	178	296
			backgroundConnect	31	16	334	32	29	63
			firstReactRender	86	34	337	73	77	309
			getState	38	5	301	79	15	270
			initialActions	6	2	34	5	6	17
			loadScripts	1586	1159	2065	219	1742	1896
			setupStore	26	6	293	58	14	244
Firefox	Browserify	Home	uiStartup	1386	1187	1827	112	1436	1616
			load	1197	1038	1467	82	1255	1354
			domContentLoaded	1197	1038	1467	82	1254	1354
			domInteractive	104	34	323	54	108	234
			firstPaint	NaN	NaN	NaN	NaN	NaN	NaN
			backgroundConnect	34	20	142	18	36	57
			firstReactRender	27	23	41	3	29	32
			getState	6	3	26	4	6	13
			initialActions	5	1	211	21	3	10
			loadScripts	1171	1015	1449	82	1229	1328
			setupStore	10	4	93	14	8	42
	Webpack	Home	uiStartup	1573	1370	1993	151	1659	1916
			load	1343	1174	1706	132	1434	1560
			domContentLoaded	1342	1173	1706	132	1433	1560
			domInteractive	105	30	321	62	104	293
			firstPaint	NaN	NaN	NaN	NaN	NaN	NaN
			backgroundConnect	32	21	58	7	36	45
			firstReactRender	43	30	67	5	46	53
			getState	6	3	11	2	6	9
			initialActions	3	1	63	6	3	5
			loadScripts	1320	1148	1676	133	1414	1541
			setupStore	12	5	151	20	9	22

Benchmark value 1237 exceeds gate value 1234 for chrome browserify home mean uiStartup
Benchmark value 1072 exceeds gate value 1070 for chrome browserify home mean load
Benchmark value 1065 exceeds gate value 1061 for chrome browserify home mean domContentLoaded
Benchmark value 248 exceeds gate value 10 for chrome browserify home mean backgroundConnect
Benchmark value 25 exceeds gate value 23 for chrome browserify home mean firstReactRender
Benchmark value 6 exceeds gate value 1 for chrome browserify home mean initialActions
Benchmark value 263 exceeds gate value 18 for chrome browserify home p95 backgroundConnect
Benchmark value 15 exceeds gate value 1.2 for chrome browserify home p95 initialActions
Benchmark value 19 exceeds gate value 17 for chrome browserify home p95 setupStore
Benchmark value 39 exceeds gate value 29 for chrome webpack home mean getState
Benchmark value 2495 exceeds gate value 2454 for chrome webpack home p95 uiStartup
Benchmark value 270 exceeds gate value 195 for chrome webpack home p95 getState
Benchmark value 17 exceeds gate value 7 for chrome webpack home p95 initialActions
Benchmark value 244 exceeds gate value 65 for chrome webpack home p95 setupStore
Benchmark value 34 exceeds gate value 25 for firefox browserify home mean backgroundConnect
Benchmark value 27 exceeds gate value 25 for firefox browserify home mean firstReactRender
Benchmark value 6 exceeds gate value 1 for firefox browserify home mean initialActions
Benchmark value 11 exceeds gate value 9 for firefox browserify home mean setupStore
Benchmark value 234 exceeds gate value 195 for firefox browserify home p95 domInteractive
Benchmark value 10 exceeds gate value 2 for firefox browserify home p95 initialActions
Benchmark value 42 exceeds gate value 27 for firefox browserify home p95 setupStore
Benchmark value 105 exceeds gate value 100 for firefox webpack home mean domInteractive
Benchmark value 32 exceeds gate value 26 for firefox webpack home mean backgroundConnect
Benchmark value 44 exceeds gate value 38 for firefox webpack home mean firstReactRender
Benchmark value 4 exceeds gate value 1 for firefox webpack home mean initialActions
Benchmark value 293 exceeds gate value 156 for firefox webpack home p95 domInteractive
Benchmark value 53 exceeds gate value 50 for firefox webpack home p95 firstReactRender
Benchmark value 5 exceeds gate value 2 for firefox webpack home p95 initialActions
Sum of mean exceeds: 302ms | Sum of p95 exceeds: 770.8ms
Sum of all benchmark exceeds: 1072.8ms

Bundle size diffs [🚨 Warning! Bundle size has increased!]

background: 32.42 KiB (0.72%)
ui: -3 Bytes (0%)
common: 1.69 KiB (0.02%)

Gudahtt added 3 commits September 12, 2025 13:28

test: Add new test job for dist tests

472129e

Add a new test workflow for E2E tests using `dist` builds. Currently this workflow has just one test suite in it, the vault decryption test. More will be added in later PRs. This was split out from #31435

Fix imports

9356cbf

metamaskbot added team-core-platform Core Platform team INVALID-PR-TEMPLATE PR's body doesn't match template labels Sep 12, 2025

github-actions bot added the size-S label Sep 12, 2025

Gudahtt mentioned this pull request Sep 12, 2025

test: Update test splitting to support new test workflows #35905

Open

7 tasks

Skip vault decryption on Firefox

bcc974a

metamaskbot removed the INVALID-PR-TEMPLATE PR's body doesn't match template label Sep 12, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

test: This is a test of #35905 #35913

test: This is a test of #35905 #35913

Gudahtt commented Sep 12, 2025 •

edited

Loading

Uh oh!

metamaskbot commented Sep 12, 2025

Uh oh!

metamaskbot commented Sep 12, 2025

Uh oh!

metamaskbot commented Sep 12, 2025

Uh oh!

metamaskbot commented Sep 12, 2025

Uh oh!

Uh oh!

test: This is a test of #35905 #35913

Are you sure you want to change the base?

test: This is a test of #35905 #35913

Conversation

Gudahtt commented Sep 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Changelog

Related issues

Manual testing steps

Screenshots/Recordings

Pre-merge author checklist

Pre-merge reviewer checklist

Uh oh!

metamaskbot commented Sep 12, 2025

📊 Page Load Benchmark Results

📄 Localhost MetaMask Test Dapp

Summary

Uh oh!

metamaskbot commented Sep 12, 2025

Uh oh!

metamaskbot commented Sep 12, 2025

📊 Page Load Benchmark Results

📄 Localhost MetaMask Test Dapp

Summary

Uh oh!

metamaskbot commented Sep 12, 2025

Uh oh!

Uh oh!

Gudahtt commented Sep 12, 2025 •

edited

Loading