E2E Scaling POC
A POC investigating infrastructure options for running E2E tests on every PR push and nightly on branches, alongside BrowserStack. A Mac Mini (M4, 32GB) was provisioned as the initial test bed.
On pull requests, E2E tests are opt-in per suite. A checklist of available test suites is presented on the PR, and only the suites selected by the developer will run, not the full regression.
Recommended Approach
iOS on Mac Mini with 4 parallel runners per machine, Android on GHA-hosted runners. Launch is blocked on required E2E test suite changes.
What Was Investigated
| Outcome | |
|---|---|
| iOS Mac Mini | 4 parallel runners viable — stable with optimisations |
| Android Mac Mini | Not recommended — 2 runners max, too costly, too fragile |
| Android GHA hosted | Adopted — more reliable and cost-effective than self-hosted |
| iOS GHA hosted | No POC — costs too high to justify |
Blockers
Several external blockers were identified during the POC that need to be resolved before these tests can be launched.
Codebase
An E2E review identifies issues and improvements in the current test suite.
TODOs
Things still to investigate or complete are tracked in the TODOs.