Skip to content

tests: add load tests to the cache ingestion and simulation loop#236

Merged
dylanlott merged 6 commits intomainfrom
dylan/load-test-bundle-sim
Apr 8, 2026
Merged

tests: add load tests to the cache ingestion and simulation loop#236
dylanlott merged 6 commits intomainfrom
dylan/load-test-bundle-sim

Conversation

@dylanlott
Copy link
Copy Markdown
Contributor

@dylanlott dylanlott commented Mar 4, 2026

tests: add load tests to the cache ingestion and simulation loop

Per discussions with @Fraser999 I load tested the builder simulation loop and was able to reproduce the same error they saw - the build function deadlocks over some limit of bundles, which also prevents the simulation deadline from being respected.

image.png

The screenshot shows the test running and taking over 60 seconds, but with the deadline configured for 12 seconds, which should terminate the build loop and return a block with tx_count > 0.

Copy link
Copy Markdown
Contributor Author

dylanlott commented Mar 4, 2026

@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch from 7697e42 to d99e2c8 Compare March 4, 2026 01:06
Copy link
Copy Markdown
Contributor Author

The 50k test won't pass so this PR shouldn't be merged until the simulation deadlock issue is resolved.

@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch from acec1af to def269d Compare March 11, 2026 01:46
Copy link
Copy Markdown
Contributor Author

I thought the deadlock issue would solve the 50k test, but it still fails, but not sure what the root cause is yet.

@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch from ba26c1a to edbd58d Compare March 11, 2026 06:11
@dylanlott dylanlott marked this pull request as ready for review March 11, 2026 06:12
Copy link
Copy Markdown
Contributor Author

Update: It wasn't a deadlock, it was a very long running test from a runtime blow up. The blow up was caused by a priority fee collision at insertion time. After assigning different priority fees, tests pass.

@Evalir
Copy link
Copy Markdown
Member

Evalir commented Mar 11, 2026

Update: It wasn't a deadlock, it was a very long running test from a runtime blow up. The blow up was caused by a priority fee collision at insertion time

This seems worth looking into?

@Fraser999 Fraser999 force-pushed the dylan/load-test-bundle-sim branch from edbd58d to a45baef Compare March 12, 2026 18:00
@prestwich
Copy link
Copy Markdown
Member

[Claude Code]

Linking to Linear: ENG-1950 — Load test the builder simulation loop

@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch 2 times, most recently from 62f7066 to e37ea16 Compare March 25, 2026 03:20
@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch 2 times, most recently from 6f17cde to 997c4f1 Compare March 25, 2026 15:55
@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch 3 times, most recently from 0c5769b to 707f252 Compare March 27, 2026 05:04
@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch from 707f252 to 82fba21 Compare March 27, 2026 19:56
@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch 2 times, most recently from 4d8d1e1 to f288fbd Compare April 8, 2026 03:32
Base automatically changed from dylan/sim-tests to main April 8, 2026 04:06
- every bundle had the same effective fee score, so cache insertion hit heavy rank collision
@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch from f288fbd to 1621bdf Compare April 8, 2026 20:40
@dylanlott dylanlott force-pushed the dylan/load-test-bundle-sim branch from 1621bdf to 0549b63 Compare April 8, 2026 21:40
@dylanlott dylanlott merged commit 42fbe08 into main Apr 8, 2026
7 checks passed
@dylanlott dylanlott deleted the dylan/load-test-bundle-sim branch April 8, 2026 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants