perf(server): bootstrap engine from persisted projections

[juliusmarminge]

Summary

• initialize the orchestration engine read model from persisted projections after projection bootstrap
• remove the extra startup replay pass over the full orchestration event log
• update orchestration test harnesses to provide the snapshot query dependency during engine startup

Stack

• base: Add open-in-editor feature with Cmd+O shortcut #2 in this stack (codex/backend-perf-message-projection)

Validation

• bun run test src/orchestration/Layers/OrchestrationEngine.test.ts
• bun run test src/orchestration/Layers/ProjectionSnapshotQuery.test.ts src/checkpointing/Layers/CheckpointDiffQuery.test.ts src/persistence/Layers/ProjectionThreadMessages.test.ts src/orchestration/Layers/ProjectionPipeline.test.ts src/orchestration/Layers/OrchestrationEngine.test.ts src/orchestration/Layers/CheckpointReactor.test.ts src/orchestration/Layers/ProviderRuntimeIngestion.test.ts src/orchestration/Layers/ProviderCommandReactor.test.ts
• bun fmt
• bun lint
• bun typecheck (currently fails in apps/web due pre-existing @effect/atom-react / Layer.suspend errors)

---

Note

Medium Risk
Changes orchestration engine startup semantics to seed in-memory state from projection snapshots rather than replaying the full event log; incorrect/missing snapshots could lead to stale read models at boot. Also touches server layer wiring and multiple harness/test compositions, which can cause runtime DI/startup regressions.

Overview
Orchestration engine startup now initializes its in-memory read model from persisted projection snapshots by calling ProjectionSnapshotQuery.getSnapshot() after projection bootstrap, removing the extra full OrchestrationEventStore.readAll() replay pass.

Wires OrchestrationProjectionSnapshotQueryLive as a required dependency throughout runtime composition: refactors server.ts orchestration layers to separate infrastructure vs engine, and updates integration/test harness layers to provide the snapshot query to OrchestrationEngineLive.

Adds a new engine test asserting bootstrap uses snapshots (and fails if historical replay is attempted).

^{Written by Cursor Bugbot for commit 379bef6. This will update automatically on new commits. Configure here.}

Note

Bootstrap orchestration engine read model from persisted projection snapshots instead of event replay

• makeOrchestrationEngine now calls ProjectionSnapshotQuery.getSnapshot() at startup instead of replaying all historical events via OrchestrationEventStore.readAll(), reducing bootstrap time proportional to event history.
• A new OrchestrationProjectionSnapshotQueryLive layer is wired into OrchestrationEngineLive across server.ts, integration harnesses, and all affected test modules.
• ProjectionThreadMessageRepository gains a getByMessageId method returning Option<ProjectionThreadMessage>, used by the thread.message-sent projector in ProjectionPipeline.ts to look up messages directly instead of listing by thread.
• Behavioral Change: the engine's in-memory read model is now seeded from the snapshot store at startup; if snapshots are stale or missing, the engine will not replay missing events to catch up.

^{Macroscope summarized 379bef6.}

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro

Run ID: c8a500a3-aea7-4f8a-9f28-17337bd50529

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch codex/backend-perf-bootstrap

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[macroscopeapp]

Approvability

Verdict: Needs human review

This PR changes the orchestration engine's bootstrap mechanism from event replay to loading from persisted projection snapshots - a significant change to startup behavior that affects how the engine initializes its in-memory state. While the intent is performance improvement, the change to core initialization logic warrants human review.

^{You can customize Macroscope's approvability policy. Learn more.}