Severity: MEDIUM (performance + blocks async migration)
SqlTransform::execute() at transform/lib.rs:568 creates a new tokio::runtime::Builder::new_current_thread() and calls block_on() for every batch. This adds ~100us per batch and will panic when the pipeline migrates to async (cannot call block_on() from within a tokio worker).
Fix
Accept a tokio::Handle from the pipeline. Cache the SessionContext across batches (confirmed safe — SessionContext reuse works with schema changes). Only re-register the MemTable per batch.
Related
Severity: MEDIUM (performance + blocks async migration)
SqlTransform::execute()attransform/lib.rs:568creates a newtokio::runtime::Builder::new_current_thread()and callsblock_on()for every batch. This adds ~100us per batch and will panic when the pipeline migrates to async (cannot callblock_on()from within a tokio worker).Fix
Accept a
tokio::Handlefrom the pipeline. Cache theSessionContextacross batches (confirmed safe — SessionContext reuse works with schema changes). Only re-register the MemTable per batch.Related