feat: replace `StreamReader/Writer` with `FileReader/Writer`#1193

Closed

de-sh wants to merge 40 commits intoparseablehq:mainfrom

de-sh:filewriter

Commits on Feb 17, 2025

feat: replace `StreamReader`/`StreamWriter` with `FileReader`/`FileWriter`
Devdutt Shenoi
committed
refactor: can't err
Devdutt Shenoi
committed

Commits on Feb 19, 2025

Merge branch 'main' into filewriter
Devdutt Shenoi
authored

Commits on Feb 20, 2025

Merge remote-tracking branch 'origin/main' into filewriter
Devdutt Shenoi
committed
fix: query logs from on-disk arrow files
Devdutt Shenoi
committed
fix: `create_dir_all`
Devdutt Shenoi
committed
fix: convert only finished arrow files
Devdutt Shenoi
committed
fix: limit to 1684 rows per arrow file
Devdutt Shenoi
committed
test: no `manual_write` and fix read order
Devdutt Shenoi
committed
Merge branch 'main' into filewriter
Devdutt Shenoi
authored

Commits on Feb 21, 2025

log: don't log "string files"
Devdutt Shenoi
committed
Merge branch 'main' into filewriter
nikhilsinhaparseable
authored
fix: increment row count
Devdutt Shenoi
committed
fix: don't drop in-memory records
Devdutt Shenoi
committed
fix: `.arrows` naming convention
Devdutt Shenoi
committed
fix: actually replace with new file
Devdutt Shenoi
committed
ci: clippy suggestion
Devdutt Shenoi
committed
fix: properly group arrows into parquet
Devdutt Shenoi
committed
file type is known
Devdutt Shenoi
committed
refactor: simplify in-mem threshold handling
Devdutt Shenoi
committed
don't panic!
Devdutt Shenoi
committed
fix: panic on unexpected filename structure
Devdutt Shenoi
committed
fix: consider custom partitions
Devdutt Shenoi
committed
doc: custom parition limits
Devdutt Shenoi
committed
doc: improve explainers
Devdutt Shenoi
committed
doc: `arrow_path_to_parquet`
Devdutt Shenoi
committed

Commits on Feb 22, 2025

revert: all writes into a single file
Devdutt Shenoi
committed
limit record_batch row count
Devdutt Shenoi
committed

Commits on Feb 28, 2025

Merge remote-tracking branch 'origin/main' into filewriter
Devdutt Shenoi
committed
fix: don't count `part.arrows`
Devdutt Shenoi
committed
match with regex
Devdutt Shenoi
committed

Commits on Mar 14, 2025

Merge remote-tracking branch 'origin/main' into filewriter
Devdutt Shenoi
committed
fix: reverse ordering of rbs
Devdutt Shenoi
committed
clippy suggestion
Devdutt Shenoi
committed
style: coderabbit suggestion
Devdutt Shenoi
committed

Commits on Mar 16, 2025

Merge remote-tracking branch 'origin/main' into filewriter
Devdutt Shenoi
committed
Merge branch 'main' into filewriter
Devdutt Shenoi
authored
doc+test: improvements
Devdutt Shenoi
committed
refactor: declutter by separating out into #1239
Devdutt Shenoi
committed

Commits on Mar 24, 2025

Merge remote-tracking branch 'origin/main' into filewriter
Devdutt Shenoi
committed