Skip to content

Add benchmark harness: logfwd vs vector vs filebeat#4

Merged
strawgate merged 1 commit into
masterfrom
add-benchmark-harness
Mar 29, 2026
Merged

Add benchmark harness: logfwd vs vector vs filebeat#4
strawgate merged 1 commit into
masterfrom
add-benchmark-harness

Conversation

@strawgate
Copy link
Copy Markdown
Owner

Summary

  • Adds bench/run.sh, a benchmark harness that compares logfwd, vector, and filebeat throughput
  • All three agents send to a shared logfwd blackhole HTTP sink that counts received lines, giving an apples-to-apples comparison with identical I/O overhead
  • Supports --lines to configure workload size and --agents to selectively run specific agents
  • Auto-detects which agents are available on PATH; vector and filebeat are optional
  • Prints a summary table with lines processed, wall-clock time, and throughput (lines/sec)

Test plan

  • Run ./bench/run.sh --lines 100000 --agents logfwd to verify logfwd-only path works
  • Install vector and run ./bench/run.sh --agents logfwd,vector to verify multi-agent comparison
  • Verify cleanup removes temp directory on exit

🤖 Generated with Claude Code

Introduces bench/run.sh which routes all three log agents through a
shared logfwd blackhole HTTP sink for apples-to-apples throughput
comparison. Supports configurable line counts and selective agent runs.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant