Benchmarks(3)
Every post tagged Benchmarks, newest first.
- How we trained a super fast prompt injection scanner that responds under 100 ms
- Our LLM router runs at 30 ms p50 on an €84/month Hetzner server, no GPU
- Open source Jev alternatives sucks, here is the benchmark