beops
now

what i'm on, right now.

last updated2026-06-08 · what's a /now page?

shipping

building llm-batcher, an openai-shaped proxy in front of claude. it translates the openai and anthropic shapes both ways, microbatches concurrent requests into short admission windows, and watches itself through an opt-in /metrics snapshot (p50/p95/p99 latency plus an estimated dollar cost). distributed-systems instincts pointed at llm serving.

   openai client                        claude
        |  POST /v1/chat/completions    ^
        v                               |  /v1/messages
+---------------------------------------------------+
|                    llm-batcher                    |
|        translate  |  microbatch  |  observe       |
+---------------------------------------------------+
                          |
         GET /metrics  ->  p50 / p95 / p99  +  $cost
# this page is hand-edited. when it goes stale, it goes stale.