Skip to content
#

request-queuing

Here are 7 public repositories matching this topic...

A Go-based request queue and gateway for self-hosted LLM inference with admission control, fair scheduling, rate limiting, deduplication, worker leases, and recovery.

  • Updated Sep 21, 2026
  • Go

Add this topic to your repo

To associate your repository with the request-queuing topic, visit your repo's landing page and select "manage topics."

Learn more