Rank of 3301
Known for
Serving a model to real traffic: batching, paged attention and an OpenAI-shaped endpoint.
The serving layer behind a large share of production inference. Low star count relative to its reach, because the people who depend on it are operators rather than browsers.
91.7index score · Open Source
Each factor shows where this entry sits among the 33 ranked on this board. Weights are shared out across the factors we have data for.
—votes · crowd
Reading votes…
Votes are counted separately and published separately. Nothing on this panel is an input to the index score above it, and no amount of voting moves a measured rank.