Raunak Patil

vLLM

High-throughput serving for open models, on your own GPUs.

What it costs
Free and open source
Category
Build with AI
On Radar
Hand-picked by Raunak
Ranks
No. 19 of 764 in Build with AI
Website
docs.vllm.ai ↗
Open docs.vllm.ai ↗See it on Radar

Similar AI tools for building with AI

  1. AI SDKVercel's TypeScript toolkit for streaming chat, tools and agents in web apps.Open source
  2. Transformers.jsRuns Hugging Face models right in the browser, on the GPU with WebGPU.Open source
  3. Model Context ProtocolThe open standard for plugging tools and data into any AI assistant.Open source
  4. UnslothFine-tune open models faster and on far less memory.Open source
  5. StreamlitTurns a Python script into a shareable data or AI app.Open source
  6. GradioQuick web demos for machine-learning models, in a few lines of Python.Open source
Make vLLM? Show it's listed on Radar

Add this badge to your site or README. It links to this page.

Listed on Radar 
<a href="https://raunakpatil.com/ai-tools/tool/vllm"><img src="https://raunakpatil.com/img/badges/listed-on-radar.svg" alt="vLLM is listed on Radar" height="40"></a>
[![Listed on Radar](https://raunakpatil.com/img/badges/listed-on-radar.svg)](https://raunakpatil.com/ai-tools/tool/vllm)