Raunak Patil

mlc-llm

Universal LLM Deployment Engine with ML Compilation

What it costs
Free and open source
Category
Chat & Assistants
On Radar
Open-source project on GitHub, 23,249 stars
Ranks
No. 114 of 644 in Chat & Assistants
Released
29 April 2023
Website
github.com · mlc-ai/mlc-llm ↗
Open github.com ↗See it on Radar

Similar AI chatbots and assistants

  1. happyOrchestrate Claude, Codex and Grok in one app. Open-source (MIT), reuses the subscriptions you already pay for.★ 24,189
  2. 🔥Llava Llama-3 8BMeta Llama3 8b with Llava Multimodal capabilities♥ 89
  3. LlamaoPrivate & offline alternative to ChatGPT on your device▲ 491
  4. ⚡Llama 3- 70B ChatbotLlama 3 chatbot with lightning speed generation (Groq)♥ 80
  5. GPT-4.5The largest and best model for chat yet in GPT family▲ 487
  6. omlxLLM inference server with continuous batching & SSD caching for Apple Silicon, managed from the macOS menu bar★ 22,883
Make mlc-llm? Show it's listed on Radar

Add this badge to your site or README. It links to this page.

Listed on Radar
<a href="https://raunakpatil.com/ai-tools/tool/mlc-llm"><img src="https://raunakpatil.com/img/badges/listed-on-radar.svg" alt="mlc-llm is listed on Radar" height="40"></a>
[![Listed on Radar](https://raunakpatil.com/img/badges/listed-on-radar.svg)](https://raunakpatil.com/ai-tools/tool/mlc-llm)