Raunak Patil

llama.cpp

Runs language models efficiently on ordinary CPUs and GPUs, in C++.

What it costs
Free and open source
Category
Build with AI
On Radar
Hand-picked by Raunak
Ranks
No. 55 of 764 in Build with AI
Website
github.com ↗
Open github.com ↗See it on Radar

Similar AI tools for building with AI

  1. AutoGenMicrosoft's framework for agents that work together in conversation.Open source
  2. HaystackAn open-source framework for RAG pipelines and agents in production.Open source
  3. DSPyProgram language models instead of prompting them, and optimise automatically.Open source
  4. MLXApple's array framework for machine learning on Apple silicon.Open source
  5. PyTorchThe deep-learning framework most AI research and models are built with.Open source
  6. TensorFlowGoogle's end-to-end platform for machine learning.Open source
Make llama.cpp? Show it's listed on Radar

Add this badge to your site or README. It links to this page.

Listed on Radar 
<a href="https://raunakpatil.com/ai-tools/tool/llama-cpp"><img src="https://raunakpatil.com/img/badges/listed-on-radar.svg" alt="llama.cpp is listed on Radar" height="40"></a>
[![Listed on Radar](https://raunakpatil.com/img/badges/listed-on-radar.svg)](https://raunakpatil.com/ai-tools/tool/llama-cpp)