Llama.cppCode & DevelopmentHighly optimized LLM inference engine in pure C++inferencec++quantizationOpen Source4.6Visit
GPT4AllCode & DevelopmentFree, locally running AI chatbot with no data sharinglocal-llmcpuopen-sourceOpen Source