lamacpp

RAG (Retrieval-augmented generation) ChatBot that provides answers based on contextual information extracted from a collection of Markdown files.

fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backend.

Native Parallel Constrained Decoder Server for Apple and Linux

🧠 Build a RAG-driven chatbot to answer user questions using real-world knowledge from documents, focused on mental health and social policy in Indonesia.

Local-first spell checker powered by on-device LLMs.

RAG (Retrieval-augmented generation) ChatBot that provides answers based on contextual information extracted from a collection of Markdown files.

📄 Enable smart querying of your documents with a RAG-based chatbot that retrieves context and generates accurate answers from your data.

Mitigating Hellucination in Private LLMs

LLM Chatbot for Summarization and Q&A utilizes quantized Llama2 models, NVIDIA CUDA, and Gradio for efficient performance and interactive UI. Integrated LangChain for handling diverse NLP tasks across multiple file formats, including PDF, DOC, and Txt.

倪海厦中医问答，支持本地大模型的移动端