Explore live open-source projects and AI models.

A C++ implementation of Transformer without special library dependencies, supporting CPU, CUDA, and Apple Metal, including training and inference.

A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization techniques, performance comparisons, and step-by-step setup instructions for privacy-focused, cost-e... Read more

Binding to transformers in ggml

Swin Transformer C++ Implementation

用C++实现一个简单的Transformer模型。 Attention Is All You Need。

TransformerCPP is a minimal C++ machine learning library with autograd and tensor ops, inspired by PyTorch. It includes a from-scratch Transformer model demo, optimized for CPU and multithreaded performance.

Android app for running transformers locally using LLama.cpp & Whisper.cpp

Connect llama-cpp, transformers or text-generation-webui to telegram bot api.

A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)

transformer tokenizers (e.g. BERT tokenizer) in C++ (WIP)