Training models with ternary quantized weights using PyTorch
-
Updated
Jun 12, 2019 - Python
#
ternary-quantization
Here are 15 public repositories matching this topic...
n0x CLI is my go-to Claude Code alternative when I’m on a budget.
nodejs cli open-source npm typescript terminal ai developer-tools code-generation quantization bonsai low-resource ternary-quantization llm llama-cpp local-llm ollama react-agent offline-ai coding-agent
-
Updated
Jul 4, 2026 - TypeScript
Custom Apple Metal kernels for Hy4-preview (770B ternary MoE) in llama.cpp — makes AngelSlim's STQ1_0 GGUF runnable on Apple Silicon
-
Updated
Sep 2, 2026 - Metal
Pre-quantized ternary models for VLMs, multimodal, and audio — the models GGUF can't touch
quantization whisper gemma vlm model-compression multimodal edge-ai ternary-quantization huggingface apple-silicon vision-language-model qwen
-
Updated
Apr 27, 2026 - Python
1.58-bit ternary Mamba LLM for Indian languages. Weights are {-1,0,+1} — inference uses only add/sub. 3B model fits in 750MB, runs 20+ tok/s on mobile.
-
Updated
Apr 10, 2026 - Python
Selective ternary compression of Qwen3.6 MoE expert projections on Apple Silicon, with matched-control functional, routing, and perplexity evaluation.
machine-learning quantization mlx model-compression mixture-of-experts ternary-quantization apple-silicon large-language-models local-llm qwen
-
Updated
Jul 31, 2026 - TypeScript
Research implementation of activation-aware ternary and mixed-bit quantization for Qwen3.8-27B, targeting 7-9 GB text inference on 16 GB GPUs.
transformers pytorch quantization model-compression mixed-precision ternary-quantization large-language-models llama-cpp gguf qwen3
-
Updated
Aug 17, 2026 - Python
Anonymous paper release for TRACE-Q, a topology-aware ternary quantization framework for heterogeneous language models.
-
Updated
Jul 30, 2026
Colab-friendly BitNet distillation engine: collect KD traces from a teacher, train a ternary Mini-BitNet, and dry-run 7B memory. Multi-provider + Drive/S3
transformers pytorch parquet knowledge-distillation model-compression bitnet colab-notebook mixed-precision ternary-quantization large-language-model efficient-llm efficient-llm-inference activation-quantization kd-traces
-
Updated
Sep 5, 2025 - Python
PILON (Primitive-Induced Linear Operator Network) explores a compositional weight parameterization for transformer FFN layers. The goal is to replace dense FFN matrices with shared low-rank primitives plus learned composition weights.
research pytorch transformer language-model model-compression bitnet weight-sharing low-rank ternary-quantization quantization-aware-training efficient-deep-learning consumer-gpu
-
Updated
Mar 20, 2026 - Python
ESP32 LLM / MoE: trained on Google Colab GPU, ternary-quantized, exported to C++, and verified on real ESP32 hardware. Fork of Ahmed Barakat's ESP-LLM.
machine-learning microcontroller ai esp32 platformio moe language-model google-colab bitnet arduino-esp32 mixture-of-experts embedded-ai edge-ai ternary-quantization tinyml llm tiny-llm esp32-llm on-device-inference embedded-llm
-
Updated
Sep 26, 2026 - C++
First open-source qutrit (d=3) variational quantum classifier for tabular data. Lossless 2³→3² binary-to-ternary compression, CSUM ring entanglement, and SHAP explainability. 72 parameters. Built with PennyLane + PyTorch.
pytorch model-compression quantum-machine-learning qiskit explainable-ai shap ternary-quantization pennylane variational-quantum-classifier vqc ternary-computing qutrit ternary-llm
-
Updated
Sep 25, 2026 - Dart
Independent forensics of Bonsai 2 27B ternary quantization: format and basis recovery, the trained-weights residual, and the public PTQ calibration artifact.
reproducibility quantization bonsai model-compression mixture-of-experts ternary-quantization llm gguf
-
Updated
Sep 26, 2026 - Python
jade_mage · agentprivacy dual-agent harness lane for JadeZaher/ternary-memory-research (fork: main tracks upstream; lane on branch harness/jade_mage; contributions go upstream by PR)
-
Updated
Sep 21, 2026 - Python
Apple Silicon MLX low-bit ternary (BitNet b1.58 {-1,0,+1}) quantization, Metal GPU kernels, perplexity benchmarking, the cogito corpus pipeline
-
Updated
Sep 26, 2026 - C++
Add this topic to your repo
To associate your repository with the ternary-quantization topic, visit your repo's landing page and select "manage topics."