FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
-
Updated
Sep 4, 2024 - Python
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
Custom model training using modern architectures. 4-bit QLoRA fine-tuning pipeline for LLaMA 3 8B with production-grade optimization. Memory-efficient training on consumer GPUs. Published adapter on HuggingFace. From training pipeline to deployed model.
QuantLLM is a Python library designed for developers, researchers, and teams who want to fine-tune and deploy large language models (LLMs) efficiently using 4-bit and 8-bit quantization techniques.
YOalphabet & YOconlang is a 4-bit isomorphic visual script replacing heavy CNNs and text embeddings with zero-inference hardware geometry . Engineered for low-power Edge IoT, M2M swarms, and BCI with zero-latency register mapping . Uses immutable SVO syntax and a MECE matrix for 0% LLM hallucinations.
An Emulator of the Busch 2090 Microtronic Computer System for Arduino Uno and Arduino Mega 2560
Commented source code of Texas Instrument's original Speak and Spell™
A Raspberry Pi Pico (RP2040)-based 2114 SRAM Emulator for the Busch 2090 Microtronic Computer System
Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"
The Microtronic Phoenix Computer System - A Microtronic Emulator Running the Original Firmware from 1981
These are VHDL codes for a signed 4bit multiplier using 4bit adders. Base on Baugh-Wooley Method.
Mixed-precision quantization scheme (16/8/4bit mixed quantization) for the Wan2.2-Animate-14B model. Compresses the original 35GB base model to 17GB, balancing inference performance and model size.
Design Project for a 4-bit Micro-Processor for CS1050
This emulates the 4bit computer and be able to run on the browser.
📚 This repository demonstrates how to interface a 16x2 alphanumeric LCD with the 8051 Microcontrollers (AT89S52) using Assembly Language Programming. The project is designed to showcase a practical example of sending data from the 8051 microcontroller to an LCD and includes Proteus simulation files for testing, modify, debug and visualization.
a 4 bit TTL computer
To associate your repository with the 4bit topic, visit your repo's landing page and select "manage topics."