bitlinear-re

Recreating BitLinear from the reference paper: https://arxiv.org/pdf/2310.11453. Full credit goes to the authors, this repo is meant for recreational and educational purposes only.

TODO:

• Implement core BitLinear module
• Add training script
• Write evaluation metrics
• Document usage and API
• Write kernels using triton for matmul and layernorm for customizability (and for fun)