Pinned Loading

1. open-infra-ai/paged-infer open-infra-ai/paged-infer Public

   Rust LLM Serving 控制面：Paged KV、continuous batching、OpenAI SSE、C ABI 后端与可信压测

   Rust 1

2. open-infra-ai/cuflash-attn open-infra-ai/cuflash-attn Public

   CUDA C++ FlashAttention/FlashDecoding 专项：FP32/FP16/BF16、WMMA、差分测试与基准

   Cuda

3. open-infra-ai/tiny-llm open-infra-ai/tiny-llm Public

   CUDA/C++ LLM 推理运行时：GGUF、W8A16、tokenizer、Paged KV、CUDA Graph 与可复现基准

   C++