Pinned Loading

1. vllm-windows vllm-windows Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)

   Python 552 53

2. pynini-windows pynini-windows Public

   Forked from kylebgorman/pynini

   Pynini for Windows

   Python 24 2

3. flashinfer-windows flashinfer-windows Public

   Forked from flashinfer-ai/flashinfer

   FlashInfer: Kernel Library for LLM Serving (Windows build & kernels)

   Python 15 5

4. openfst-windows openfst-windows Public

   OpenFst for Windows

   C++ 2

5. nccl-windows nccl-windows Public

   Forked from NVIDIA/nccl

   Optimized primitives for collective multi-GPU communication

   C++ 3 1

6. fastsafetensors-windows fastsafetensors-windows Public

   Forked from foundation-model-stack/fastsafetensors

   High-performance safetensors model loader

   Python