Pinned Loading

1. gemma.cpp gemma.cpp Public

   Forked from google/gemma.cpp

   lightweight, standalone C++ inference engine for Google's Gemma models.

   C++

2. lm-evaluation-harness lm-evaluation-harness Public

   Forked from EleutherAI/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python

3. opencompass opencompass Public

   Forked from open-compass/opencompass

   OpenCompass is an LLM evaluation platform, supporting a wide range of models (InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

   Python

4. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

5. whisper.cpp whisper.cpp Public

   Forked from ggml-org/whisper.cpp

   Port of OpenAI's Whisper model in C/C++

   C++

6. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python