behnamoh 4 hours ago

is sglang an LLM engine or does it use vLLM/llama.cpp under the hood? and while we're at it, has anyone done a comparison of LLM engines? I've also heard of Mistral.rs, LLM MLC, and obviously HF transformers library and its ktransformers alternative.

  • imtringued an hour ago

    SGLang is a competitor to vLLM.