Optimized for Dark Mode

The website is optimized for dark mode to enhance your user experience. Switch to dark mode to enjoy it.

opensource

Common Challenges in Adopting Open-Source LLMs
llm opensource transformers vllm Hugging Face
Published On
August 4, 2024
The most common open-source LLM adoption pitfalls: bad model choices, unrealistic expectations, poor prompting, and avoidable infrastructure mistakes.
Read more ->
Faster LLMs with Quantization - How to get faster inference times with quantization
quantization awq gptq llm opensource transformers vllm Hugging Face
Published On
January 17, 2025
A practical look at LLM quantization tradeoffs, benchmark results, and what actually improves vLLM inference speed in production.
Read more ->

Tags