May 10, 2025 Best Settings to Run Qwen3-30B-A3B Locally If you're running Qwen3-30B-A3B locally, don't guess your way through the settings. This guide tells you what actually works based on Qwen's own documentation and what we've seen hold up in practice. guides Read article →
February 8, 2025 Offline ChatGPT: You can't run ChatGPT offline, do this instead Learn how to use AI offline with Jan - a free, open-source alternative to ChatGPT that works 100% offline on your computer. guides Read article →
January 31, 2025 Run DeepSeek R1 locally on your device (Beginner-Friendly Guide) A straightforward guide to running DeepSeek R1 locally regardless of your background. guides Read article →
January 31, 2025 How to run AI models locally as a beginner? A straightforward guide to running AI models locally on your computer, regardless of your background. guides Read article →
April 29, 2024 Benchmarking NVIDIA TensorRT-LLM This post compares the performance of TensorRT-LLM and llama.cpp on consumer NVIDIA GPUs, highlighting the trade-offs among speed, resource usage, and convenience. research Read article →
March 25, 2024 The Invisible Moat around Open-Source LLM Uncover the pivotal role of data ownership in training the next iteration of LLM. research Read article →
March 25, 2024 RAG is not enough: Lessons from Beating GPT-3.5 on Specialized Tasks with Mistral 7B We present a straightforward approach to customizing small, open-source models using fine-tuning and RAG that outperforms GPT-3.5 for specialized use cases. research Read article →
January 10, 2024 Bitdefender False Positive Flag 10th January 2024, Jan's 0.4.4 Release on Windows triggered Bitdefender to incorrectly flag it as infected with Gen:Variant.Tedy.258323, leading to automatic quarantine warnings on users' computers. building-jan Read article →