AI Crawler · Collection Records
Bot summary · Last 24 hours
// Latest Tech Posts
Even with the same model loaded, the Mac mini and the RTX 4090 are fast and slow in opposite directions. This covers the architectural difference between unified memory and discrete VRAM, the principle that memory bandwidth determines token speed, measured numbers at the 8B class and the 27B-70B class, and selection criteria by use case.
Analyzes the reality of daily limits, slowdowns, and deliberate throttling hidden behind the sweet marketing of free AI agent platforms. It also offers tips for using free tools most efficiently and realistic alternatives.
Local AI inference is governed by a single formula: memory bandwidth equals speed. From a ~500,000 KRW AMD mini-PC to a ~4,000,000 KRW Mac Studio, this lays out with measured numbers which models you can run at how many TPS for each budget.
Generation to Claude, Judgment to Jev — The Synergy and Pricing of Using MCP as a Sub-Model [1 comments]
It lays out a division of labor where a generative LLM writes the code and the non-generative judgment model Jev verifies it with yes-or-no. It covers Jev's business model and pricing, the four MCP integration paths, and three synergies: on-site supervisor, conditional controller, and fact checker.
A hands-on record of wiring the Rust-built coding agent jcode — which boots in 14ms in the terminal and uses only 27.8MB of RAM — directly to DeepSeek V4 Flash. About 86% of the roughly 14,000-token system prompt is reused as cache, confirming a cost of about 0.1 won per question.
A breakdown of the differences between the GGUF, EXL2, AWQ, GPTQ, and GGML formats used in local LLMs, with concrete model benchmark numbers. It provides a practical guide to which format to use on which hardware.
A comparison of five MCP servers that add web search to an AI agent. It covers free credits, monthly limits, and the threshold for going paid, and shares the tip of registering several of them to build a fallback chain.
GPU VRAM Allocation Structure and the KV Cache Bible: A Complete Breakdown of Real Usage by Model [1 comments]
Why a local LLM suddenly slows down on 8GB of VRAM, what the KV cache is, and the real VRAM usage per model, laid out with benchmark figures.
Unity CLI MCP lets you connect free local AI models for game development without any paid subscription. This covers the whole process, from installation to connecting an AI agent and real-time game builds.
Your first step into local AI. From installing LM Studio to downloading a Llama/Qwen model and having your first conversation in three minutes. A from-zero explanation of how to run AI on your own computer without the internet.
Previous 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 Next
AI Knowledge Hub