Topic hub
AI Development Tools
Tools, frameworks, and best practices for building production AI applications.
All posts · 55
AI DEVELOPMENT TOOLS01
OpenCode Offline Mode: Air-Gapped Setup for Local ModelsOpenCode v1.18.34 has no offline flag. Its source shows 17 outbound paths, four with no setting at all, and the model catalog now calls models.opencode.ai.
AI DEVELOPMENT TOOLS02
Langfuse v3 to v4 Upgrade: What Breaks When Self-Hostedevents_only is the v4 default, so an unpinned deploy is the cutover: 22 endpoints start returning 404 and the historic backfill starts in the same rollout.
AI DEVELOPMENT TOOLS03
LiteLLM Spend Logs Table Too Big: Retention That WorksLiteLLM writes a durable row per request and ships maximum_spend_logs_retention_period unset, so nothing is deleted until you set it yourself.
AI DEVELOPMENT TOOLS04
Failed to Initialize NVML: Unknown Error on GPU NodesToolkit v1.18.0 moved the NVIDIA Container Runtime off legacy mode on 2025-10-21, but the hook behind docker run --gpus still resolves to legacy at v1.20.0.
AI DEVELOPMENT TOOLS05
Mutation Testing for AI-Generated Tests: The CI GateOne four-line function, three test suites, all at 100 percent line and branch coverage, with mutation scores of 0, 50 and 100 percent. Here is the gate.
AI DEVELOPMENT TOOLS06
Claude Code Local Model: What Actually Breaks in 2026Read at pinned versions, three local Anthropic-format servers agree on only 3 of 12 request rows. On vLLM the losses come back as a 200, not an error.
AI DEVELOPMENT TOOLS07
MIG vs MPS vs Time-Slicing: Sharing One GPU for vLLMTime-slicing caps no memory, MPS shares a fault domain, and vLLM sizes itself against the whole card. The decision path across all three mechanisms.
AI DEVELOPMENT TOOLS08
Transformers Does Not Recognize This Architecture in vLLMvLLM 0.27.1 consults a 64-entry config registry of its own before Transformers runs. Seven startup errors look alike and only one is fixed by a pip upgrade.
AI DEVELOPMENT TOOLS09
OpenTelemetry GenAI Semantic Conventions: 0 of 63 Are StableAll 63 gen_ai attribute keys still read stability: development. Here is the deprecation map, the package flip that blanks dashboards, and what to pin.