Tag: vllm
All the articles with the tag "vllm".
-
Deploying an AI Agent: How I Shipped Credential Sentinel to Production
How I deployed Credential Sentinel, my LangGraph AI agent, from local development to a live production URL. The infrastructure story: multi-stage Docker builds, Kubernetes with GPU nodes, a one-line vLLM swap, Prometheus, and Fly.io.