Latency Optimization on Bharat Singhhttps://bsbhadwal.com/tags/latency-optimization/Recent content in Latency Optimization on Bharat SinghBharat Singhhttps://bsbhadwal.com/images/bharat-singh-ai-systems-architect.jpghttps://bsbhadwal.com/images/bharat-singh-ai-systems-architect.jpgHugoenWed, 19 Aug 2026 00:00:00 +0530Context Caching vs. Semantic Caching: Latency Trade-Offs Across High-Throughput Agent Workflowshttps://bsbhadwal.com/posts/context-caching-vs-semantic-caching-latency-physics/Wed, 19 Aug 2026 00:00:00 +0530https://bsbhadwal.com/posts/context-caching-vs-semantic-caching-latency-physics/Architectural comparison of LLM context caching and semantic caching. Analyzing TTFT, token economics, cache hit ratios, and multi-agent latency budgets.