How AI Agents Work: Inside Agentic Inference
Agentic workflows fundamentally change AI compute workloads, requiring new benchmarking methods that measure throughput per megawatt, interactivity, and end-to-end latency.
Read articleTopic
NVIDIA Dynamo
All digests tagged NVIDIA Dynamo
Suggested route
Topic journey
Move from earlier context through the available material to the newest signals. This route is a reading aid, not a difficulty ranking.
Start here
The Inference Frontier: 10x Faster Models to Self-Optimizing AI — Philip Kiely & Ali Taha, Baseten Inference engineering is critical, involving techniques like cache-aware routing, disaggregated prefill/decode, and speculative decoding to achieve massive model speedups up to 10x. We deep dive into NVFP4 quantization and the role of hardware.Recent signals
How AI Agents Work: Inside Agentic Inference Agentic workflows fundamentally change AI compute workloads, requiring new benchmarking methods that measure throughput per megawatt, interactivity, and end-to-end latency. How H-Company Optimizes VLM Serving for Computer Use Agents With NVIDIA Dynamo Learn how H-Company optimizes VLM serving for computer-use agents using NVIDIA Dynamo. Discover techniques like embedding caching, Model Express, and advanced routing to scale complex, multi-modal AI workloads. Ask the Experts: How NeMo Switchyard Helps Agents Select Models | Nemotron Labs NeMo Switchyard is an open-source model routing library for AI agents that automatically routes each query to the best available model. It solves the 'one model' problem by optimizing selection across local/cloud and open/closed models.
How H-Company Optimizes VLM Serving for Computer Use Agents With NVIDIA Dynamo
Learn how H-Company optimizes VLM serving for computer-use agents using NVIDIA Dynamo. Discover techniques like embedding caching, Model Express, and advanced routing to scale complex, multi-modal AI workloads.
Read article
Ask the Experts: How NeMo Switchyard Helps Agents Select Models | Nemotron Labs
NeMo Switchyard is an open-source model routing library for AI agents that automatically routes each query to the best available model. It solves the 'one model' problem by optimizing selection across local/cloud and open/closed models.
Read article
The Inference Frontier: 10x Faster Models to Self-Optimizing AI — Philip Kiely & Ali Taha, Baseten
Inference engineering is critical, involving techniques like cache-aware routing, disaggregated prefill/decode, and speculative decoding to achieve massive model speedups up to 10x. We deep dive into NVFP4 quantization and the role of hardware.
Read article