Vol.01 · No.10 Daily Dispatch August 13, 2026

Latest AI News

AI · PapersDaily CurationOpen Access
AI NewsResearch
7 min read

Nvidia releases Nemotron 3.5 Lightning and NeMo Switchyard to speed agent execution

A 30B mixture‑of‑experts model with 3B active parameters reports up to 4x faster output and 30% faster completion on 10,000 PinchBench tasks, while a routing library steers prompts to cut costs to nearly one‑third in internal tests.

Reading Mode

One-Line Summary

Agentic AI shifts from single-model setups to systems of models: Nvidia ships a specialist-plus-router stack, vision agents show selective seeing cuts latency and errors, and core repos tighten tooling.

LLM & SOTA Models

Nvidia's Nemotron 3.5 Lightning and NeMo Switchyard aim to speed agent workflows

Nvidia releases a smaller specialist model to handle routine steps inside AI agents and a routing library that automatically picks the right model for each step in a workflow. Together, they target faster, cheaper agent execution and can run from local PCs to data centers; the model weights and the router are broadly available on major hubs and GitHub. 1

Nemotron 3.5 Lightning is a 30 billion parameter model with 3 billion active parameters using a hybrid Mixture of Experts (MoE) design that interleaves Mamba‑2, MoE, and Attention layers. It supports up to a 1 million token context window and bakes in Multi‑Token Prediction (MTP) to generate several tokens per step for speed. The model card lists development across more than 20 trillion tokens and provides detailed benchmark recipes. 2

Performance claims center on throughput and task completion: Nvidia and coverage report up to 4x faster output than similar‑size models and 30% faster completion of 10,000 PinchBench tasks than Qwen3.6 35B at comparable accuracy, with 86% PinchBench accuracy reported. These figures position Lightning as an execution workhorse beneath a frontier planner in a system‑of‑models agent architecture. 3

NeMo Switchyard is an open source router that sends each prompt to the most capable and cost‑efficient model for that step. Nvidia cites internal tests that keep frontier‑level accuracy at nearly one‑third the cost of using Opus 4.8 alone; partner results include LangChain cutting cost 74% across 145 multi‑turn Deep Agents tasks by routing only 7% of calls to a frontier model (at a ~6‑point accuracy tradeoff) and Ramp matching frontier performance on SWE‑Bench while reducing cost 58% and runtime 33%. 1

Open Source & Repos

PyTorch: the Python workhorse for tensors and dynamic neural nets

PyTorch is a Python package for tensor computation and dynamic neural networks with strong graphics processing unit (GPU) acceleration — the core building block many AI teams start with. It integrates naturally with NumPy, SciPy, and Cython for extensions. 4

For engineering teams, the main repository is the canonical entry point and surfaces project status via continuous integration (CI) signals at hud.pytorch.org. If you are evaluating or contributing, begin with the README and CI dashboard to align on supported environments and current trunk health. 4

Code-Graph-RAG updates with a critical fix for monorepos

Code‑Graph‑RAG helps you query, understand, and edit large multi‑language codebases by combining knowledge graphs with Retrieval‑Augmented Generation (RAG). It targets engineers working in monorepos who need structured, cross‑file insights. 5

Release v0.0.589 (Aug 10, 2026) fixes a symlink‑following arbitrary file read/write issue in structural_search/structural_replace. The maintainers strongly recommend upgrading, especially if you run the tool against untrusted repositories. 5

Research Papers

Adaptive visual agents cut latency and errors on long documents and medical images

InSight‑doc frames visual resolution as a resource: it starts with a low‑resolution pass over long, visually rich documents and selectively zooms into high‑resolution regions only when needed. Trained with 17.9K supervised trajectories (region‑level zoom‑ins) plus 19.2K reinforcement learning (RL) examples, InSight‑doc‑8B improves baselines by 4.3–16.4 points on document visual question answering (VQA), while cutting hallucination by over 40% and reducing inference latency by 41%–68% on long documents. Code, datasets, and models are released. 6

MIRA (Medical Image Reflection for Agentic Diagnosis) builds a medical visual agent that decides when to use tools (zooming, grounding, pointing, rotation, measurement, and web search) and verifies whether the evidence supports its current hypothesis. A two‑stage recipe drives performance: a tool‑augmented Monte Carlo Tree Search (MCTS) engine constructs supervised fine‑tuning trajectories, then reinforcement learning further improves decisions via online "reflective principle" evolution. Across nine medical visual reasoning benchmarks, MIRA averages 64.73, improving a Qwen3‑VL‑8B backbone by 7.44 points, while raising useful tool‑use judgments from 56.2% to 73.8% and reducing harmful judgments from 8.9% to 1.6%. 7

Both papers point to the same idea: let agents treat perception and tool calls as a reasoning‑time budget. By zooming only where evidence is needed and verifying what tools return, systems cut cost and errors without sacrificing accuracy. 6

Community Pulse

Hacker News (255↑) — Measurable speedups are noted, but readers question workflow impact and point to unclear Spark/NVFP4 integration support. 8

"Thanks for sharing. Yeah, that was my experience too (2x or 3x is indeed considerably faster), but not workflow-changing faster at 45tps baseline, especially for asynchronous tasks (which is my goal with a local 3090, to just let it do things non-stop, without my intervention). What was the result with MTP? Isn't MTP "losless"? The result should still be relevant when averaged across a fee queriers across different domaine I guess." — Hacker News 8

"I have seen many a model card claim Spark compatibility, but without any proof or instructions. There are vibe-patched images of vLLM that kinda works with NVFP4 models, but I have not seen any support from NVIDIA. Does not seem to be a priority for some reason." — Hacker News 8

Why It Matters

Production agents increasingly act as systems of models: a frontier planner for tough reasoning, specialists for high‑volume execution, and a router to arbitrate cost, latency, and quality. Nvidia’s releases formalize this pattern, while new vision agents show the same “budgeted perception” principle reduces hallucinations and speeds up decisions — a useful blueprint for teams turning prototypes into dependable, cost‑aware workflows. 1

What to Try This Week

  1. Nemotron 3.5 Lightning quick test: Run the model on build.nvidia.com or try the free endpoint on OpenRouter to compare response speed and quality on your team’s common agent tasks.
  2. Secure your code assistant: Update Code‑Graph‑RAG to v0.0.589 to patch the symlink read/write vulnerability before running against any untrusted repository.

Sources 8

Helpful?

Comments (0)