One-Line Summary

Data takes center stage: a 6T-token vision-language benchmark shows instruction-heavy mixes beat filtering, while a multi-layer agent security framework and a local research tool add tighter controls.

Research Papers

DataComp-VLM sets a 6T-token benchmark for vision-language training

To train stronger Vision-Language Models (VLMs) — AI that connects images and text — the authors introduce DataComp-VLM, a standardized way to compare how you curate training data. It aggregates 160 datasets across four types (image–caption pairs, multimodal interleaved documents, text-only, and instruction-tuning) into a 6 trillion–token multimodal corpus and supports controlled experiments across 1B–8B-parameter models and 6.25B–200B token budgets. ¹

Across up to 52 benchmarks in 9 domains, the headline finding is that data mixing matters more than heavy filtering: instruction-heavy mixtures scale better than caption-heavy ones, with the gap widening at larger scales. Think of it as training with recipes and step-by-step feedback rather than only photo captions. ¹

Using the DCVLM-Baseline mixture, an 8B-parameter VLM trained on 200B tokens reaches 63.6% on the 33-task core suite — a +5.4 percentage point gain over the FineVision open dataset. The authors state that all artifacts will be made publicly available at datacomp.ai/dcvlm. ¹

AI-Infra-Guard unifies red teaming for AI agents

AI-Infra-Guard is an open-source framework for adversarial testing (red teaming) of AI agents that organizes the attack surface into four layers: infrastructure, protocol/tooling, agent behavior, and the model. It combines deterministic rule matching across 75+ AI components with 1,400+ vulnerability rules, plus Large Language Model (LLM)-driven auditing of Model Context Protocol (MCP) servers and agent-skill packages, and multi-turn black-box agent red teaming. ²

A jailbreak harness adds 26+ attack operators spanning sixteen datasets, and the framework includes supply-chain auditing of the agent skills that extend agents. The authors present it as the only open-source system that spans all these layers, and they release it to serve as a shared foundation for agent security work. ²

Open Source & Repos

Local Deep Research adds egress controls, nears 95% on SimpleQA

Local Deep Research is a privacy-first research assistant that runs on your machine, supports both local and cloud Large Language Models (LLMs), and reports about 95% on the SimpleQA question-answering benchmark (for example, Qwen3.6-27B on an RTX 3090). It integrates 10+ search sources including arXiv, PubMed, and private documents, emphasizing local execution and encryption. ³

In the 2026-07-02 v1.8.1 release, the project adds an egress policy system to control whether research runs stay local or can reach cloud services, alongside security hardening, chat/research UX improvements, and new chat actions. ³

Why It Matters

Data choices — not just model size — are moving the needle: DCVLM’s controlled comparisons show instruction-style data mixing can surpass filtering-heavy caption datasets, quantified by 63.6% for an 8B VLM and a +5.4-point margin over a leading open mixture. ¹

As AI agents proliferate, security work is mapping cleanly onto layers from infrastructure to model behavior; AI-Infra-Guard operationalizes this with concrete rules, audits, and attack operators so teams can probe weak points before incidents. ²

This Week, Try

1. Local Deep Research: Install and follow the README to test egress controls and local-only runs — https://github.com/LearningCircuit/local-deep-research
2. DataComp-VLM on arXiv: Skim the core suite and mixture recipes — https://arxiv.org/abs/2606.28551