OpenAI releases Python framework for multi‑agent AI workflows across 100+ models
The new framework is provider‑agnostic and works with OpenAI’s Responses and Chat Completions application programming interfaces (APIs), lowering the friction to coordinate multiple agents and tools. Two new papers, meanwhile, test multimodal world reasoning and 3D articulation from sparse views.
One-Line Summary
OpenAI ships a provider-agnostic Python framework for multi-agent workflows, while new papers probe multimodal world reasoning and 3D articulation from sparse observations.
Open Source & Repos
OpenAI ships Python framework for multi‑agent workflows
This is a lightweight framework for building AI agents that can work together on complex tasks. It is provider‑agnostic and works with OpenAI’s Responses and Chat Completions application programming interfaces (APIs), as well as more than 100 other large language models (LLMs). 1
Core concepts include agents configured with instructions, tools, guardrails, and handoffs; sandbox agents preconfigured to run inside a container for long‑running work; and realtime agents for live interactions. The repository highlights these patterns and includes documentation pages such as Agents and Sandbox agents. 1
The project is actively updated, with version v0.22.3 noting fixes like aligning conditional approvals with validated tool arguments and clearer “tool‑not‑found” output on server‑managed resume. A JavaScript/TypeScript edition is linked for teams building outside Python. 1
Why it matters: by standardizing multi‑agent orchestration and tool use across providers, teams can prototype and compare heterogeneous models without rewriting glue code, lowering switching costs for multi‑model strategies. 1
Research Papers
MiniMax-H3: evaluating multimodal physical-world reasoning
This paper evaluates whether an “omni‑modal” generative model that handles text, images, video, and audio can reason better about real‑world events and dynamics. Across 517 evaluation instances spanning four partial‑evidence settings (implicit prompts with frames, audio–image pairs, prefix videos, and audio–video), MiniMax‑H3 achieves an overall success rate of 41.97%, with 56.00% on video‑based decision reasoning and 27.40% on audio‑based disambiguation. 2
The results suggest multimodal alignment helps but remains uneven, especially when disambiguating with audio, and the authors propose evaluation setups tailored to models that ingest multiple modalities together. 2
FAMOS: feed‑forward 3D articulation from sparse views
This work presents a feed‑forward system that predicts which object parts can move and how their joints are configured from a few sparse, unordered three‑dimensional (3D) point‑cloud observations. It aggregates motion cues across views with a Multi‑state Articulation Transformer and supervises the observed motion range via an “articulation span” objective, avoiding heavy per‑object optimization at test time. 3
On PartNet‑Mobility, ACD, and ArtiCraft‑10K, FAMOS reports consistent improvements over both feed‑forward and optimization‑based baselines, indicating that stitching together limited partial observations can recover reliable part segmentation and joint parameters. 3
Why It Matters
Agent workflows are moving from ad‑hoc scripts to shared infrastructure: a provider‑agnostic framework with built‑in patterns (tools, guardrails, handoffs, sandboxing) cuts integration work and makes multi‑model setups more practical for teams. 1
At the same time, the MiniMax‑H3 and FAMOS results illuminate where “world models” stand: integrating audio‑visual cues still shows gaps on disambiguation tasks, while inferring mechanics from sparse 3D views is improving with new architectures—useful signals for scoping audio‑heavy features and planning perception pipelines. 2 3
What to Try This Week
- Build a two‑agent handoff: install with “pip install openai‑agents” and run the README quickstart to have one agent call a tool and pass results to another.
- Skim the MiniMax‑H3 paper’s results table and note which modality combinations lift or limit reasoning performance.
Comments (0)