Close Menu
  • AI
  • Content Creation
  • Tech
  • Robotics
AI-trends.todayAI-trends.today
  • AI
  • Content Creation
  • Tech
  • Robotics
Trending
  • A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels
  • Collectively AI Discloses Immediate Leak After Coding Agent Uncovered Credential – Unite.AI
  • Dragos Finds Immediate Leaks and Stolen Keys in AI Provide Chains
  • Lean and Mathlib Communities Certify Claude-Assisted Riemann Proof – Unite.AI
  • AWS Routes HyperPod Inference Throughout Areas From One Endpoint – Unite.AI
  • DailyAI Briefing: A Lean-checked Riemann proof, plus 4 extra
  • Anthropic Shares Drop 8.5% in Second Session Throughout AI Selloff – Unite.AI
  • OpenAI Ships GPT-Stay-1.1 for Voice Brokers, Cuts Idle Value to $0.02/Min
AI-trends.todayAI-trends.today
Home»Tech»NVIDIA AI releases Molt, a PyTorch native agentic reinforcement learning framework

NVIDIA AI releases Molt, a PyTorch native agentic reinforcement learning framework

Tech By Gavin Wallace02/08/20263 Mins Read
Facebook Twitter LinkedIn Email
NVIDIA Introduces ProRL: Long-Horizon Reinforcement Learning Boosts Reasoning and Generalization
NVIDIA Introduces ProRL: Long-Horizon Reinforcement Learning Boosts Reasoning and Generalization
Share
Facebook Twitter LinkedIn Email

The constant modification of algorithms is the hallmark of agentic reinforcement learning. New estimation methods, pipeline stages and rollout plans. Each change is woven through the layers of distributed backends, trainers, and glue for rollouts in mainstream frameworks. The researcher pays for this cost at each iteration.

MoltThe NeMo Team at NVIDIA has developed targets which cost money directly. This is a PyTorch native agentic RL Framework with an uncommon design goal. The codebase must be compact for researchers to keep in their heads, as well as for AI coding assistants to read it and understand its reasoning. According to the stated footprint, there are approximately 8.6K lines RL code. This is measured by tracing an import graph starting from each framework’s RL entry. The same method accounts for 62K lines of verl code, 25K lines for slime and 7.2K line for OpenRLHF.

Is it deployable?

Yes. Molt is shipped under Apache 2.0, with Slurm Scripts and a container. The research paper, however, positions Molt as research infrastructure and not production training, with hardware being the key. Shipped recipes use 2 nodes each with 8 H100 graphics cards, 8 split for training and eight for rolling out.

This puts Molt within reach of labs at the frontiers and adjacent to them, as well as startups that are doing post-training. It also makes it available for enterprise AI groups working in robotics, finance, healthcare and AI who train agents in proprietary environments. The applications include code-execution, multi-turn tools, vision-language environments, LLM reward loops and policy distillation on a smaller student.

Three parts, one loop

Molt composes Ray For placement and asynchronous queuing vLLM NVIDIA’s AutoModel and FSDP2 are used to train, while NVIDIA is for rolling out. The three are not forked. Upstream improvements come as container pins rather than being rebased.

Runtime consists of an agentpool, a collection of vLLM-engines behind a request router, and one trainable policy actor. The streaming pool ensures that the engines are never drained while an actor is training. Partially rolling out pauses engines. It broadcasts actor shards to all the engines over NCCL and resumes requests that were previously retained.

Agent is a normal program

A RL run names a Python module which exports. AgentRunner. The reward is also code.

There are two forms of support. Two forms are supported. EnvThe LLM loop is owned by the framework in a Gymnasium aligned Step(). As With ChatAgentThe user can own the loop by using an OpenAI SDK or Anthropic SDK. Molt launches both wire and loopback servers, decoding each request at the server. If a agent with a longer horizon compacts their context, rewrites prefixes it and then reopens a new segment automatically.

Do not train using a token which you didn’t generate

The design is organized around three correctness invariants. Token identity – sampled tokens ids are used to define the path, and not just a retokenized version of the transcript. Semantics of the policy-version: Trainable tokens retain their log-probabilities for behavior and policies, while asynchronous usage is corrected by token behind an sequence-level gate. Consistency in the future: both rollout and actor agree upon model semantics.

In policies that mix experts, it is important to consider the final invariant. Both the rollout and training routes select experts separately, but small numerical changes can cause top-k decisions to change. Molt applies rollout routing replayvLLM will return its expert ids per token and then the forward training replays these.Function Tok (Mode)

Interactive explainer


You can partner with us to promote your GitHub Repository OR Hugging Page OR New Product Launch OR Webinar, etc.? Connect with us

AI ar learning nvidia work
Share. Facebook Twitter LinkedIn Email
Avatar
Gavin Wallace

Related Posts

A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels

22/11/2026

OpenAI Ships GPT-Stay-1.1 for Voice Brokers, Cuts Idle Value to $0.02/Min

21/11/2026

Meet Pondering Machines Inkling 2 Mini: 26B Looped MoE Runs on a 32GB Mac

21/11/2026

Baseten Releases Bison-1 and Groundhog-1, Topping Choice Mannequin Index

21/11/2026
Top News

The AI Image Generator Startup Exposed Database Leaked a Huge Trunk of Nude Pictures

The UK Bets on a Billions-Dollar AI Supercomputer To Kick Its Addiction To US Tech

Your Online Trends Are All Wrong

OpenAI and Anthropic are rivals but the investors don’t pick sides

DailyAI Briefing: An AI agent operates on a mouse, plus 4 extra

Load More
AI-Trends.Today

Your daily source of AI news and trends. Stay up to date with everything AI and automation!

X (Twitter) Instagram
Top Insights

Where to find the latest TikTok Sound in 2026

18/11/2025

Jen Vescio, President of Empiric Earth – Interview Collection – Unite.AI

01/11/2026
Latest News

A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels

22/11/2026

Collectively AI Discloses Immediate Leak After Coding Agent Uncovered Credential – Unite.AI

22/11/2026
X (Twitter) Instagram
  • Privacy Policy
  • Contact Us
  • Terms and Conditions
© 2026 AI-Trends.Today

Type above and press Enter to search. Press Esc to cancel.