Close Menu
  • AI
  • Content Creation
  • Tech
  • Robotics
AI-trends.todayAI-trends.today
  • AI
  • Content Creation
  • Tech
  • Robotics
Trending
  • Collectively AI Discloses Immediate Leak After Coding Agent Uncovered Credential – Unite.AI
  • Dragos Finds Immediate Leaks and Stolen Keys in AI Provide Chains
  • Lean and Mathlib Communities Certify Claude-Assisted Riemann Proof – Unite.AI
  • AWS Routes HyperPod Inference Throughout Areas From One Endpoint – Unite.AI
  • DailyAI Briefing: A Lean-checked Riemann proof, plus 4 extra
  • Anthropic Shares Drop 8.5% in Second Session Throughout AI Selloff – Unite.AI
  • OpenAI Ships GPT-Stay-1.1 for Voice Brokers, Cuts Idle Value to $0.02/Min
  • Copywriting: The Full Information | Copyblogger
AI-trends.todayAI-trends.today
Home»Tech»NVIDIA AI releases Molt, a PyTorch native agentic reinforcement learning framework

NVIDIA AI releases Molt, a PyTorch native agentic reinforcement learning framework

Tech By Gavin Wallace02/08/20263 Mins Read
Facebook Twitter LinkedIn Email
NVIDIA Introduces ProRL: Long-Horizon Reinforcement Learning Boosts Reasoning and Generalization
NVIDIA Introduces ProRL: Long-Horizon Reinforcement Learning Boosts Reasoning and Generalization
Share
Facebook Twitter LinkedIn Email

The constant modification of algorithms is the hallmark of agentic reinforcement learning. New estimation methods, pipeline stages and rollout plans. Each change is woven through the layers of distributed backends, trainers, and glue for rollouts in mainstream frameworks. The researcher pays for this cost at each iteration.

MoltThe NeMo Team at NVIDIA has developed targets which cost money directly. This is a PyTorch native agentic RL Framework with an uncommon design goal. The codebase must be compact for researchers to keep in their heads, as well as for AI coding assistants to read it and understand its reasoning. According to the stated footprint, there are approximately 8.6K lines RL code. This is measured by tracing an import graph starting from each framework’s RL entry. The same method accounts for 62K lines of verl code, 25K lines for slime and 7.2K line for OpenRLHF.

Is it deployable?

Yes. Molt is shipped under Apache 2.0, with Slurm Scripts and a container. The research paper, however, positions Molt as research infrastructure and not production training, with hardware being the key. Shipped recipes use 2 nodes each with 8 H100 graphics cards, 8 split for training and eight for rolling out.

This puts Molt within reach of labs at the frontiers and adjacent to them, as well as startups that are doing post-training. It also makes it available for enterprise AI groups working in robotics, finance, healthcare and AI who train agents in proprietary environments. The applications include code-execution, multi-turn tools, vision-language environments, LLM reward loops and policy distillation on a smaller student.

Three parts, one loop

Molt composes Ray For placement and asynchronous queuing vLLM NVIDIA’s AutoModel and FSDP2 are used to train, while NVIDIA is for rolling out. The three are not forked. Upstream improvements come as container pins rather than being rebased.

Runtime consists of an agentpool, a collection of vLLM-engines behind a request router, and one trainable policy actor. The streaming pool ensures that the engines are never drained while an actor is training. Partially rolling out pauses engines. It broadcasts actor shards to all the engines over NCCL and resumes requests that were previously retained.

Agent is a normal program

A RL run names a Python module which exports. AgentRunner. The reward is also code.

There are two forms of support. Two forms are supported. EnvThe LLM loop is owned by the framework in a Gymnasium aligned Step(). As With ChatAgentThe user can own the loop by using an OpenAI SDK or Anthropic SDK. Molt launches both wire and loopback servers, decoding each request at the server. If a agent with a longer horizon compacts their context, rewrites prefixes it and then reopens a new segment automatically.

Do not train using a token which you didn’t generate

The design is organized around three correctness invariants. Token identity – sampled tokens ids are used to define the path, and not just a retokenized version of the transcript. Semantics of the policy-version: Trainable tokens retain their log-probabilities for behavior and policies, while asynchronous usage is corrected by token behind an sequence-level gate. Consistency in the future: both rollout and actor agree upon model semantics.

In policies that mix experts, it is important to consider the final invariant. Both the rollout and training routes select experts separately, but small numerical changes can cause top-k decisions to change. Molt applies rollout routing replayvLLM will return its expert ids per token and then the forward training replays these.Function Tok (Mode)

Interactive explainer


You can partner with us to promote your GitHub Repository OR Hugging Page OR New Product Launch OR Webinar, etc.? Connect with us

AI ar learning nvidia work
Share. Facebook Twitter LinkedIn Email
Avatar
Gavin Wallace

Related Posts

OpenAI Ships GPT-Stay-1.1 for Voice Brokers, Cuts Idle Value to $0.02/Min

21/11/2026

Meet Pondering Machines Inkling 2 Mini: 26B Looped MoE Runs on a 32GB Mac

21/11/2026

Baseten Releases Bison-1 and Groundhog-1, Topping Choice Mannequin Index

21/11/2026

RadixArk Ships DaisyRose-27B, a 27B Agentic Coding Mannequin Skilled With Reinforcement Studying Solely

20/11/2026
Top News

OpenAI Leadership’s Response to Meta Offers, ‘Someone is Breaking into Our House’

White House Ordered Federal Workers ‘ASAP!’ to Install Grok

It’s not for plumbers or electricians that the real AI talent war is.

AI Chatbots Guide Psychedelic Trips

Apple’s Most Overlooked App Has Just gotten a Whole Lot Better

Load More
AI-Trends.Today

Your daily source of AI news and trends. Stay up to date with everything AI and automation!

X (Twitter) Instagram
Top Insights

YouTube TV launches subscription plans based on genres in 2026

10/12/2025

OpenAI Launches GDPval – A New AI Evaluation Tool that Measures Artificial Intelligence on Economically Valuable Real World Tasks

25/09/2025
Latest News

Collectively AI Discloses Immediate Leak After Coding Agent Uncovered Credential – Unite.AI

22/11/2026

Dragos Finds Immediate Leaks and Stolen Keys in AI Provide Chains

22/11/2026
X (Twitter) Instagram
  • Privacy Policy
  • Contact Us
  • Terms and Conditions
© 2026 AI-Trends.Today

Type above and press Enter to search. Press Esc to cancel.