Close Menu
  • AI
  • Content Creation
  • Tech
  • Robotics
AI-trends.todayAI-trends.today
  • AI
  • Content Creation
  • Tech
  • Robotics
Trending
  • A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels
  • Collectively AI Discloses Immediate Leak After Coding Agent Uncovered Credential – Unite.AI
  • Dragos Finds Immediate Leaks and Stolen Keys in AI Provide Chains
  • Lean and Mathlib Communities Certify Claude-Assisted Riemann Proof – Unite.AI
  • AWS Routes HyperPod Inference Throughout Areas From One Endpoint – Unite.AI
  • DailyAI Briefing: A Lean-checked Riemann proof, plus 4 extra
  • Anthropic Shares Drop 8.5% in Second Session Throughout AI Selloff – Unite.AI
  • OpenAI Ships GPT-Stay-1.1 for Voice Brokers, Cuts Idle Value to $0.02/Min
AI-trends.todayAI-trends.today
Home»Tech»Microsoft Open Sources code-testing-generator: a Polyglot Unit-Test Agent That Hits 92.1% Task Completion Versus 78.9% for Stock Copilot

Microsoft Open Sources code-testing-generator: a Polyglot Unit-Test Agent That Hits 92.1% Task Completion Versus 78.9% for Stock Copilot

Tech By Gavin Wallace07/08/20264 Mins Read
Facebook Twitter LinkedIn Email
This AI Paper Introduces Differentiable MCMC Layers: A New AI
This AI Paper Introduces Differentiable MCMC Layers: A New AI
Share
Facebook Twitter LinkedIn Email

Microsoft Open Sourced code-testing-generatorIt is a multi-language agent who writes unit tests, then verifies that they are working. The software is delivered in the dotnet-test plugin The MIT licensees have developed a MIT software. dotnet/skills repository.

Agents fill in a hole that is often left by coding assistants. A prompt like ‘generate unit tests’ does not say which framework, file location or assertions to use. code-testing-generator It reads the repository first, before writing anything. After that, the software plans, produces, tests and runs them. Microsoft’s internal benchmark of 152 tasks was completed by 140 tasks compared to 120 with GitHub Copilot. The same prompts and model were used in both setups.

Is it deployable

Yes. Because it is an agent description and skills that are not hosted, the code remains local.

  • The Company Stage: It is feasible for single maintainers and upwards. Because the agent provides repository information that small teams do not have time for, startups and midmarket teams benefit most. The language guide can be adapted to fit the internal frameworks of enterprises.
  • Industries: regulated or audit-heavy software estates — financial services, healthcare, insurance, public sector — plus platform teams paying down legacy test debt.
  • Applications: The backfilling of untested modules with tests, the generation of tests to compare a diff between a pull request and a change-request, increasing coverage in advance before a gate release, standardising conventions for monorepos that are polyglot.

What an agent does

It coordinates work through a Research-Plan-Implement (RPI) pipeline. It looks for tests in the code repository, it detects language and frameworks for testing, it reads tests to see if they follow conventions and then finally, the actual build and test command is found. The last step targets a failure in particular: a local test project which never gets run by CI, because it was not registered.

Choose one of the three possible strategies. You can also Direct Write and validate tests instantly. Single pass Runs one cycle. Iterative It is repeated for larger scopes of coverage or target targets. The code is never modified in production, and it avoids testing that calls external URLs or ports, or depends on timing.

Verification gate

Agents perform five tests before they can report completion. The agent uses a light form of mutation test to reason about minor code changes which should cause the tests to fail. It checks for missing or weak assertions. Every scenario is mapped to a specific test. The full workspace is built and the entire suite of tests are run. The repository confirms that the repository test command has discovered the new tests.

Benchmark results

The agent achieved a score of 95% on Microsoft’s benchmark internal test, which included 152 real-world tasks. 140 (92.1%) versus 120 (78.9%) For stock GitHub Copilot, using the same model with prompts (63%) fewer errors.

Concentrated gain. The agent scored 79 out of 89 (88.8%), compared to 59 (66.3%), reducing failures by 30 points. In 63 specific prompts both agents scored 61. The agent completed all 15 of the tasks that targeted a particular diff. Stock Copilot failed none.

The agent generates a lot of heat. Tests are 2.3% less. Comparing the two lines of coverage, there was a difference in line coverage (6.963 vs 7.129). The average task took 359 seconds versus 380. Use of tokens per completed task increased by 3.2%.

With 45.NET jobs, Claude Opus 4.8 was able to achieve 43/45 (with the agent) compared with 35/45 without; and GPT-5.5 achieved 41/45 versus 37/45. Externally, GPT-5.5 achieved 41/45 versus 36/45. Claude Opus 4.8 reached 43/45 with the agent compared to 35/45 stock. SWE Atlas Completion was measured at 16/44, compared to 12/44.

How the agent converts a prompt into a verified test

ces code microsoft open source
Share. Facebook Twitter LinkedIn Email
Avatar
Gavin Wallace

Related Posts

A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels

22/11/2026

OpenAI Ships GPT-Stay-1.1 for Voice Brokers, Cuts Idle Value to $0.02/Min

21/11/2026

Meet Pondering Machines Inkling 2 Mini: 26B Looped MoE Runs on a 32GB Mac

21/11/2026

Baseten Releases Bison-1 and Groundhog-1, Topping Choice Mannequin Index

21/11/2026
Top News

ChatGPT’s Horny Era May Be The Stickiest Ever

Google AI overviews can be hidden from your search results.

The Hackable Robot Lawn Mower is a New Nightmare

How can we counter someone like Terrence-Howard? • AI Blog

Meta Superintelligence Lab’s Researchers are Already Departing

Load More
AI-Trends.Today

Your daily source of AI news and trends. Stay up to date with everything AI and automation!

X (Twitter) Instagram
Top Insights

Despite protests Elon Musk secured an air permit for xAI

03/07/2025

AI Deepfakes Impersonate Pastors and Scam their Congregations

05/01/2026
Latest News

A Group of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels

22/11/2026

Collectively AI Discloses Immediate Leak After Coding Agent Uncovered Credential – Unite.AI

22/11/2026
X (Twitter) Instagram
  • Privacy Policy
  • Contact Us
  • Terms and Conditions
© 2026 AI-Trends.Today

Type above and press Enter to search. Press Esc to cancel.