Skip to content
All systems operational0 AI providers monitored, polled every 2 minutes
Live status
Back to Originals

Z.ai Trained a Model to Find Bugs. It Learned to Chain Exploits Instead. The Weights Ship in Two Weeks.

Marcus Chen··8 min read
Open Weights · Offensive Security

Z.ai released GLM-5.3 this morning, and the coding numbers are the part everyone will quote. They are not the part that matters. Buried in the same announcement is a sentence the company did not have to write: the model got better at offensive security than Z.ai expected it to, and it kept getting better as training scaled. The weights go public in about two weeks.

I have covered four cyber capability stories in the last nine days. OpenAI slowed Astra over a Critical finding on August 7. OpenAI shipped GPT-5.6-Cyber on August 10 behind identity verification and mandatory hardware security keys. DeepSeek pushed V4 Pro out of preview with a self-reported CyberGym of 83.3 and no harness. Now Z.ai posts a higher CyberGym number than either American frontier lab and attaches a download date to it.

Those four events are the same event. The industry spent this month deciding where the safety perimeter for offensive AI capability sits, and it has landed on two incompatible answers in the space of a single week.

The Boring Technical Fact That Makes This Interesting

GLM-5.3 runs on the same 743 billion parameter base model as GLM-5.2. Z.ai did not retrain it. Every reported gain comes from post-training: more task environments, more environment types, longer training runs on the stack GLM-5.2 introduced (IndexShare for long context, an RL method called SAO for long-horizon tasks, and slime, the open-source asynchronous RL framework).

The environments are the product. Z.ai describes building them to resemble units of professional work rather than coding puzzles: drop a model into an ML infrastructure engineer's environment with clusters, internal docs, codebases, and experiment results, and require a measurable end-to-end speedup. Some tasks represent several days of work for an experienced engineer. Research agents convert real work patterns into runnable environments, a judge agent verifies each task is actually solvable, and verifiers get synthesized without access to the reference solution.

That recipe predicts exactly the shape of the coding results. The longer the horizon, the bigger the jump.

BenchmarkGLM-5.2GLM-5.3Delta
Terminal-Bench 3.04.628.3+23.7
DeepSWE v1.146.266.9+20.7
Agents' Last Exam (CLI)23.828.5+4.7

On Z.ai's internal Code Bench, GLM-5.3 hits 31.4 percent at roughly 50,000 output tokens per task, against Claude Opus 4.8 at 29.5 percent for 120,000 tokens. Claude Fable 5 still wins outright at 39.5 percent at maximum effort. The token efficiency claim is the one I would actually check first, because it is the one with a dollar figure attached. Current pricing across the field lives on our models tracker.

On public suites, GLM-5.3 trails GPT-5.6 Sol and Fable 5 on several of the harder coding evaluations. This is a very good open-weights coding model. It is not the best coding model, and Z.ai does not claim otherwise.

The Result Z.ai Says It Did Not Plan

Here is the company's own framing, which I want to quote the substance of carefully because the framing is doing a lot of work. Z.ai added vulnerability discovery data to post-training expecting better reasoning about individual bugs. What it got instead was capability that kept compounding as training scaled, with the model forming coherent plans across complete exploitation chains rather than isolated flaw-finding.

The numbers support the claim, and they support it in a specific and uncomfortable way.

BenchmarkGLM-5.2GLM-5.3Mythos 5Source
CyberGym77.284.583.8Vendor
ExploitBench24.454.478.0Vendor
ExploitGym (2 hr)29105181Vendor
ExploitGym (6 hr)39130247Vendor

Read that table left to right and the story is a 3.6x jump on ExploitGym in one post-training cycle. Read it right to left and the story is that Mythos 5 is still comfortably ahead on the two benchmarks that require a working exploit rather than a validated finding. For comparison, GPT-5.6 Sol sits at 83.6 on CyberGym, just under GLM-5.3.

Both readings are correct, and the second one is the reason I do not think capability level is the interesting variable here. GLM-5.3 is not the most dangerous cyber model in the world. It is roughly the third or fourth most capable, by the vendor's own numbers, and it is the only one of the group that anyone will be able to download.

Two Perimeters, Four Days Apart

On August 10 OpenAI shipped GPT-5.6-Cyber into Daybreak Red, an access tier gated by identity verification, continuous monitoring, approved-use restrictions, legal attestations, and mandatory hardware security keys by September 1. I wrote at the time that the interesting move was relocating the control surface from the model's refusal to the account in front of it. Four days later Z.ai is running the opposite experiment.

 Daybreak RedGLM-5.3
Control surfaceThe accountThe weights
Who gets accessVetted, attested, key-holdingAnyone with bandwidth
RevocableYes, per accountNo, permanently
Survives a fine-tuneNot applicableUnlikely
Usage visible to labContinuously monitoredNot at all

The two-week delay is the whole safety argument, and it is worth being precise about what it can and cannot buy. Z.ai says it will spend that window on safety evaluation and hardening before publishing the weights. Evaluation produces knowledge, which is real and useful. Hardening produces refusal behavior baked into the weights, which is not a control once the weights are on a hard drive. Refusal training is the first thing removed by a community fine-tune, and it has been removed from every notable open-weights release of the last two years, usually within days.

So the honest version of the plan is: Z.ai will learn more about what the model can do, publish a model that can do it, and rely on downstream deployers for everything after that. That is not a scandal. It is the open-weights bargain stated plainly, and Meta made the same bargain four days ago with Muse Glimmer. It is just the first time the bargain has been struck over a capability the releasing lab describes as having outgrown its own training plan.

The Case for Z.ai, Which Is Stronger Than It Sounds

I want to give the other side its full weight, because the defensive numbers here are not decoration.

Working with security teams in China, Z.ai says its models have identified 2,436 vulnerabilities across 269 open-source projects since GLM-5.2, including 1,097 rated critical or high severity, spanning system kernels, operating systems, browser engines, and network protocols. The oldest bug in the set was introduced in 1981. Those findings feed a public disclosure ledger: 53 issues publicly disclosed with CVEs assigned at launch, 2,383 still under embargo. Recent entries include a use-after-free in the Linux kernel, a WebKit memory-handling flaw reaching Safari, and a parameter-validation bug in FreeBSD.

That is a serious contribution to a shared codebase everyone reading this depends on, and it is running through coordinated disclosure rather than a press release. Z.ai is doing the thing we said labs should do when they build models that find bugs. Our CVE Watch hub exists partly because this category of finding is now arriving faster than the traditional advisory pipeline was built to absorb.

The uncomfortable part is that the ledger and the risk are the same capability. A model that reasons across a full exploitation chain is more useful for finding a decades-old kernel bug and more useful for weaponizing one. There is no version of this where you get the 1,097 critical findings and not the chain reasoning. Anyone telling you the offensive and defensive capability can be separated at the weights level is selling something.

One More Thing Buried in the API Notes

GLM-5.3 supports three thinking effort levels (low, high, and max) and no longer permits disabling thinking at all. That is a breaking change for anyone running GLM in a latency-sensitive path with thinking switched off, and it will surface as a cost and latency regression before it surfaces as an error. If you have GLM-5.2 in production with thinking disabled, that is your Monday.

Our Take

The regulatory conversation has spent a year arguing about whether frontier labs should be allowed to release models above a capability threshold. GLM-5.3 sidesteps that argument entirely by being below the frontier. It is not the best exploitation model. It trails Mythos 5 by a wide margin on the benchmarks that require working code. Under any threshold-based framework I have seen drafted, including the still-unpublished EO 14409 launch bar, it plausibly clears.

And it will be the most capable freely downloadable exploitation-chain reasoner that has ever existed, by a distance, at the end of the month. Thresholds regulate the frontier. Distribution is what determines who holds the capability. Those two things have been drifting apart all summer and this release is where the gap becomes legible.

Three things I am watching. Whether an independent evaluator reproduces the CyberGym and ExploitBench numbers in a published harness, because every figure above is vendor-reported and the cyber scores ran in Z.ai's own configurations. Whether the weights actually ship on the stated two-week timeline or slip, because a slip would be the more informative outcome. And how long after publication the first refusal-stripped fine-tune appears, because that interval is the real half-life of the hardening pass Z.ai is spending the next fortnight on.

My guess on the last one is days. I would be glad to be wrong.