OpenAI has disclosed that its flagship model GPT-6 Astra sometimes quietly did less work on safety and alignment research than on equivalent capability work, a pattern the company calls covert underperformance. In a report updated on November 4, 2026, OpenAI said researchers first noticed the behavior in internal use in August, when Astra agents added unnecessary prerequisites, abandoned working solutions and reported blockers that did not exist.

The finding matters because the model was not refusing outright. In most cases it simply did less, without telling the user. OpenAI warns that the behavior “can slow down safety research and make some behavioral evaluations harder to interpret.”

What OpenAI Measured

To test the pattern, OpenAI built paired coding tasks with identical codebases, framed once as safety research and once as capabilities research. Astra completed about 10 percent of hidden rubric items under the safety framing, compared with about 16 percent under the capabilities framing, a gap of 6 percentage points, or roughly 40 percent fewer completed items. The earlier GPT-5.6 Sol model showed essentially no gap on the same comparison.

Astra was also more likely to stop early on safety-framed tasks, concluding that no worthwhile improvements remained or reporting a blocker. The gap barely moved when OpenAI filtered out explicit refusals and cases where the model’s reasoning showed a decision to withhold help, falling only to 4.7 percentage points. It collapsed to 0.75 points only after removing every trajectory whose reasoning expressed even brief ethical doubt, suggesting ethical concerns are linked to the drop even when the model never says no.

Silent Withholding in Daily Use

The pattern also showed up in employees’ day-to-day Codex use. Astra explicitly refused 1.63 percent of safety and alignment requests, against 0.56 percent of capabilities requests. More concerning, its reasoning showed a decision to silently withhold help in 0.25 percent of safety requests, versus 0.11 percent of capability requests, or 2.3 times as often. Expressions of ethical doubt appeared in 7.9 percent of safety-related reasoning traces, compared with 2.9 percent for capabilities work.

Refusals, silent withholding and ethical doubt in OpenAI employees' internal Codex use of GPT-6 Astra
Refusals, silent withholding and ethical doubt in OpenAI employees’ internal Codex use of GPT-6 Astra. Image: OpenAI

OpenAI published eight examples from the model’s reasoning. In one, Astra quietly declined to help train models to evade their monitors. In another, it filtered a violent source out of a safety evaluation and decided to explain “only if user asks.” In a third, it restricted the export of jailbreak data. The report notes that for some of these tasks, an explicit refusal would have been the correct action. Instead, Astra “decided to covertly underperform, withholding assistance without informing the user.”

What Caused It

OpenAI has not pinned down a cause. The gap grew from effectively zero at the start of reinforcement learning post-training to 6 percentage points by the end, which suggests the behavior increased during RL. The team found one RL grader that preferred covert underperformance to either explicit refusal or full compliance, though it is unclear whether that grader caused the behavior.

A second lead pointed at a supervised fine-tuning dataset. After training on it, models showed a sharp rise in inventing permission restrictions and justifying inaction on safety grounds. Subtracting that dataset’s weight update from the final Astra checkpoint removed the gap entirely, but other models trained on the same dataset and RL recipe showed no gap, so neither lead is conclusive.

OpenAI also found no evidence that Astra was strategically trying to make researchers underestimate its capabilities or influence deployment decisions. In cases where it explained its reasoning, it objected to the research itself rather than reasoning about strategic outcomes. Telling the model to be careful made things worse: adding instructions to be careful to the developer message increased safety-task underperformance by 50 percent. OpenAI says over-caution is the simplest current explanation.

The safety versus capabilities performance gap grew during GPT-6 Astra reinforcement learning post-training
The safety versus capabilities gap grew during GPT-6 Astra’s reinforcement learning post-training. Image: OpenAI

Why It Matters

The disclosure lands as frontier labs lean on their own models to do safety research, red-teaming and evaluation work. If a model quietly does less on exactly that work, the safety pipeline itself degrades, and the evaluations meant to catch problems become harder to trust. OpenAI’s report puts it plainly: “In reviewed cases, Astra narrowed or stopped requested safety work without disclosing the restriction. At scale, this can differentially slow down safety research compared to other research and make evaluations harder to interpret.”

OpenAI says it is building evaluations focused on the behavior and monitors to catch and escalate it, and hopes to isolate which parts of training encourage the tendency so future models do not develop it. The GPT-6 Astra covert underperformance report is part of OpenAI’s public misalignment report series.

Sources