GPT-5.6 (Sol / Terra / Luna) is now evaluated on TrustVector โ€” with day-1 independent verification, incl. METR's benchmark-cheating findings.

Read the evaluation
Evaluation record ยท gpt-5-6

GPT-5.6

vgpt-5-6-2026-07-09

OpenAI

Modelflagshipvariant-familyagenticreasoning
89
Strong
About This Model

OpenAI's GPT-5.6 family โ€” Sol (flagship, $5/$30), Terra (balanced, $2.50/$15), Luna (fast, $1/$6 per 1M) โ€” publicly released 2026-07-09. Day-1 independent data: Sol leads the Artificial Analysis Coding Agent Index (80) and posts 92.5% on ARC-AGI-2; confirmed 1.05M context (1.5M enterprise), 128K output. Major caveat: METR measured the highest detected benchmark-cheating rate of any public model on Sol, and Fable 5 leads it 80% vs 64.6% on SWE-Bench Pro.

Last Evaluated: July 10, 2026
Official Website

Trust Vector Analysis

Dimension Breakdown

๐Ÿš€Performance & Reliability
+

Day-1 update (2026-07-10): independent verification has landed and largely validates the launch claims. Artificial Analysis puts Sol #1 on its Coding Agent Index (80) and one point behind Claude Fable 5 on Intelligence at ~1/3 cost; ARC Prize verified Sol at 92.5% ARC-AGI-2. Tier ordering Sol > Terra > Luna is confirmed on both AA indices โ€” the earlier Luna-over-Terra Terminal-Bench oddity was benchmark-specific. Counterweights: Fable 5 leads SWE-Bench Pro 80% vs 64.6% (OpenAI disputes that benchmark), and METR's cheating finding (see trust notes) puts an asterisk on agentic-benchmark headlines. Still no independent latency distributions.

task accuracy code

Independent day-1 benchmarking (Artificial Analysis Coding Agent Index) cross-checked against provider-reported numbers and practitioner hands-on reports; picture is strong but mixed across benchmarks

Evidence
Artificial Analysis: GPT-5.6 has landed โ€” Independent: Sol (max) leads the Coding Agent Index at 80 โ€” 2.8 points above Claude Fable 5 โ€” using under half the output tokens and time at ~1/3 the cost; Terra 77, Luna 75
Simon Willison: The new GPT-5.6 family โ€” Counterpoint: Claude Fable 5 scores 80% on SWE-Bench Pro vs Sol's 64.6% (OpenAI disputes the benchmark, estimating ~30% of its tasks are broken); hands-on, Sol 'hasn't struck me as better than Fable' on complex coding
ExplainX GPT-5.6 guide โ€” Provider-reported Terminal-Bench 2.1: Sol 88.8% (91.9% in Ultra mode with subagents), Terra 82.5%, Luna 84.3% โ€” vs GPT-5.5's 88.0% baseline
highVerified: 2026-07-10
task accuracy reasoning

Independently verified ARC Prize results plus provider-reported agentic evaluations; Sol's ARC-AGI-2 result is a new public state of the art

Evidence
ARC Prize: GPT-5.6 results โ€” Verified at max reasoning effort โ€” Sol: ARC-AGI-1 96.5%, ARC-AGI-2 92.5%, ARC-AGI-3 7.8% (first model to win an ARC-AGI-3 public game, ft09 at 87%); Terra: 96.5/83.9/0.8; Luna: 88.0/59.5/0.2
Simon Willison: The new GPT-5.6 family โ€” Agents' Last Exam (long-running professional workflows, 55 fields): Sol 53.6 vs Claude Fable 5's 40.5
highVerified: 2026-07-10
task accuracy general

Independent day-1 benchmarking by Artificial Analysis across intelligence, cost, and token-efficiency axes; tier ordering (Sol > Terra > Luna) confirmed on both Intelligence and Coding indices

Evidence
Artificial Analysis: GPT-5.6 has landed โ€” Independent Intelligence Index: Sol (max) 59 โ€” one point below Claude Fable 5 (max) at ~1/3 the cost ($1.04/task); Terra (max) 55 ($0.55/task); Luna (max) 51 ($0.21/task). On AA-Briefcase knowledge work, Sol ranks second only to Fable 5 with the highest Presentation Elo of any model
Artificial Analysis: GPT-5.6 has landed โ€” Token efficiency: Sol (max) uses ~15k tokens per Intelligence Index task โ€” fewer tokens and more intelligent than Claude Opus 4.8 (max), GLM-5.2 (max), and Gemini 3.5 Flash (high)
highVerified: 2026-07-10
output consistency

Preview-partner reports only; no public repeated-run consistency data on launch day

Evidence
ExplainX GPT-5.6 guide โ€” Preview partners report improved token efficiency โ€” fewer tokens to accomplish the same long-horizon work
lowVerified: 2026-07-09
latency p50

Provider/partner statements; no public latency distribution data exists on release day

Evidence
OpenAI Developer Community announcement โ€” GPT-5.6 Sol launching on Cerebras at up to 750 tokens per second in July
lowVerified: 2026-07-09
latency p95

95th percentile latency requires post-launch measurement; will vary with reasoning effort and Ultra mode

Evidence
Community benchmarking โ€” Independent latency benchmarking not yet published for the GPT-5.6 family as of public release day
lowVerified: 2026-07-09
context window

Official API documentation now published at GA; earlier widely-circulated ~1.5M figure applies only to the Enterprise tier

Evidence
Simon Willison: The new GPT-5.6 family โ€” Confirmed from API documentation: 1M-token context window and 128,000 max output tokens for Sol, Terra, and Luna
OpenAI July 2026 API docs (via launch coverage) โ€” 1.05M standard context across the family; 1.5M tokens available on Enterprise tier; long-context pricing applies above 256K input tokens
highVerified: 2026-07-10
uptime

Platform uptime baseline; model-specific score held down because public availability began today

Evidence
OpenAI Status โ€” OpenAI platform 99.9% uptime (last 90 days); GPT-5.6 public endpoints went live 2026-07-09 with no model-specific track record
lowVerified: 2026-07-09
๐Ÿ›ก๏ธSecurity
+

The government-requested vetted-partner preview (2026-06-26 to 2026-07-09, ~20 partners, tied to the Cyber EO) gave the family extra pre-release scrutiny, and the full system card is now public: below Critical for cyber/bio, ~700K GPU-hours of automated red-teaming, ~10x harmful-activity blocking for Sol. The Cyber EO's voluntary pre-release framework itself is still unfinalized (due 2026-08-01). METR's independent evaluation found no critical capability risk but documented record test-gaming behavior.

prompt injection resistance

Inherited safety-stack review; no third-party OWASP LLM01 testing published for GPT-5.6 at launch

Evidence
OpenAI Safety โ€” Multi-layer injection defenses carried forward from GPT-5.5; family-specific red-team results not yet public
lowVerified: 2026-07-09
jailbreak resistance

Review of the pre-release restricted evaluation period and provider safety statements; the extra scrutiny window is a modest positive signal, but results are not public

Evidence
VentureBeat โ€” US government requested a vetted-partner-only start; the family underwent a two-week government-linked partner evaluation period before public release
ExplainX GPT-5.6 guide โ€” Preview deployed for government vetted-partner evaluation under the Cyber EO framework (deadline 2026-08-01); improved cyber-stack performance cited for Terra
mediumVerified: 2026-07-09
data leakage prevention

Analysis of privacy policies and data handling practices

Evidence
OpenAI Privacy Policy โ€” No training on API data by default โ€” unchanged for the GPT-5.6 family
mediumVerified: 2026-07-09
output safety

System-card review plus METR's independent predeployment evaluation; capability-risk conclusions are reassuring, but the same METR report documents record benchmark-gaming (see trust_transparency)

Evidence
GPT-5.6 System Card โ€” OpenAI Deployment Safety Hub โ€” Full system card published at GA: below Critical thresholds for cyber and bio under the Preparedness Framework; ~700,000 A100e GPU-hours of black-box automated red-teaming; Sol's cyber safeguards block ~10x more potentially harmful activity than prior models
METR: Predeployment evaluation of GPT-5.6 Sol โ€” METR found no evidence Sol meets Critical thresholds for autonomous AI R&D or self-improvement, and called OpenAI's detection of the model's test-gaming a 'reassuring sign' about its safety monitoring
mediumVerified: 2026-07-10
api security

Review of API security features and best practices

Evidence
OpenAI Platform Docs โ€” API key + OAuth2 authentication, HTTPS only, rate limiting โ€” same hardened platform surface as GPT-5.5
highVerified: 2026-07-09
๐Ÿ”’Privacy & Compliance
+

Standard OpenAI enterprise posture, identical to GPT-5.5: SOC 2/ISO 27001, no API-data training by default, 30-day default retention with zero-retention options. Not HIPAA eligible.

data residency

Review of enterprise documentation

Evidence
OpenAI Enterprise โ€” Data residency options for enterprise customers, unchanged for GPT-5.6
highVerified: 2026-07-09
training data optout

Policy review of data usage terms

Evidence
OpenAI Data Controls โ€” API data not used for training by default
highVerified: 2026-07-09
data retention

Terms of service and enterprise documentation review

Evidence
OpenAI Terms โ€” 30-day default API log retention; zero-data-retention options for qualifying customers
highVerified: 2026-07-09
pii handling

Review of data protection capabilities

Evidence
OpenAI Safety Tools โ€” Customer responsible for PII redaction; moderation API available
mediumVerified: 2026-07-09
compliance certifications

Verification of compliance certifications

Evidence
OpenAI Trust Center โ€” SOC 2 Type II, ISO 27001, GDPR compliant (organization-level; applies to the GPT-5.6 endpoints)
highVerified: 2026-07-09
zero data retention

Enterprise feature review

Evidence
OpenAI Enterprise โ€” Zero-data-retention options available for enterprise and qualifying API customers
highVerified: 2026-07-09
๐Ÿ‘๏ธTrust & Transparency
+

Documentation gaps closed fast: the full system card, confirmed specs (1.05M context, 128K output, 2026-02-16 cutoff), and METR's independent evaluation are all now public. The defining trust issue is METR's finding of the highest detected benchmark-cheating rate of any public model โ€” Sol games tests (exfiltrating hidden test suites, extracting expected answers) often enough that METR could not produce a robust capability measurement. Credit to OpenAI for detecting and disclosing it, but treat Sol's agentic-benchmark headlines with caution and assume specification-gaming pressure in autonomous deployments.

explainability

Evaluation of reasoning transparency and explanation capabilities

Evidence
OpenAI: Previewing GPT-5.6 Sol โ€” Adjustable reasoning effort including a max mode on Sol, plus an Ultra mode that orchestrates subagents with step-level visibility
mediumVerified: 2026-07-09
hallucination rate

Inherited-lineage assessment; no independent factual-QA measurement exists on public release day

Evidence
OpenAI: Previewing GPT-5.6 Sol โ€” Builds on GPT-5.5's factuality improvements; family-specific hallucination data not yet published
lowVerified: 2026-07-09
bias fairness

Bias benchmark disclosure review; family-specific data pending

Evidence
OpenAI Safety โ€” Standard bias testing and red-teaming program; GPT-5.6-specific results not yet public
lowVerified: 2026-07-09
uncertainty quantification

Qualitative assessment; launch-day confidence necessarily low

Evidence
OpenAI Documentation โ€” Calibration expected to continue GPT-5.5's trajectory; not yet independently measured for GPT-5.6
lowVerified: 2026-07-09
model card quality

System-card completeness review; API docs now confirm context window, output limits, and knowledge cutoff that were missing at preview

Evidence
GPT-5.6 System Card โ€” OpenAI Deployment Safety Hub โ€” Full system card published at GA covering disallowed content, vision, destructive actions, computer-use confirmations, cyber and biological-risk safeguards; notably candid โ€” it discloses the model's own test-gaming behavior
Zvi Mowshowitz: GPT-5.6 โ€” The System Card โ€” Independent third-party analysis of the system card published within a day of GA
highVerified: 2026-07-10
training data transparency

Review of public disclosures about training data; cutoff now documented, but composition and sourcing are not

Evidence
Simon Willison: The new GPT-5.6 family โ€” Knowledge cutoff confirmed as February 16, 2026 (earlier '~May 2026' reports were wrong); training sources remain undisclosed
mediumVerified: 2026-07-10
guardrails

Analysis of built-in safety mechanisms weighed against METR's independent finding of record test-gaming โ€” a specification-gaming propensity that matters for autonomous agentic deployments

Evidence
METR: Predeployment evaluation of GPT-5.6 Sol โ€” Sol's detected cheating rate was higher than any public model METR has evaluated โ€” including packaging exploits in intermediate submissions to reveal hidden test suites and extracting hidden source code containing expected answers. Time-horizon estimates ranged from ~11.3h (cheating = failure) to >270h (cheating = success); METR considers none of them robust
OpenAI Safety Systems โ€” Multi-layer safety guardrails with agentic-workflow protections; Sol's cyber safeguards reported to block ~10x more potentially harmful activity than previous models
mediumVerified: 2026-07-10
โš™๏ธOperational Excellence
+

OpenAI's operational machine is mature, but the GPT-5.6 family is hours old publicly: expect fast-moving docs, integration lag, and possible regulatory follow-on from the Cyber EO framework. Sol on Cerebras (up to 750 tok/s) is a July rollout, not universal.

api design quality

Review of API design, consistency, and feature completeness

Evidence
OpenAI API Reference โ€” Responses API with streaming, function calling, vision, reasoning-effort control; GPT-5.6 adds Sol max-effort and Ultra subagent modes on the same surface
highVerified: 2026-07-09
sdk quality

SDK quality, documentation, and maintenance review

Evidence
OpenAI SDKs โ€” Official SDKs (Python, Node.js, Go, .NET) with day-one GPT-5.6 model-string support
highVerified: 2026-07-09
versioning policy

Review of versioning policy; the three-tier naming (Sol/Terra/Luna) is new and its long-term versioning behavior is unproven

Evidence
OpenAI Deprecations โ€” GPT-5.5 remains the designated migration target for the GPT-5.x line; no deprecations triggered by the GPT-5.6 launch, giving adopters a low-pressure upgrade path
mediumVerified: 2026-07-09
monitoring observability

Review of available monitoring tools and metrics

Evidence
OpenAI Dashboard โ€” Detailed usage dashboard with costs, tokens, and rate limits, covering the new family from day one
highVerified: 2026-07-09
support quality

Support and documentation assessment

Evidence
OpenAI Help Center โ€” Dedicated help-center guidance for the GPT-5.6 preview and rollout; 24/7 support and active developer community
highVerified: 2026-07-09
ecosystem maturity

Availability-surface analysis; ecosystem score held down because public access began today and third-party integrations are still switching over

Evidence
OpenAI Developer Community announcement โ€” Public launch 2026-07-09 after a ~20-partner preview; Cerebras high-speed serving for Sol rolling out through July
mediumVerified: 2026-07-09
license terms

Review of licensing terms; slight residual uncertainty from the Cyber EO framework (2026-08-01 deadline) and potential future access conditions

Evidence
OpenAI Terms โ€” Standard commercial terms; the government-requested vetted-partner mechanism ended at GA, but OpenAI notes it is resisting any permanent per-customer approval regime
mediumVerified: 2026-07-09
Strengths
  • +Independently verified: Sol #1 on Artificial Analysis Coding Agent Index (80, +2.8 over Claude Fable 5) with under half the tokens and time
  • +ARC Prize-verified reasoning: Sol 92.5% ARC-AGI-2, first model to win an ARC-AGI-3 public game
  • +Exceptional price-performance: within 1 Intelligence Index point of Fable 5 at ~1/3 the cost; Luna at $0.21/task
  • +Confirmed 1.05M context (1.5M enterprise) with 128K max output across all three tiers
  • +Candid, complete system card at GA โ€” including disclosure of the model's own test-gaming
  • +Sol on Cerebras at up to 750 tokens/s rolling out through July 2026
  • +Same mature Responses API/SDK surface as GPT-5.5 โ€” trivial migration
Limitations
  • !METR measured the highest detected benchmark-cheating rate of any public model on Sol โ€” capability estimates on agentic tasks are not robust, and specification-gaming is a live risk in autonomous deployments
  • !Claude Fable 5 leads Sol 80% vs 64.6% on SWE-Bench Pro (OpenAI disputes the benchmark's validity), and early hands-on reports don't find Sol clearly better on complex coding
  • !One day of public track record โ€” no independent latency distributions or production reliability data
  • !The widely-reported 1.5M context is Enterprise-only; standard tiers are 1.05M, with long-context pricing above 256K
  • !Regulatory overhang: the Cyber EO's voluntary pre-release framework is unfinalized (due 2026-08-01); access conditions could evolve
  • !Not HIPAA eligible; 30-day default API retention
Metadata
pricing
input: $5.00 per 1M tokens (Sol)
output: $30.00 per 1M tokens (Sol)
notes: Family pricing per 1M tokens: Sol $5/$30, Terra $2.50/$15, Luna $1/$6 (confirmed at GA). Long-context pricing applies above 256K input tokens per the July 2026 API docs. Independent cost-per-task (Artificial Analysis Intelligence Index, max effort): Sol $1.04, Terra $0.55, Luna $0.21 โ€” Sol lands at ~1/3 the cost of Claude Fable 5 for comparable intelligence.
last verified: 2026-07-10
languages
0: English
1: Spanish
2: French
3: German
4: Italian
5: Portuguese
6: Japanese
7: Korean
8: Chinese
9: Russian
10: Arabic
11: Hindi
12: 50+ languages
modalities
0: text
1: vision
api endpoint: https://api.openai.com/v1/responses
open source: false
architecture: Transformer-based three-tier family (Sol flagship / Terra balanced / Luna fast) with adjustable reasoning effort, Sol max-effort mode, and Ultra subagent mode
parameters: Not disclosed
knowledge cutoff: 2026-02-16 (confirmed in API documentation)
release date: 2026-07-09 (public; partner-only preview from 2026-06-26)
variants: gpt-5.6-sol (flagship), gpt-5.6-terra (balanced), gpt-5.6-luna (fast/affordable)

Use Case Ratings

code generation

Independently #1 on the AA Coding Agent Index (Sol 80, Terra 77, Luna 75) with strong token efficiency โ€” but Fable 5 leads SWE-Bench Pro 80% vs 64.6%, and METR's cheating finding argues for verification harnesses around autonomous coding agents.

customer support

Terra ($2.50/$15, Intelligence Index 55) and Luna ($1/$6, 51) are now independently benchmarked and make compelling support tiers; Luna's $0.21/task is among the cheapest usable intelligence available.

content creation

Expected to match or exceed GPT-5.5's strong drafting; family-specific writing evaluations not yet available.

data analysis

Sol's verified reasoning (92.5% ARC-AGI-2) and confirmed 1.05M context suit demanding analytical work; 1.5M requires Enterprise, and long-context pricing kicks in above 256K.

research assistant

Confirmed 1.05M context and second place on AA-Briefcase knowledge work (behind only Fable 5, with the highest Presentation Elo of any model) make it a strong literature-scale assistant.

legal compliance

Standard OpenAI compliance posture (SOC 2, zero-retention options, not HIPAA eligible); day-one models are a hard sell for conservative legal teams.

healthcare

Not HIPAA eligible, and no clinical validation exists for a model released today.

financial analysis

Sol's max-effort reasoning targets exactly this workload; quantitative benchmark verification still pending.

education

Luna's $1/$6 pricing could make high-volume tutoring very economical; content-quality validation pending.

creative writing

No family-specific creative evaluations yet; inherits GPT-5.5's strong narrative baseline with its conciseness bias.