GPT-5.6 (Sol / Terra / Luna) is now evaluated on TrustVector โ€” with day-1 independent verification, incl. METR's benchmark-cheating findings.

Read the evaluation
Evaluation record ยท warp

Warp / Oz

vADE 2.x; client open-sourced 2026-04-28

Warp

Agentagentic-development-environmentterminalmulti-agentopen-source
77
Strong
About This Agent

Warp's Agentic Development Environment (ADE): a Rust-based terminal reimagined for prompt-driven, multi-agent software development, paired with Oz, its cloud agent orchestration platform. Warp 2.0 launched the ADE in June 2025; the client was open-sourced under dual MIT/AGPLv3 licensing on 2026-04-28 with OpenAI as founding repository sponsor. Used by nearly a million developers, including Docker and over half the Fortune 500.

Last Evaluated: July 9, 2026
Official Website

Trust Vector Analysis

Dimension Breakdown

๐Ÿš€Performance & Reliability
+
task completion accuracy

Review of vendor-reported acceptance metrics and third-party recognition; no fully independent benchmark of the current agent stack, so vendor figures are weighted cautiously

Evidence
Warp 2.0 ADE launch blog โ€” Warp reported a 95% acceptance rate across 75 million lines of agent-generated code and 6-7 hours/week saved when running multiple agents
TIME Best Inventions 2025 โ€” Warp's ADE recognized in TIME's Best Inventions 2025, reflecting strong real-world task performance
mediumVerified: 2026-07-09
tool use reliability

Review of built-in agent toolchain, external agent hosting, and MCP integration reliability in terminal workflows

Evidence
Warp GitHub repository โ€” Built-in coding agents plus first-class hosting of external CLI agents (Claude Code, Codex, Gemini CLI) inside the ADE; MCP support and native terminal tooling
mediumVerified: 2026-07-09
multi step planning

Evaluation of Oz's plan-first lifecycle (triage, clarification, planning, implementation, PR) on open repository workflows

Evidence
Warp open-source announcement โ€” Oz triages issues, asks clarifying questions, generates implementation plans, writes code, and opens pull requests end-to-end
mediumVerified: 2026-07-09
memory persistence

Review of Warp Drive persistence and Oz cross-session memory/handoff claims; long-horizon memory less battle-tested than incumbents

Evidence
Warp is now open-source blog โ€” Oz platform handles orchestration, memory, and handoff across agent sessions; Warp Drive persists shared workflows, prompts, and environment context
mediumVerified: 2026-07-09
error recovery

Observation of agent self-correction loops and human-in-the-loop escalation in the ADE's multi-agent management UI

Evidence
Warp 2.0 ADE launch blog โ€” Agent management UI surfaces agents that are blocked or need help; agents iterate on failing commands and long-running tasks with human handoff
mediumVerified: 2026-07-09
agent collaboration

Assessment of parallel agent management, cloud agent fan-out via Oz, and cross-agent handoff as the product's primary design goal

Evidence
Warp open-source announcement โ€” Multi-agent orchestration is the core product: parallel local and cloud agents with a management UI, and Oz coordinating fleets of cloud agents with visible sessions, reviews, and progress
highVerified: 2026-07-09
๐Ÿ›ก๏ธSecurity
+
tool sandboxing

Architecture review of cloud sandbox isolation versus local terminal execution; local runs rely on approval flows, not kernel-enforced isolation

Evidence
Warp cloud agents overview โ€” Cloud agents run in Warp-managed sandboxes (metered as compute credits); local agent commands execute in the user's terminal with permission/approval controls rather than OS-level sandboxing
mediumVerified: 2026-07-09
access control

Review of identity (SSO), admin data controls, and per-plan governance features

Evidence
Warp pricing โ€” Business plan adds SAML SSO and admin-configurable data controls; Enterprise adds advanced spend controls, enterprise admin controls, and self-hosted cloud agents
mediumVerified: 2026-07-09
prompt injection defense

Threat surface analysis of Oz's autonomous issue triage/PR workflows and local agent command execution; limited public disclosure and no third-party security research yet

Evidence
Warp documentation โ€” Agents process untrusted repository content, issues, and web output; command approval gates risky actions, but injection-specific defenses are not publicly detailed
lowVerified: 2026-07-09
data isolation

Review of ZDR agreements for managed model routing and per-run cloud sandbox separation

Evidence
Warp pricing and billing FAQs โ€” All Warp-managed model traffic is covered by Zero Data Retention agreements with OpenAI, Anthropic, and Google; providers cannot store or train on user data. Business plan adds enforced ZDR
mediumVerified: 2026-07-09
open source transparency

License and source availability review; full client auditability with a closed cloud orchestration backend

Evidence
Warp GitHub repository โ€” Client codebase (98% Rust) open-sourced 2026-04-28 under dual licensing: MIT for the warpui UI framework, AGPLv3 for the rest; 63K stars and 5.2K forks by July 2026. Oz cloud platform remains proprietary
highVerified: 2026-07-09
๐Ÿ”’Privacy & Compliance
+
data retention

Review of published ZDR commitments across plan tiers and telemetry/data control settings

Evidence
Warp pricing and billing FAQs โ€” Zero Data Retention agreements with model providers apply on all plans for Warp-managed traffic; Business and Enterprise plans add enforced ZDR and admin data controls
mediumVerified: 2026-07-09
gdpr compliance

Compliance certification review; SOC 2 verified, GDPR posture inferred from data governance features rather than a published DPA page

Evidence
Warp pricing (compliance footer) โ€” SOC 2 certified; enterprise data governance offered on Enterprise plan. GDPR-specific documentation is less prominent than SOC 2 attestation
mediumVerified: 2026-07-09
third party data sharing

Data flow analysis of multi-provider model routing; third parties are in the loop by design, with contractual ZDR mitigation

Evidence
Warp pricing โ€” Prompts and code route to third-party frontier models (OpenAI, Anthropic, Google) plus open models (Kimi, MiniMax, Qwen), mitigated by ZDR agreements and BYO-LLM/BYOK options
mediumVerified: 2026-07-09
local deployment option

Deployment options assessment: open client plus BYO-LLM enables substantial local control, but the Oz orchestration layer requires Warp's cloud

Evidence
Warp pricing โ€” Open-source client can be built from source; free tier supports bring-your-own inference (including local/open models), and Enterprise offers self-hosted cloud agents and BYO-LLM. Oz platform itself is cloud-hosted
mediumVerified: 2026-07-09
๐Ÿ‘๏ธTrust & Transparency
+
documentation quality

Documentation completeness and accuracy review across agent, platform, and billing docs

Evidence
Warp documentation โ€” Comprehensive docs covering agents, cloud agent platform, credits/billing, MCP, and team administration
highVerified: 2026-07-09
execution traceability

Review of Oz session visibility, shareable session links, and agent management UI observability

Evidence
Warp open-source announcement โ€” Oz sessions are public on Warp's own repo: session links, reviews, and progress visible to anyone; ADE shows live status of all running agents
mediumVerified: 2026-07-09
decision explainability

Assessment of plan publication, clarifying-question loops, and PR-based change justification

Evidence
Warp open-source announcement โ€” Oz asks clarifying questions and publishes implementation plans before writing code; PRs document the resulting changes
mediumVerified: 2026-07-09
open source code

Open source assessment of client versus cloud components

Evidence
Warp GitHub repository โ€” Client fully open (dual MIT/AGPLv3) with contribution guidelines and community Slack; Oz cloud orchestration and hosted services remain closed-source
highVerified: 2026-07-09
community activity

Community engagement analysis via GitHub metrics, sponsorship, and open contribution model

Evidence
Warp GitHub repository โ€” 63K GitHub stars and 5.2K forks within ~10 weeks of open-sourcing; OpenAI is founding repository sponsor and Oz-for-OSS extends the model to other projects
Warp is now open-source blog โ€” Nearly one million active developers; community contribution flywheel where user ideas become agent-shipped improvements
highVerified: 2026-07-09
โš™๏ธOperational Excellence
+
ease of integration

Setup and adoption-path assessment: incremental adoption from terminal to ADE with no workflow rewrite required

Evidence
Warp product page โ€” Drop-in terminal replacement for existing shells on macOS, Linux, and Windows; hosts external CLI agents and scales from plain terminal UI to full ADE via customizable modes
highVerified: 2026-07-09
scalability

Assessment of parallel cloud agent fan-out, platform APIs, and enterprise scaling options

Evidence
Warp cloud agents overview โ€” Oz cloud agents run in parallel managed sandboxes with lifecycle APIs, integrations, and dashboards; Enterprise offers custom credit pools and self-hosted cloud agents
mediumVerified: 2026-07-09
cost predictability

Pricing model analysis: subscriptions cap spend but three-bucket credit burn on cloud agents is variable and hard to forecast per task

Evidence
Warp credits and billing docs โ€” Credit metering spans AI, compute, and platform buckets from one pool; cloud agents require at least 20 credits available to start. Build $20/mo = 1,500 credits; Max $200/mo = 18,000; Business $50/user/mo
highVerified: 2026-07-09
monitoring capabilities

Review of usage dashboards, team metrics, and cloud agent observability features

Evidence
Warp pricing โ€” Team usage metrics and admin controls on Business plan; cloud agent platform includes run lifecycle dashboards and observability (metered as platform credits)
mediumVerified: 2026-07-09
production readiness

Maturity assessment: mature terminal core with large enterprise footprint, balanced against the recency of the Oz agent platform

Evidence
Warp open-source announcement โ€” Nearly one million developers, deployed at Docker, Ramp, Peloton, and over half the Fortune 500; terminal shipping since 2021, though Oz cloud agents launched broadly only in 2026
mediumVerified: 2026-07-09
Strengths
  • +Client open-sourced 2026-04-28 (dual MIT/AGPLv3, 98% Rust) with 63K GitHub stars and OpenAI as founding repository sponsor
  • +Purpose-built multi-agent orchestration: parallel agents, management UI, and Oz cloud agent platform
  • +Massive adoption: nearly 1M developers including Docker and over half the Fortune 500
  • +Zero Data Retention agreements with model providers on all plans; enforced ZDR and SSO on team plans
  • +Model flexibility: frontier models, open models (Kimi, MiniMax, Qwen), BYOK, and enterprise BYO-LLM
  • +Radically transparent Oz development: sessions, plans, and reviews public on its own repository
  • +Free tier keeps the terminal itself free with bring-your-own inference
Limitations
  • !Oz cloud agent platform is recent (broad launch 2026) and remains proprietary despite the open client
  • !Three-bucket credit metering (AI, compute, platform) makes per-task costs hard to predict; cloud agents need a 20-credit floor to start
  • !Local agent commands run in the user's terminal with approval gates, not OS-level sandboxing
  • !Prompt injection defenses for autonomous issue/PR workflows are not publicly documented; no third-party security research yet
  • !Code routes to third-party model providers by design (mitigated contractually via ZDR)
  • !AI features are credit-metered even on paid tiers; heavy multi-agent use burns quota quickly
Metadata
repository: https://github.com/warpdotdev/warp
license: Dual MIT (warpui UI framework) / AGPLv3 (rest of client); Oz cloud platform proprietary
supported models
0: OpenAI GPT models (including GPT-5.5)
1: Anthropic Claude models
2: Google Gemini models
3: Open models: Kimi, MiniMax, Qwen
4: BYOK / enterprise BYO-LLM
programming languages
0: Language-agnostic (terminal-native; any language in the repository)
deployment type: Local desktop app (macOS/Linux/Windows) + Oz managed cloud agents; enterprise self-hosted cloud agents
tool support
0: Built-in coding agents and terminal tools
1: External CLI agents (Claude Code, Codex, Gemini CLI)
2: MCP servers
3: Oz cloud agent platform (triage, planning, PRs)
4: Warp Drive shared workflows
first release: Terminal 2021; Warp 2.0 ADE 2025-06-25; open-sourced 2026-04-28
pricing: Terminal free; Build $20/mo (1,500 credits); Max $200/mo (18,000 credits); Business $50/user/mo; Enterprise custom. Cloud agents require >=20 credits available
adoption: Nearly 1M developers; Docker, Ramp, Peloton, over half the Fortune 500; SOC 2 certified

Use Case Ratings

code generation

Strong multi-agent coding in terminal-native workflows; excels when orchestrating several agents (including external CLIs) across repos and infrastructure tasks

data analysis

Capable for shell-driven data work and scripting; not specialized for notebooks or analytics tooling

research assistant

Agents can research codebases and docs, but the product is optimized for building and operating software, not general research

content creation

Limited to technical writing incidental to engineering work; not a content tool