GPT-6.1 Terra vs Kimi K3.1 Pro: Same Rails Ticket, Real Cost
GPT-6.1 Terra and Kimi K3.1 Pro get the same Rails ticket in the same agent, twice each, and I measure what a finished ticket really costs: time, money, interventions, tests, and one rule the tests don't check.
Prerequisites: Rails 8, Solid Queue, Turbo Streams; to rerun it: OpenCode 2.1.4 and an OpenRouter account
Not covered: self-hosting Kimi, other agents, Claude in the comparison, more than one ticket
Source: https://github.com/webmatze/demo-shop (branches: episode-010-before / episode-010-after)
Results (OpenCode 2.1.4 via OpenRouter, provider pinned, reasoning effort high, two runs per model, measured 2026-10-28):
- GPT-6.1 Terra: 1:53 / 2:23, $0.090 / $0.111, 0 interventions, 69 / 72 tests green
- Kimi K3.1 Pro: 2:38 / 2:52, $0.118 / $0.131, 0 interventions, 61 / 61 tests green
Costs are what OpenRouter billed, to the cent. Neither model leaked the export notice to another seller (4 of 4 runs).
The ticket: https://github.com/webmatze/demo-shop/blob/episode-010-before/docs/briefs/payout-export.md
The failing tests: https://github.com/webmatze/demo-shop/tree/episode-010-before/test
AGENTS.md: https://github.com/webmatze/demo-shop/blob/episode-010-before/AGENTS.md
Terra's run: https://github.com/webmatze/demo-shop/tree/episode-010-terra
Kimi's run: https://github.com/webmatze/demo-shop/tree/episode-010-kimi
Prices and vendor numbers as of 2026-10-28:
- GPT-6.1 Terra launch (price, speed claim, Terminal-Bench): https://www.bleepingcomputer.com/news/artificial-intelligence/openai-launches-gpt-61-terra-with-3x-faster-ai-agents-50-percent-lower-pricing/
- Kimi K3.1 Pro by Moonshot (Terminal-Bench, hallucination test, open weights by Nov 4): https://www.kimi.com/en/blog/kimi-k3-1-pro
- OpenRouter prices: https://openrouter.ai/openai/gpt-6.1-terra and https://openrouter.ai/moonshotai/kimi-k3.1-pro