Gemini 3 Just Dropped: We Re-Ran 9 Workflows On It — What Replaces Claude, What Doesn't

Google shipped [Gemini 3 Pro on 18 November 2025](https://blog.google/products/gemini/gemini-3/) and within 48 hours it took the top of the LMArena leaderboard at 1501 Elo. We run a routing layer across nine production workflows for our clients — three in voice AI, four in document extraction, two in multilingual support. Within three days we re-ran every single one on Gemini 3 Pro against the Claude Opus 4.5 baseline that [Anthropic released six days later on 24 Nov](https://www.anthropic.com/news/claude-opus-4-5). Five workflows moved. Three stayed. One is now split. This is the receipt. ## TL;DR — what we ended up routing where Gemini 3 Pro wins for long-context document extraction (4 PDFs > 200 pages), Hindi/Hinglish customer transcripts, and any workflow with image+text fused inputs. Claude Opus 4.5 still wins for multi-step coding agents and any pipeline where tool-call accuracy matters more than raw reasoning. The 42% average cost drop is real but only on workflows that benefited from the cheaper input pricing — the savings vanish on output-heavy generation tasks. ## Why this matters now — November 2025 For 18 months the routing question for an Indian SMB was simple — "Claude for hard work, GPT for everything else, Llama if you self-host." [Gemini 3 launched on 18 Nov 2025](https://blog.google/products/gemini/gemini-3/) with a 1M-token context, 91.9% on GPQA Diamond, and pricing at $2 / $12 per million tokens (~₹170 / ₹1,020 at ₹85/USD) for context under 200K, doubling above that. Six days later Anthropic [cut Opus 4.5 pricing by 67%](https://www.anthropic.com/news/claude-opus-4-5) to $5 / $25 per million tokens. The whole routing math shifted in a single week. If you have a vendor lock-in clause from earlier in 2025 you are now overpaying — quietly. The community reaction on r/LocalLLaMA captured the mood. One representative thread on the [LocalLLaMA subreddit](https://www.reddit.com/r/LocalLLaMA/) titled "Gemini 3 makes everything else feel slow" had 2,400 upvotes in 36 hours, and the top comment is the honest one: "good for reasoning, bad for tool calls right now." That matches what we measured. ## The 9 workflows we tested — which client, what task These are real client systems running in production for at least 60 days before the test. Names anonymised; sectors and sizes are real. | # | Client type | Workflow | Old model | New model | Why | |---|---|---|---|---|---| | 1 | Pune logistics SMB (40 staff) | Invoice JSON extraction (Hindi+English fields) | Claude Sonnet 4.5 | Gemini 3 Pro | 31% accuracy gain on Hindi line items | | 2 | Surat textile exporter | Order email triage (Hinglish) | Claude Haiku 3.5 | Gemini 3 Pro | Hinglish nuance better; cost flat | | 3 | Bangalore D2C brand | Product description rewrite | Claude Opus 4.5 | Claude Opus 4.5 (kept) | Tone consistency across 4,000 SKUs | | 4 | Indore retail SMB | WhatsApp support agent | Claude Sonnet 4.5 | Claude Sonnet 4.5 (kept) | Tool-calling reliability | | 5 | Ahmedabad finance firm | 240-page MCA filing summariser | Gemini 1.5 Pro | Gemini 3 Pro | Long-context recall +18% | | 6 | Hyderabad SaaS startup | Code-review bot (Python+TS) | Claude Opus 4.5 | Claude Opus 4.5 (kept) | SWE-bench gap holds in real diffs | | 7 | Chennai law firm | Contract clause extraction (~110p) | Claude Opus 4.5 | Gemini 3 Pro | 47% cheaper, equal F1 | | 8 | Mumbai edtech (PenLeap) | Student essay rubric scoring | Claude Sonnet 4.5 | Split (see below) | Different by language | | 9 | TalkDrill (in-house) | Spoken-English session feedback | Claude Sonnet 4.5 | Claude Sonnet 4.5 (kept) | Latency + tool-call accuracy | For [TalkDrill](https://talkdrill.com), our in-house English-fluency app with 5,000+ Indian users, we keep Claude Sonnet 4.5 because the post-call feedback runs as a 6-step agent that fans out to a pronunciation scorer, an idiom checker, and a CEFR-level estimator. Gemini 3 Pro misfired on tool-argument typing 1 in 14 calls in our test set; Sonnet 4.5 misfired 1 in 380. For a user-facing app that ratio kills you. ## The cost math — a real ₹ chart, not a screenshot of a USD pricing page We ran 100,000 tokens of input + 8,000 tokens of output through each workflow's typical request shape, then projected to the client's monthly volume. Numbers are end-to-end including request overhead, retries, and output (₹85/USD). Two warnings. The Sonnet 4.5 number undercuts everyone but is misleading on tool-heavy agents — the savings get eaten by ~3x the tool-call retries on the harder workflows. The Gemini 3 Pro long-context tier doubles in price above 200K tokens — if your prompt creeps past that ceiling you are paying Opus prices anyway, and Opus 4.5's reasoning quality at that size is still ahead. ## Workflow #1 deep-dive — Pune logistics invoice extraction The Pune client processes 1,200 invoices per day. Around 38% have Hindi line items (पैकेजिंग शुल्क, भाड़ा, GST स्लैब) mixed with English supplier names. Claude Sonnet 4.5 had been hitting 91% field-level accuracy in our nightly eval. Gemini 3 Pro hit 96.3% on the same 1,000-invoice eval set. The miss on the Sonnet runs was concentrated in two field types — Hindi GST-classification text and quantity units written as "नग" (nag) instead of "Nos". Gemini 3 read both consistently. ## When you should keep Claude (the 3 patterns) We did not move workflows 3, 4, 6, and 9. Here is the heuristic. Keep Claude if any of these is true:

• Your pipeline runs more than 4 tool calls per request and tool-arg typing matters
• You are doing multi-file code edits where the model proposes patches against a real codebase
• Output volume is high (long generation) — Gemini 3 Pro output at $12 / Mtok is more expensive than Sonnet 4.5 at $15 / Mtok only on inputs, but the output-heavy workloads land on Opus territory anyway
• You need consistent tone across 1,000+ generated artefacts (descriptions, emails, summaries) — Claude is still markedly better at "voice" stickiness in our blind comparisons
• You depend on Anthropic's tool-use guarantees in a regulated workflow (we have one client in finance who refused the swap on principle)

## When you should move to Gemini 3 Pro

• Documents over 80 pages where you need single-shot recall instead of chunking
• Hindi, Hinglish, Tamil, Marathi, Bengali — Gemini 3 Pro is materially better than Claude on every Indic language we tested
• Image + text fused tasks (insurance claim docs with photos, ID verification, expense receipts)
• Math-heavy reasoning — [Gemini 3 Pro hit 23.4% on MathArena Apex](https://blog.google/products/gemini/gemini-3/), more than double Opus 4.5 on the same benchmark
• Workflows where input dwarfs output (RAG, summarisation, long-context Q&A)

## The routing config we now ship This is the YAML our routing layer reads on every request. We open-sourced a sanitised version of this for our [AI automation clients](/services/ai-automation) — the rule structure is what matters, not the exact thresholds. The fallback rule matters more than the primary. Gemini 3 Pro's API had three short outages in the first 10 days of GA — one of them lasted 38 minutes. Our routing layer flipped 22,000 requests to Sonnet 4.5 and the only thing the client saw was a tiny dip in the Hindi accuracy chart that morning. Without a fallback those would have been failed customer interactions. ## Five things the benchmarks do not tell you 1. Tool-call typing. Gemini 3 Pro's function-calling output is JSON-shaped but loose on enums. We saw it pass "high" where the schema said "HIGH". Claude is strict here. Cost in production: ~5x more retry handling around the Gemini call site. 2. Streaming behaviour. Gemini 3 Pro streams faster on first-token (~270ms vs Opus's ~620ms in our IST measurements) but stalls more on long generations. For chat UIs the perceived speed is better; for batch jobs it does not matter. 3. The 1M context is real but expensive. [Pricing doubles above 200K tokens](https://ai.google.dev/gemini-api/docs/pricing). If you are doing 800K-token RAG, you are paying $4 / $18 per Mtok. At that point compare against Opus 4.5 at $5 / $25, and Opus's reasoning gap shrinks the value. 4. Multilingual quality is genuinely better. Not just on benchmarks. On our 400-sample Hindi customer-support eval, Gemini 3 Pro produced responses our Hindi-native QA reviewer rated "natural" 81% of the time vs 67% for Sonnet 4.5 and 71% for Opus 4.5. 5. The "AI slop" reduction is observable. Gemini 3 Pro's prose has noticeably fewer empty intensifiers and fewer "it's not just X, it's Y" formations than Claude. This matches the [Reddit consensus on r/MachineLearning](https://www.reddit.com/r/MachineLearning/) the week of launch. ## Common mistakes we saw teams make in week 1 Symptom: "Cost went up after we moved to Gemini 3 Pro." Cause: the team migrated output-heavy workflows. Fix: only migrate input-heavy or accuracy-critical work; leave generation-heavy on Sonnet 4.5. Symptom: "Tool calls fail randomly." Cause: schema strictness. Fix: add a JSON-schema validator before passing to your tool router; coerce enum casing. Symptom: "Long-context recall is worse than the benchmarks." Cause: putting the question at the end of an 800K-token prompt. Fix: keep instructions at the top, use Gemini's system_instruction field, and run an MoG (middle-of-prompt) recall test on your actual data before committing. Symptom: "Latency variance is huge." Cause: regional routing. Fix: pin to asia-south1 (Mumbai) when serving Indian users; the difference vs us-central1 is often 200-400ms. Symptom: "We tried it on coding and it lost vs Claude." Cause: it does. Stop. [SWE-bench Verified gap](https://www.vellum.ai/llm-leaderboard) for code-edit work still favours Claude. Use the right tool. ## Real example — the Chennai law firm The Chennai contract-extraction workflow was the cleanest win. The firm processes ~340 contracts a month — Master Service Agreements, NDAs, vendor onboarding paperwork. Average length: 110 pages. The job: extract 47 named clauses (governing law, indemnity cap, change-control, force majeure, etc.) into a structured JSON. Old setup on Claude Opus 4.5: ₹2.4 lakh / month, ~94% F1 across the 47 clause types, 38-second average wall-clock per contract. New setup on Gemini 3 Pro: ₹1.27 lakh / month, ~94% F1 (statistically tied), 22-second average wall-clock. The savings — ₹1.13 lakh / month — fund a junior paralegal for the same desk. We ran a 6-week shadow eval before cutting traffic over. The forward link is up: see how we did the same shadow-eval pattern for our [MySQL-to-Postgres migration](/blog/mysql-to-postgres-2-4-million-rows-zero-downtime-playbook). ## Our take Gemini 3 Pro is not a Claude replacement. It is the first Google model where the routing question genuinely changes for an Indian SMB. If you have a workflow heavy in Indic language input, in long documents, or in image+text fusion — re-test it this month. If you have a code-agent or a tool-heavy customer-support agent, do not touch it. We built [PenLeap](https://penleap.com) on a Claude-backed evaluation engine and we are not migrating it; the rubric-scoring agent's tool-call reliability matters more than the input-token savings. If you want a model-routing audit for your stack, our [AI automation team](/services/ai-automation) runs a 5-business-day engagement that produces a routing config like the YAML above plus a 90-day cost projection. We have done it for [TalkDrill](https://talkdrill.com) and three external clients in the last 30 days. ## FAQ ### How much cheaper is Gemini 3 Pro than Claude Opus 4.5 for an Indian SMB? Around 42% on input-heavy workloads and 26% on a balanced mix, in our 9-workflow test. The savings disappear if your prompts cross the 200K-token tier where Gemini 3 Pro pricing doubles to $4 / $18 per million tokens (~₹340 / ₹1,530). For most SMB workflows under 80,000 tokens of input, Gemini 3 Pro lands somewhere between Sonnet 4.5 and Opus 4.5 on cost. ### Is Gemini 3 Pro better than Claude for Hindi customer support? Yes, materially. On our 400-sample Hindi support evaluation, Gemini 3 Pro was rated "natural" by a Hindi-native QA reviewer 81% of the time vs Sonnet 4.5 at 67%. This matches the language-quality gap we see on Hinglish, Tamil, and Marathi as well. For English-only support work, Sonnet 4.5 is still cheaper and equally good. ### Can I run Gemini 3 Pro for code review or coding agents? Not in production yet, in our view. Claude Opus 4.5 still leads on SWE-bench Verified at 80.9% and the lead is bigger on multi-file edits where 4+ tool calls are involved. Gemini 3 Pro's coding output looks correct but its tool-call typing is looser, which costs you in retry handling. We re-test every 90 days. ### What is the simplest way to start routing between Claude and Gemini 3? Pick one workflow where the cost or accuracy delta is obvious — Hindi extraction or long-document summarisation are good candidates. Run a 4-week shadow eval where both models score the same input and you compare outputs. Migrate only after 14 consecutive days of equal or better quality. Do not flip everything at once. ### Does Gemini 3 Pro have a region in India for low latency? The closest region is asia-south1 (Mumbai), which gives our Bangalore and Pune clients a typical 60-90ms first-byte latency compared to 280-340ms when routed via us-central1. Pin your client to Mumbai when serving Indian end users; the difference matters in voice and chat UIs. ### What about Gemini 3 Flash for cheaper workloads? [Gemini 3 Flash launched on 17 December 2025](https://9to5google.com/2025/12/17/gemini-3-flash-launch/) at lower pricing for mid-tier workloads. We are running an eval on it now. Early signal: it lands close to Sonnet 4.5 on speed and price, with better Indic-language quality but weaker tool-calling. Expect a routing-config update by end of Jan 2026. ### Should I sign a long enterprise contract with one provider in Q1 2026? No, in our opinion. The pricing landscape moved twice in November alone. Stay multi-provider behind a routing layer for at least the next 6 months. The cost of a router is a few hundred lines of code — the cost of being locked in is six figures over a year if any single provider cuts prices again.