Claude 3.5 Haiku vs Gemma 3 4B

Comparing Claude 3.5 Haiku by Anthropic and Gemma 3 4B by Google across benchmarks, pricing, and capabilities.

Claude 3.5 Haiku shows notably better performance in the majority of benchmarks. Gemma 3 4B is 64.0x cheaper per token.

Want to compare interactively?Try the playground

Performance Benchmarks

Comparative analysis across standard metrics

4 benchmarks

Claude 3.5 Haiku outperforms in 3 benchmarks (GPQA, HumanEval, MMLU-Pro), while Gemma 3 4B is better at 1 benchmark (MATH).

Claude 3.5 Haiku shows notably better performance in the majority of benchmarks.

Tue Mar 24 2026 • llm-stats.com

Arena Performance

Human preference votes

Pricing Analysis

Price comparison per million tokens

Gemma 3 4B costs less

For input processing, Claude 3.5 Haiku ($0.80/1M tokens) is 40.0x more expensive than Gemma 3 4B ($0.02/1M tokens).

For output processing, Claude 3.5 Haiku ($4.00/1M tokens) is 100.0x more expensive than Gemma 3 4B ($0.04/1M tokens).

In conclusion, Claude 3.5 Haiku is more expensive than Gemma 3 4B.*

* Using a 3:1 ratio of input to output tokens

Lowest available price from all providers

Tue Mar 24 2026 • llm-stats.com

Claude 3.5 Haiku

Input tokens$0.80

Output tokens$4.00

Best providerAWS Bedrock

Gemma 3 4B

Input tokens$0.02

Output tokens$0.04

Best providerDeepinfra

Notice missing or incorrect data?Start an Issue→

Context Window

Maximum input and output token capacity

Claude 3.5 Haiku accepts 200,000 input tokens compared to Gemma 3 4B's 131,072 tokens. Claude 3.5 Haiku can generate longer responses up to 200,000 tokens, while Gemma 3 4B is limited to 131,072 tokens.

Claude 3.5 Haiku

Input200,000 tokens

Output200,000 tokens

Gemma 3 4B

Input131,072 tokens

Output131,072 tokens

Tue Mar 24 2026 • llm-stats.com

Input Capabilities

Supported data types and modalities

Gemma 3 4B supports multimodal inputs, whereas Claude 3.5 Haiku does not.

Gemma 3 4B can handle both text and other forms of data like images, making it suitable for multimodal applications.

Claude 3.5 Haiku

Text

Images

Audio

Video

Gemma 3 4B

Text

Images

Audio

Video

License

Usage and distribution terms

Claude 3.5 Haiku is licensed under a proprietary license, while Gemma 3 4B uses Gemma.

License differences may affect how you can use these models in commercial or open-source projects.

Claude 3.5 Haiku

Proprietary

Closed source

Gemma 3 4B

Gemma

Open weights

Release Timeline

When each model was launched

Claude 3.5 Haiku was released on 2024-10-22, while Gemma 3 4B was released on 2025-03-12.

Gemma 3 4B is 5 months newer than Claude 3.5 Haiku.

Claude 3.5 Haiku

Oct 22, 2024

1.4 years ago

Gemma 3 4B

Mar 12, 2025

1.0 years ago

4mo newer

Knowledge Cutoff

When training data ends

Gemma 3 4B has a documented knowledge cutoff of 2024-08-01, while Claude 3.5 Haiku's cutoff date is not specified.

We can confirm Gemma 3 4B's training data extends to 2024-08-01, but cannot make a direct comparison without Claude 3.5 Haiku's cutoff date.

Claude 3.5 Haiku

—

Gemma 3 4B

Aug 2024

Provider Availability

Claude 3.5 Haiku is available from Bedrock, Google, Anthropic. Gemma 3 4B is available from DeepInfra. The availability of providers can affect quality of the model and reliability.