The AI arena is free today

Open Superagent

Gemma 3 4B vs Kimi K2.8 Preview

Comparing Gemma 3 4B and Kimi K2.8 Preview across benchmarks, pricing, and capabilities.

Google · Moonshot AI · Updated for 2026

Which is better?

Gemma 3 4B and Kimi K2.8 Preview trade strengths across price, capabilities, and technical limits. The better choice depends on the workload.

Kimi K2.8 Preview also accepts a larger context window (1,048,576 input tokens), making it the stronger choice for long documents and large codebases.

Based on current LLM Stats indexes, shared benchmarks, pricing, and model metadata for 2026.

Choose Gemma 3 4B

  • you need open weights you can self-host or fine-tune

Choose Kimi K2.8 Preview

  • you process long inputs — it offers a 1,048,576 token context window
  • you want the most recent training data — it shipped Sep 2026

At a glance

The differences that matter most.

Gemma 3 4B
Google
Kimi K2.8 Preview
Moonshot AI
Benchmark wins
—
—
Input price
$0.02 / M
— / M
Output price
$0.04 / M
— / M
Context window
131,072
1,048,576

Individual benchmarks

26 reported for Gemma 3 4B · 0 for Kimi K2.8 Preview

No common benchmarks found

Gemma 3 4B and Kimi K2.8 Previewdon't have any common benchmark datasets to compare. They may have been evaluated on different testing suites.

Human preference

Blind head-to-head votes and playground preference scores

Context Window

Maximum input and output token capacity

Kimi K2.8 Preview accepts 1,048,576 input tokens compared to Gemma 3 4B's 131,072 tokens. Only Gemma 3 4B specifies output context (131,072 tokens).

Google
Gemma 3 4B
Input131,072 tokens
Output131,072 tokens
Moonshot AI
Kimi K2.8 Preview
Input1,048,576 tokens
Output- tokens
Wed Sep 16 2026 • llm-stats.com

Input capabilities

Documented input modalities across available providers

Both Gemma 3 4B and Kimi K2.8 Preview support multimodal inputs.

They are both capable of processing various types of data, offering versatility in application.

Gemma 3 4B

Text
Images
Audio
Video

Kimi K2.8 Preview

Text
Images
Audio
Video

License

Usage and distribution terms

Gemma 3 4B is licensed under Gemma, while Kimi K2.8 Preview uses a proprietary license.

License differences may affect how you can use these models in commercial or open-source projects.

Gemma 3 4B

Gemma

Open weights

Kimi K2.8 Preview

Proprietary

Closed source

Release Timeline

When each model was launched

Gemma 3 4B was released on 2025-03-12, while Kimi K2.8 Preview was released on 2026-09-11.

Kimi K2.8 Preview is 18 months newer than Gemma 3 4B.

Gemma 3 4B

Mar 12, 2025

1.5 years ago

Kimi K2.8 Preview

Sep 11, 2026

5 days ago

1.5yr newer

Knowledge Cutoff

When training data ends

Gemma 3 4B has a documented knowledge cutoff of 2024-08-01, while Kimi K2.8 Preview's cutoff date is not specified.

We can confirm Gemma 3 4B's training data extends to 2024-08-01, but cannot make a direct comparison without Kimi K2.8 Preview's cutoff date.

Gemma 3 4B

Aug 2024

Kimi K2.8 Preview

—

Provider Availability

Gemma 3 4B is available from DeepInfra. Kimi K2.8 Preview is available from Moonshot AI.

Gemma 3 4B

deepinfra logo
Deepinfra
Input Price:Input: $0.02/1MOutput Price:Output: $0.04/1M

Kimi K2.8 Preview

moonshot logo
Unknown Organization
* Prices shown are per million tokens

Outputs Comparison

Notice missing or incorrect data?Start an Issue discussion→

Judge for yourself.

Run your own prompts against Gemma 3 4B and Kimi K2.8 Preview side-by-side, then vote on the output you prefer.

Gemma 3 4B
✓ Preferred
Kimi K2.8 Preview
Open in Playground

FAQ

Common questions about Gemma 3 4B vs Kimi K2.8 Preview.

Which is better, Gemma 3 4B or Kimi K2.8 Preview?

Gemma 3 4B (Google) and Kimi K2.8 Preview (Moonshot AI) each have strengths in different areas. Compare their benchmark scores, pricing, context windows, and capabilities above to determine which fits your needs.

How does Gemma 3 4B compare to Kimi K2.8 Preview in benchmarks?

Gemma 3 4B scores IFEval: 90.2%, GSM8k: 89.2%, DocVQA: 75.8%, MATH: 75.6%, AI2D: 74.8%.

What are the context window sizes for Gemma 3 4B and Kimi K2.8 Preview?

Gemma 3 4B supports 131K tokens and Kimi K2.8 Preview supports 1.0M tokens. A larger context window lets you process longer documents, conversations, or codebases in a single request.

What are the main differences between Gemma 3 4B and Kimi K2.8 Preview?

Key differences include context window (131K vs 1.0M), licensing (Gemma vs Proprietary). See the full comparison above for benchmark-by-benchmark results.

Who makes Gemma 3 4B and Kimi K2.8 Preview?

Gemma 3 4B is developed by Google and Kimi K2.8 Preview is developed by Moonshot AI.

Related comparisons