ComplexFuncBench
Progress Over Time
Interactive timeline showing model performance evolution on ComplexFuncBench
ComplexFuncBench Leaderboard
| Context | Cost | License | ||||
|---|---|---|---|---|---|---|
| 1 |  OpenAI | — | 128K | $2.50 / $10.00 | ||
| 2 | OpenAI | — | 1.0M | $2.00 / $8.00 | ||
| 3 |  Amazon | — | 1.0M | $0.33 / $2.75 | ||
| 4 | OpenAI | — | — | — | ||
| 5 | OpenAI | — | 1.0M | $0.40 / $1.60 | ||
| 6 | OpenAI | — | — | — | ||
| 7 | OpenAI | — | 1.0M | $0.10 / $0.40 |
What is ComplexFuncBench?
ComplexFuncBench is a benchmark designed to evaluate large language models' capabilities in handling complex function calling scenarios. It encompasses multi-step and constrained function calling tasks that require long-parameter filling, parameter value reasoning, and managing contexts up to 128k tokens. The benchmark includes 1,000 samples across five real-world scenarios.
ComplexFuncBench is a text benchmark evaluating models on long context, reasoning, structured output, and tool calling tasks. LLM Stats tracks 7 models on this benchmark, scored on a 0–1 scale. The current average is 0.5, with the leader at 0.7.
Compare leaders on the best AI for long context, best AI for reasoning, best AI for structured output and best AI for tool calling leaderboards.
Current leaders
GPT-4o from OpenAI currently leads the ComplexFuncBench leaderboard with a score of 0.665 across 7 evaluated AI models.
FAQ
Common questions about the ComplexFuncBench benchmark and leaderboard.