·Jonathan Chavez
A Thorough Analysis of LLM Biases
In this post, we'll look at biases from a quantitative perspective across a variety of dimensions and models.
Read article
Benchmarks & Analysis
LLM Stats Blog
Independent analysis and practical insights into language models, exploring real-world performance, limitations, and capabilities.
·Jonathan Chavez
An Introduction to Applied LLMs
An introduction to applied LLMs, including a discussion of the current state of the field and some of the most important applications.
Read article
·Jonathan Chavez
Fine-Tuning vs RAG: An In-Depth Comparison
A detailed analysis of the pros and cons of fine-tuning vs RAG for building a custom LLM.
Read article
·Jonathan Chavez
Model Quantization Across Providers
Same LLM, different performance scores. Here's how quantization choices by providers like Anthropic, OpenAI, and others affect model behavior and speed.
Read article
·Jonathan Chavez
Analyzing LLM Contamination in the Wild
Some LLMs are scoring suspiciously high on benchmarks. A data-driven analysis of which models likely saw test data during training and how to spot it.
Read article