LLMs Are Trained on Their Own Benchmarks

Originally posted on LinkedIn

Irrefutable proof that LLMs are trained on the very benchmarks they’re evaluated against.

In plain terms: they already have the answer key to the test that’s supposed to measure how good they are.