Jinki Jeong PRO
Anserwise
AI & ML interests
None yet
Recent Activity
upvoted an article 25 minutes ago
OpenRouter Leaderboard: 425 Models by Price, Measured Speed and Korean Quality liked a Space 25 minutes ago
ginigen-ai/open-router-leaderboard reacted to ginigen-ai's post with ๐ค 25 minutes ago
OpenRouter Leaderboard โ every model, every provider, one comparable table. Price, precision, uptime, measured latency and language quality on the same axes.
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics โ only 8.5% earn an A
Knowledge of Korean institutions โ 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks โ it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
๐ https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard ๐ https://huggingface.co/spaces/ginigen-ai/open-router-leaderboardOrganizations
None yet