Audio-visual video embedding quality across retrieval, classification, clustering, pair classification, zero-shot classification, and video-centric...
AI & ML interests
Massive Text Embeddings Benchmark
Recent Activity
Papers
View all PapersMAEB is a comprehensive audio benchmark with 30 tasks spanning both audio-only and audio-text cross-modal evaluation. Tasks span 7 task types: retr...
The HUME benchmark is designed to evaluate the performance of text embedding models and humans on a comparable set of tasks. This captures areas wh...
-
HUME: Measuring the Human-Model Performance Gap in Text Embedding Task
Paper • 2510.10062 • Published • 10 -
mteb/HUMEEmotionClassification
Viewer • Updated • 16k • 54 -
mteb/HUMEToxicConversationsClassification
Viewer • Updated • 8.05k • 60 -
mteb/HUMETweetSentimentExtractionClassification
Viewer • Updated • 27.5k • 39
A collection of items telated the the MMTEB release
MIEB(Multilingual) is a comprehensive image embeddings benchmark, spanning 10 task types, covering 130 tasks and a total of 39 languages.
In ad...
This is a collection of MTEB papers (not exhaustive).
-
MAEB: Massive Audio Embedding Benchmark
Paper • 2602.16008 • Published • 25 -
HUME: Measuring the Human-Model Performance Gap in Text Embedding Task
Paper • 2510.10062 • Published • 10 -
MMTEB: Massive Multilingual Text Embedding Benchmark
Paper • 2502.13595 • Published • 50 -
MIEB: Massive Image Embedding Benchmark
Paper • 2504.10471 • Published • 21
Audio-visual video embedding quality across retrieval, classification, clustering, pair classification, zero-shot classification, and video-centric...
A collection of items telated the the MMTEB release
MAEB is a comprehensive audio benchmark with 30 tasks spanning both audio-only and audio-text cross-modal evaluation. Tasks span 7 task types: retr...
MIEB(Multilingual) is a comprehensive image embeddings benchmark, spanning 10 task types, covering 130 tasks and a total of 39 languages.
In ad...
The HUME benchmark is designed to evaluate the performance of text embedding models and humans on a comparable set of tasks. This captures areas wh...
-
HUME: Measuring the Human-Model Performance Gap in Text Embedding Task
Paper • 2510.10062 • Published • 10 -
mteb/HUMEEmotionClassification
Viewer • Updated • 16k • 54 -
mteb/HUMEToxicConversationsClassification
Viewer • Updated • 8.05k • 60 -
mteb/HUMETweetSentimentExtractionClassification
Viewer • Updated • 27.5k • 39
This is a collection of MTEB papers (not exhaustive).
-
MAEB: Massive Audio Embedding Benchmark
Paper • 2602.16008 • Published • 25 -
HUME: Measuring the Human-Model Performance Gap in Text Embedding Task
Paper • 2510.10062 • Published • 10 -
MMTEB: Massive Multilingual Text Embedding Benchmark
Paper • 2502.13595 • Published • 50 -
MIEB: Massive Image Embedding Benchmark
Paper • 2504.10471 • Published • 21