BGE-M3
BGE-M3 is a new embedding model, which is distinguished for its versatility in Multi-Linguality, Multi-Functionality, and Multi-Granularity.
- University of Science and Technology of China
- BAAI
Can I use it?
No license is specified. Ask the authors before using it.
About this resource
BGE-M3 is a new embedding model, which is distinguished for its versatility in Multi-Linguality, Multi-Functionality, and Multi-Granularity. It provides a uniform support for the semantic retrieval of more than 100 working languages. It can simultaneously accomplish the three common retrieval functionalities: dense retrieval, multi-vector retrieval, and sparse retrieval. Besides, it is also capable of processing inputs of different granularities, spanning from short sentences to long documents of up to 8,192 tokens. The effective training of M3-Embedding presents a series of technical contributions: a novel self-knowledge distillation approach, where the relevance scores from different retrieval functionalities can be integrated as the teacher signal to enhance the training quality. Also, the batching strategy was optimize to enable a large batch size and high training throughput to improve the discriminativeness of embeddings.
More resources for this task
All resources for “Search by meaning” (5)- DatasetSkMTEB
SkMTEB is the first comprehensive MTEB-style text embedding benchmark for Slovak — a low-resource West Slavic language with ~5 million speakers.
- SlovakNLP Community
CC BY 4.0 - ModelE5-sk-large
This is a specialized Slovak sentence-transformers model that maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity,…
MIT - ModelE5-sk-small
This is a specialized Slovak sentence-transformers model that maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity,…
MIT - DatasetSlovak STS Synthetic
This is a synthetic Slovak dataset intended for the semantic textual similarity (STS) task.
CC BY-NC 4.0