skLEP
skLEP (General Language Understanding Evaluation benchmark for Slovak) is the first comprehensive benchmark specifically designed for evaluating Slovak natural language understanding (NLU) models.
Can I use it?
The license allows noncommercial use only.
About this resource
skLEP (General Language Understanding Evaluation benchmark for Slovak) is the first comprehensive benchmark specifically designed for evaluating Slovak natural language understanding (NLU) models. The benchmark encompasses nine diverse tasks that span token-level, sentence-pair, and document-level challenges, thereby offering a thorough assessment of model capabilities. To create this benchmark, we curated new, original datasets tailored for Slovak and meticulously translated established English NLU resources with native speaker post-editing to ensure high quality evaluation. skLEP includes nine tasks across three categories: Token-Level Tasks: Part-of-Speech (POS) Tagging using Universal Dependencies Named Entity Recognition using Universal NER (UNER) Named Entity Recognition using WikiGoldSK (WGSK) Sentence-Pair Tasks: Recognizing Textual Entailment (RTE) Natural Language Inference (NLI) Semantic Textual Similarity (STS) Document-Level Tasks: Hate Speech Classification (HS) Sentiment Analysis (SA) Question Answering (QA) based on SK-QuAD
The skLEP — Slovak Language Understanding Benchmark benchmark uses this dataset.See the leaderboard
See a mistake or a missing detail? Write to us.More resources for this task
All resources for “Understand text” (3)- CC BY-NC-SA 4.0
- ModelSlovakBERT
SlovakBERT is the first pretrained masked language model based on the RoBERTa architecture, optimized for Slovak natural language processing (NLP).
- NLP KInIT
- Gerulata
MIT
More from LRKT FEI TUKE
LRKT FEI TUKE- ModelE5-sk-large
This is a specialized Slovak sentence-transformers model that maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity,…
- ModelE5-sk-small
This is a specialized Slovak sentence-transformers model that maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity,…
More from NLP KInIT
NLP KInIT- Transcribe speechCC BY 4.0
- Transcribe speechCC BY 4.0
- Transcribe speechApache 2.0
- Transcribe speechApache 2.0
- Transcribe speechApache 2.0