SlovakBERT

SlovakBERT is the first pretrained masked language model based on the RoBERTa architecture, optimized for Slovak natural language processing (NLP). As the pioneering foundational model for the Slovak language, it effectively captures bidirectional context for downstream tasks including text classification, named entity recognition (NER), and semantic search.