Skip to content
ModelText

SlovakBERT

SlovakBERT is the first pretrained masked language model based on the RoBERTa architecture, optimized for Slovak natural language processing (NLP).

Open on Hugging FacePaper

Can I use it?

The license also allows commercial use if you credit the authors and specify the license.

About this resource

SlovakBERT is the first pretrained masked language model based on the RoBERTa architecture, optimized for Slovak natural language processing (NLP). As the pioneering foundational model for the Slovak language, it effectively captures bidirectional context for downstream tasks including text classification, named entity recognition (NER), and semantic search.

See a mistake or a missing detail? Write to us.

More from NLP KInIT

NLP KInIT