BERT

ALBETO and DistilBETO: Lightweight Spanish Language Models
In recent years there have been considerable advances in pre-trained language models, where non-English language versions have also …
Jan 1, 2022
PDF Cite Code Models arXiv
Spanish Pre-Trained BERT Model and Evaluation Data
The Spanish language is one of the top 5 spoken languages in the world. Nevertheless, finding resources to train or evaluate Spanish …
Jan 1, 2020
PDF Cite Code Slides Video Models
GLUES: General Language Understanding Evaluation in Spanish
The GLUES Benchmark aims to collect different sources of tasks for evaluating Spanish Language Models in a unified fashion in order to develop and allow the growth of the Spanish NLP Community.
Apr 27, 2016
Cite Code