16–17 Dec 2021 ONLINE
Évora, Portugal
Europe/Lisbon timezone

Deep Learning in Language Models and their use in Digital Humanities

Not scheduled
25m
Évora, Portugal

Évora, Portugal

Review Talk

Speaker

Asier Gutiérrez-Fandiño (Barcelona Supercomputing Center)

Description

Language Models’ performance has proven to be directly related with the number of parameters the models have. There is an international race to compute performant models for all the languages and domains as this will invigorate all the processes that rely on Natural Language. It has been recently shown that domain-specific models are as performant as large scale models while domain-specific models are smaller and easier to manage.

As computational capacity and data amounts are allowing domain-specific Language Models to emerge, it is demanding for domain professionals to understand the capabilities and limitations of Language Models as well as their evaluation procedures among other questions.

In this presentation, we provide a brief explanation on Language Models and data gathering methods. Then, we will cover domain-specific Language Models and their relevance and current use cases in Humanities. Finally, we will cover ethical, bias and surveillance concerns derived from the usage and application of these Language Models.

Primary author

Asier Gutiérrez-Fandiño (Barcelona Supercomputing Center)

Presentation materials

There are no materials yet.