Compare commits
No commits in common. "3f75d311e8fd6940a9c9e95b2e2f9fd4ad93ce95" and "9f6c746d7e7c5f5648cef92d3077f0e2d36ab33e" have entirely different histories.
3f75d311e8
...
9f6c746d7e
@ -1,12 +1,12 @@
|
||||
---
|
||||
title: Manohar Gowdru Shridharu
|
||||
title: Manohar Gowdru
|
||||
published: true
|
||||
taxonomy:
|
||||
category: [phd2024]
|
||||
tag: [lm,nlp]
|
||||
author: Daniel Hladek
|
||||
---
|
||||
# Manohar Gowdru Shridharu
|
||||
# Manohar Gowdru
|
||||
|
||||
Beginning of the study: 2021
|
||||
|
||||
|
@ -16,12 +16,6 @@ author: Daniel Hládek
|
||||
- diplomová práza Jozef Olekšák (inprogress, trénovanie electra na colab).
|
||||
- https://git.kemt.fei.tuke.sk/dano/bert-train
|
||||
|
||||
## Rozpracované úlohy
|
||||
|
||||
- Trénovanie na TPU Google Colab Electra Base. (Olekšák)
|
||||
- trénovanie XLNet Base
|
||||
- Tokenizer SentencePiece pre XLNet
|
||||
|
||||
|
||||
## Hotové úlohy
|
||||
|
||||
@ -44,11 +38,15 @@ author: Daniel Hládek
|
||||
- Natrénovaný HF Roberta Small
|
||||
- Deduplikovaný webový korpus oscar plus skweb2017
|
||||
- tokenizer BPE Roberta
|
||||
- Trénovanie Roberta Base
|
||||
|
||||
## Budúce úlohy
|
||||
|
||||
- Trénovanie na TPU Google Colab
|
||||
- Natrénovať Electra Base.
|
||||
- Pripraviť aj iné množiny na vyhodnotnie: kategorizácia textu na SCNC1.
|
||||
- Trénovanie Roberta Base
|
||||
- trénovanie XLNet Base
|
||||
- Tokenizer SentencePiece pre XLNet
|
||||
- Pridať Wikipedia do trénovania.
|
||||
|
||||
## Poznámky
|
||||
|
Loading…
Reference in New Issue
Block a user