diff --git a/pages/topics/bert/README.md b/pages/topics/bert/README.md index 82db4568..ac264ba3 100644 --- a/pages/topics/bert/README.md +++ b/pages/topics/bert/README.md @@ -18,6 +18,14 @@ author: Daniel Hládek - [SK Quad](/topics/question) - Slovak Question Answering Dataset - bakalárska práca [Ondrej Megela](/students/2018/ondrej_megela) +## Hardvérové požiadavky + +[https://medium.com/nvidia-ai/how-to-scale-the-bert-training-with-nvidia-gpus-c1575e8eaf71](zz): + +| BERT Large | 330M | +| BERT Base | 110M | + + ## Hotové úlohy - Dotrénovaný model multilingual BERT base na SK QUAD, funguje demo skript. Nefunguje exaktné vyhodnotenie.