From 87828f160b4b0f727c1cfb42b1fa542fce572bb6 Mon Sep 17 00:00:00 2001 From: dano Date: Wed, 20 Oct 2021 06:40:21 +0000 Subject: [PATCH] Update 'pages/topics/bert/README.md' --- pages/topics/bert/README.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/pages/topics/bert/README.md b/pages/topics/bert/README.md index 82db456892..ac264ba3e3 100644 --- a/pages/topics/bert/README.md +++ b/pages/topics/bert/README.md @@ -18,6 +18,14 @@ author: Daniel Hládek - [SK Quad](/topics/question) - Slovak Question Answering Dataset - bakalárska práca [Ondrej Megela](/students/2018/ondrej_megela) +## Hardvérové požiadavky + +[https://medium.com/nvidia-ai/how-to-scale-the-bert-training-with-nvidia-gpus-c1575e8eaf71](zz): + +| BERT Large | 330M | +| BERT Base | 110M | + + ## Hotové úlohy - Dotrénovaný model multilingual BERT base na SK QUAD, funguje demo skript. Nefunguje exaktné vyhodnotenie.