From e14dc631c575634d50cdbc4dace0c3dab4530431 Mon Sep 17 00:00:00 2001 From: dano Date: Thu, 12 Oct 2023 09:49:21 +0000 Subject: [PATCH] Update 'pages/interns/sevval_bulburu/README.md' --- pages/interns/sevval_bulburu/README.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/pages/interns/sevval_bulburu/README.md b/pages/interns/sevval_bulburu/README.md index cca3e13d..6dc17cd7 100644 --- a/pages/interns/sevval_bulburu/README.md +++ b/pages/interns/sevval_bulburu/README.md @@ -18,7 +18,10 @@ Final Meeting 12.10.2023 State: -- Proposed extra layer above BERT model to make a classifier. +- Proposed and tried extra layers above BERT model to make a classifier in seriees of experiments. There is a single sigmoid neuron on the output. +- Manually adjusted the slovak HS dataset. Slovak dataset is not balanced. Tried some methods for "balancing" the dataset. By google translate - augmentation. Other samples are "generated" by translation into random langauge and translating back. This creates "paraphrases" of the original samples. It helps. +- Tried SMOTE upsampling, it did not work. +- Is date and user name an important feature? Tasks: