diff --git a/pages/interns/sevval_bulburu/README.md b/pages/interns/sevval_bulburu/README.md index cca3e13d..6dc17cd7 100644 --- a/pages/interns/sevval_bulburu/README.md +++ b/pages/interns/sevval_bulburu/README.md @@ -18,7 +18,10 @@ Final Meeting 12.10.2023 State: -- Proposed extra layer above BERT model to make a classifier. +- Proposed and tried extra layers above BERT model to make a classifier in seriees of experiments. There is a single sigmoid neuron on the output. +- Manually adjusted the slovak HS dataset. Slovak dataset is not balanced. Tried some methods for "balancing" the dataset. By google translate - augmentation. Other samples are "generated" by translation into random langauge and translating back. This creates "paraphrases" of the original samples. It helps. +- Tried SMOTE upsampling, it did not work. +- Is date and user name an important feature? Tasks: