From 5142ac9e82c5635ff49651e72dcceeb6c5956312 Mon Sep 17 00:00:00 2001 From: dano Date: Thu, 10 Mar 2022 13:33:04 +0000 Subject: [PATCH] Update 'pages/students/2021/manohar_gowdru_shridharu/README.md' --- .../students/2021/manohar_gowdru_shridharu/README.md | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-) diff --git a/pages/students/2021/manohar_gowdru_shridharu/README.md b/pages/students/2021/manohar_gowdru_shridharu/README.md index 101525d035..be6a6279ef 100644 --- a/pages/students/2021/manohar_gowdru_shridharu/README.md +++ b/pages/students/2021/manohar_gowdru_shridharu/README.md @@ -57,8 +57,18 @@ Resources: Tasks: - Try [this model](https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment) with your own text. -- Learn how Transformers Neural Network Works. Learn how Roberta Model works Write a short memo about your findings and papers read on this topic. +- Learn how Transformers Neural Network Works. Learn how Roberta Model training works. Learn how BERT model finetuning works. Write a short memo about your findings and papers read on this topic. +- Pick a dataset: + - https://huggingface.co/datasets/sentiment140 (english) + - https://www.clarin.si/repository/xmlui/handle/11356/1054 (multilingua) + - https://huggingface.co/datasets/tamilmixsentiment (english tamil code switch) - Grab baseline BERT type model and try to finetune it for sentiment classification. +- For finetuning and evaluation you can use this scrip https://github.com/huggingface/transformers/tree/master/examples/pytorch/text-classification +- For finetuning you will need to install CUDA and Pytorch. It can work on CPU or NOT. +- If you need GPU, use the school server idoc.fei.tuke.sk or google Colab. +- Continue working on the paper. +- Remind me about the SCYR conference payment. + ## Meeting 21.2.22