I am new to simpletransformers and NLP in general, I am currently working on a project in which I need to collect a number of values based on a model that I train from the simple transformer's library. Currently, the models I am working with are BERT and RoBERTA, however after all is said and done I am getting the exact same values, for accuracy, precision, recall, and F1-Macro. I don't believe this to be true but I also haven't seen anything with a similar error, nor can I detect this error myself. I am using Google COLAB and I can link my code here. As for the data I am using a dataset from a professor that I have streamlined and that I can provide here for you. I would really appreciate the advice/assistance anyone can give!
SimpleTransformers I am getting the same result using models RoBERTa and BERT
57 Views Asked by Mikehouse627 At
0
There are 0 best solutions below
Related Questions in PYTHON
- How to store a date/time in sqlite (or something similar to a date)
- Instagrapi recently showing HTTPError and UnknownError
- How to Retrieve Data from an MySQL Database and Display it in a GUI?
- How to create a regular expression to partition a string that terminates in either ": 45" or ",", without the ": "
- Python Geopandas unable to convert latitude longitude to points
- Influence of Unused FFN on Model Accuracy in PyTorch
- Seeking Python Libraries for Removing Extraneous Characters and Spaces in Text
- Writes to child subprocess.Popen.stdin don't work from within process group?
- Conda has two different python binarys (python and python3) with the same version for a single environment. Why?
- Problem with add new attribute in table with BOTO3 on python
- Can't install packages in python conda environment
- Setting diagonal of a matrix to zero
- List of numbers converted to list of strings to iterate over it. But receiving TypeError messages
- Basic Python Question: Shortening If Statements
- Python and regex, can't understand why some words are left out of the match
Related Questions in NLP
- Seeking Python Libraries for Removing Extraneous Characters and Spaces in Text
- Clarification on T5 Model Pre-training Objective and Denoising Process
- The training accuracy and the validation accuracy curves are almost parallel to each other. Is the model overfitting?
- Give Bert an input and ask him to predict. In this input, can Bert apply the first word prediction result to all subsequent predictions?
- Output of Cosine Similarity is not as expected
- Getting an error while using the open ai api to summarize news atricles
- SpanRuler on Retokenized tokens links back to original token text, not the token text with a split (space) introduced
- Should I use beam search on validation phase?
- Dialogflow failing to dectect the correct intent
- How to detect if two sentences are simmilar, not in meaning, but in syllables/words?
- Is BertForSequenceClassification using the CLS vector?
- Issue with memory when using spacy_universal_sentence_encoder for similarity detection
- Why does the Cloud Natural Language Model API return so many NULLs?
- Is there any OCR or technique that can recognize/identify radio buttons printed out in the form of pdf document?
- Model, lexicon to do fine grained emotions analysis on text in r
Related Questions in BERT-LANGUAGE-MODEL
- The training accuracy and the validation accuracy curves are almost parallel to each other. Is the model overfitting?
- Give Bert an input and ask him to predict. In this input, can Bert apply the first word prediction result to all subsequent predictions?
- how to create robust scraper for specific website without updating code after develop?
- Why are SST-2 and CoLA commonly used datasets for debiasing?
- Is BertForSequenceClassification using the CLS vector?
- How to add noise to the intermediate layer of huggingface bert model?
- Bert Istantiation TypeError: 'NoneType' object is not callable Tensorflow
- tensorflow bert 'tuple' object has no attribute problem
- Data structure in Autotrain for bert-base-uncased
- How to calculate cosine similarity with bert over 1000 random example
- the key did not present in Word2vec
- ResourceExhaustedError In Tensorflow BERT Classifier
- Enhancing BERT+CRF NER Model with keyphrase list
- Merging 6 ONNX Models into One for Unity Barracuda
- What's the exact input size in MultiHead-Attention of BERT?
Related Questions in SIMPLETRANSFORMERS
- BERT fine-tuning for NER(specifically for Phone number and credit card)
- Transformer augmented cGAN
- transformer model for Language Modelling in NLP
- Giving the same for every question for a given context
- Simple Transformer Question Answer model error showing input should be list of examples
- Memory Leak in simpletransformers while predication
- Simple transformers ConvAI Model completely freezes and crashes PC. Two different problems on two different machines
- Custom Multihead Attention class leaks data for causal attention
- Use of Params in pyspak
- Seq2Seq model in text-to-text
- Issue with adding evaluation dataset with T5Model Training
- simpletransforers use_cuda=True not working
- SimpleTransformers I am getting the same result using models RoBERTa and BERT
- AttributeError: tensorflow has no attribute io
- How to do you load a model from a checkpoint using simple transformers?
Related Questions in ROBERTA-LANGUAGE-MODEL
- Issues with Training RoBERTa Model for Text Prediction with Fill Mask Task in Python
- I'm beginner.I wonder how to evaluate my own pretrain model on GLUE benchmark?
- Some Roberta weights are not initializing from the checkpoint
- HuggingFace Transformers ValueError: not enough values to unpack (expected 2, got 1) when training Roberta model
- ValueError: The two structures don't have the same nested structure. while loading a roberta model
- How to suppress warning "Be aware, overflowing tokens are not returned"
- Cannot reproduce the performance of deepset/roberta-base-squad2 on squad2 due to no-answer questions
- IndexError: index out of range in self ( Google Colab notebook ) while implementing Roberta Pretrained Model
- Does the Deberta transformer model allow you to output all hidden states?
- RuntimeError: Expected target size [32, 2], got [32]
- Facing issues when loading from checkpoint in Pytorch Lightning
- Initialize masked language model with RobertaForMaskLM missing gelu activation layer
- Loading local tokenizer
- Using RoBERTa-base for QA model outputs the context not an answer
- SimpleTransformers I am getting the same result using models RoBERTa and BERT
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?