Vol. 3 No. 2 (2023): Journal of Millimeterwave Communication, Optimization and Modelling

Sentiment Analysis Using BERT on Amazon Reviews

Georgina Mirceva
Faculty of computer science and engineering, Ss. Cyril and Methodius University in Skopje

Published 31.12.2023


  • deep learning,
  • BERT,
  • sentiment analysis,
  • transformers


With the growth of social medias, blogs, discussion forums, online review sites, etc., major companies have come to realize that being sentiment-aware can help them gain insights into user behavior, track and manage their online presence and image and use that information to boost brand loyalties and advocacy, marketing message, product development, monitor competitive intelligence, etc. In this paper, we focus on the research task for sentiment analysis on Amazon reviews data. We used the BERT-base-cased model from Hugging Face. Some experimental results are presented and discussed in this paper.


  1. B. Das and S. Chakraborty, “An Improved Text Sentiment Classification Model Using TF-IDF and Next Word Negation”.
  2. J. Acosta, N. Lamaute, M. Luo, E. Finkelstein, and A. Cotoranu, ”Sentiment Analysis of Twitter Messages Using Word2Vec,” Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS 2019), Granada, Spain, 2019.
  3. U. Singh, A. Saraswat, H.K. Azad, K. Abhishek, and S. Shitharth, “Towards improving e‑commerce customer review analysis for sentiment detection,” Scientific Reports, vol. 12, 21983, 2022.
  4. S.T. Kokab, S. Asghar, and S. Naz “Transformer-based deep learning models for the sentiment analysis of social media data,” vol. 14, 100157, 2022.
  5. X. Gong, W. Ying, S. Zhong, and S. Gong, “Text Sentiment Analysis Based on Transformer and Augmentation,” Front. Psychol., vol. 13, 906061, 2022.
  6. J. Hartmann, M. Heitmann, C. Siebert, and C Schamp, “More than a Feeling: Accuracy and Application of Sentiment Analysis,” International Journal of Research in Marketing,
  7. https://doi.org/10.1016/j.ijresmar.2022.05.005.
  8. W. Trisna and H.J. Jie, “Deep Learning Approach for Aspect-Based Sentiment Classification: A Comparative Review,” Applied Artificial Intelligence, vol. 36, no. 1, doi: 10.1080/08839514.2021.2014186, 2022.
  9. J. Devlin, M-W. Chang, K. Lee, and K. Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding," 2018.
  10. https://www.kaggle.com/datasets/shitalkat/amazonearphonesreviews.
  11. https://huggingface.co/.
  12. https://huggingface.co/docs/transformers/model_doc/bert.
  13. https://www.kaggle.com/code/foolwuilin/sentiment-analysis-for-3-earphones/.
  14. https://www.kaggle.com/code/mervetas/sentiment-analysis-with-lstm-model.