Sugestii pentru un model de adnotare a emoțiilor și sentimentelor în romanul românesc de consum din lungul secol al XIX-lea
Proposals for a framework for annotating emotions and sentiments in Romanian popular novels of the long nineteenth century
DOI:
https://doi.org/10.35824/sjrs.v9i1.28189Keywords:
Romanian popular novel, Sentiment Analysis, Emotion Analysis, computational literary studies, sociology of literatureAbstract
Given the significant role of emotions and sentiments in Romanian popular novels from the long 19th century, sociological literary studies stand to benefit greatly from the automatic extraction of affective features in texts, a task made possible through Sentiment Analysis (SA) methods. In the absence of a SA model tailored to Romanian literature, this paper proposes a set of guidelines for developing such a model, drawing on both the state-of-the-art in computational literary studies and the specific characteristics of Romanian popular fiction. We argue that the most appropriate theoretical framework for this purpose is the Hourglass Model Revisited, which offers a robust foundation for manual annotation and the subsequent use of annotated texts in machine learning applications. Recognizing that the quality of manual annotation strongly influences the effectiveness of automatic feature extraction, we place particular emphasis on the creation of rigorous annotation guidelines, supplemented by numerous examples from three sentimental novels by N. G. Rădulescu-Niger and detailed discussion aimed at increasing analytical precision. The overarching goal of this research is to gain deeper insights into the ideas, values, and worldview of 19th-century Romanian readers by examining their expected emotional responses to popular fiction.
References
Barila, A., Danubianu, M., & Gradinaru, B. (2022). Romanian-Lexicon-Based Sentiment Analysis for Assesing Teachers’ Activity. International Journal of Computer Science and Network Security, 22(10), 43–50. https://doi.org/10.22937/IJCSNS.2022.22.10.7
Birkholz, J., Dejaeghere, T., Ros, S., Pozo Pérez, Á., & Singh, P. (2025). CLS INFRA D8.5 Report on Applied NLP Sentiment Analysis. Zenodo. https://doi.org/10.5281/zenodo.15037959
Blackbourn, D. (1998). The Long Nineteenth Century. A History of Germany, 1780-1918. Oxford University Press.
Bodiu, A. (2002). Șapte teme ale romanului postpașoptist [Seven themes of the post-1848 novel]. Editura Paralela 45.
Burke, E. (2000). Modernity’s Histories: Rethinking the Long Nineteenth Century, 1750-1950. https://escholarship.org/uc/item/2k62f464
Cambria, E., Livingstone, A., & Hussain, A. (2012). The Hourglass of Emotions. In A. Esposito, A. M. Esposito, A. Vinciarelli, R. Hoffman, & V. C. Müller (Eds), Lecture Notes in Computer Science (pp. 144–157). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-34584-5_11
Cornea, P. (1982). Căi și perspective în sociologia contemporană a romanului [Paths and perspectives in the contemporary sociology of the novel]. In De la N. Filimon la G. Călinescu. Studii de sociologie a romanului românesc [From N. Filimon to G. Călinescu: studies in the sociology of the Romanian novel] (p. V–XLIV). Editura Minerva.
Cornea, P. (2008). Delimitări și ipoteze. Comunicări și eseuri de teoria literară și studii culturale [Boundaries and hypotheses: contributions and essays in literary theory and cultural studies]. Editura Polirom.
Dejaeghere, T., Singh, P., Lefever, E., & Birkholz, J. (2024). Exploring Aspect-Based Sentiment Analysis Methodologies for Literary-Historical Research Purposes. In R. Sprugnoli & M. Passarotti (Eds), Proceedings of the Third Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA) @ LREC-COLING-2024 (pp. 129–143). ELRA and ICCL. https://aclanthology.org/2024.lt4hala-1.16/
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In J. Burstein, C. Doran, & T. Solorio (Eds), Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 4171–4186). Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423
Drăgan, I. (2006). Romanul popular în România. Literar și paraliterar [The popular novel in Romania. Literary and Paraliterary]. Casa cărții de știință. (Original work published 2001).
Dumitrescu, S., Avram, A.-M., & Pyysalo, S. (2020). The birth of Romanian BERT. In T. Cohn, Y. He, & Y. Liu (Eds), Findings of the Association for Computational Linguistics: EMNLP 2020 (pp. 4324–4328). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.findings-emnlp.387
Eco, U. (1991). Lector in fabula. Cooperarea interpretativă în textele narative (The Role of the Reader: Explorations in the Semiotics of Texts) (M. Spalas, Trans.). Editura Univers. (Original work published 1979).
Ekman, P. (1999). Basic emotions. In T. Dalgleish & M. J. Power (Eds), Handbook of cognition and emotion (pp. 45–60). John Wiley & Sons Ltd. https://doi.org/10.1002/0470013494.ch3
Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969). Pan-cultural elements in facial displays of emotion. Science (New York, N.Y.), 164(3875), 86–88. https://doi.org/10.1126/science.164.3875.86
Elkins, K., & Chun, J. (2019). Can Sentiment Analysis Reveal Structure in a Plotless Novel? (No. arXiv:1910.01441). arXiv. https://doi.org/10.48550/arXiv.1910.01441
Firth-Godbehere, R. (2022). O istorie a emoțiilor umane. Cum au construit sentimentele noastre lumea în care trăim (A Human History of Emotion: How the Way We Feel Built the World We Know) (A. Cork, Trans.). Editura Trei. (Original work published 2021).
Fish, S. (1980). Is There a Text in This Class? The Authority of Interpretive Communities. Harvard University Press.
Galleron, I., Patras, R., Arias, R., Fernández-Cruz, J., Mélanie-Becquet, F., & Seminck, O. (2024). The Novel’s Factory of Opinions: Adapting Sentiment Analysis Tools to ELTeC Prefaces. In C. Tănăsescu (Ed.), Literature and Computation (pp. 147–172). Routledge.
GhentCDH. (2024). Annotation Guidelines. https://github.com/GhentCDH/CLSinfra/blob/main/annotation_guide_2024.pdf
Hobsbawm, E. (1995). Age of Extremes. The Short Twentieth Century. 1914-1991. Abacus. (Original work published 1994).
Hogan, P. C. (2011). Affective Narratology. The Emotional Structure of Stories. University of Nebraska Press.
Hutto, C., & Gilbert, E. (2014). VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text. Proceedings of the International AAAI Conference on Web and Social Media, 8(1), Article 1. https://doi.org/10.1609/icwsm.v8i1.14550
Iser, W. (2006). Actul lecturii. O teorie a efectului estetic (The act of Reading: A Theory of Aesthetic Response) (R. Constantinescu, Trans.). Editura Paralela 45. (Original work published 1976).
Istrati, L., & Ciobotaru, A. (2022). Automatic Monitoring and Analysis of Brands Using Data Extracted from Twitter in Romanian. In K. Arai (Ed.), Intelligent Systems and Applications (pp. 55–75). Springer International Publishing. https://doi.org/10.1007/978-3-030-82199-9_5
Jockers, M. L. (2015). Revealing Sentiment and Plot Arcs with the Syuzhet Package. https://www.matthewjockers.net/2015/02/02/syuzhet/
Kim, E., & Klinger, R. (2019). A Survey on Sentiment and Emotion Analysis for Computational Literary Studies. Zeitschrift Für Digitale Geisteswissenschaften. https://doi.org/10.17175/2019_008
Li, S., Huang, L., Wang, R., & Zhou, G. (2015). Sentence-level Emotion Classification with Label and Context Dependence. In C. Zong & M. Strube (Eds), Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 1045–1053). Association for Computational Linguistics. https://doi.org/10.3115/v1/P15-1101
Lintvelt, J. (1994). Punctul de vedere. Încercare de tipologie narativă [Point of view: essay on narrative typology] (A. Martin, Trans.). Editura Univers. (Original work published 1981).
Liu, B. (2012). Sentiment Analysis and Opinion Mining. Morgan & Claypool Publishers.
Loria, S. (2025). TextBlob: Simplified Text Processing (Version 0.19.0) [Computer software]. https://textblob.readthedocs.io/en/dev/
Lovinescu, E. (1981). Istoria literaturii române contemporane [The history of contemporary Romanian literature] (Vol. 3). Editura Minerva. (Original work published 1929).
Lupea, M., & Briciu, A. (2019). Studying emotions in Romanian words using Formal Concept Analysis. Computer Speech & Language, 57, 128–145. https://doi.org/10.1016/j.csl.2019.02.005
Lupea, M., Briciu, A., & Bostenaru, E. (2021). Emotion-based Hierarchical Clustering of Romanian Poetry. Studies in Informatics and Control, 30(1), 109–118. https://doi.org/10.24846/v30i1y202110
Mohammad, S. (2013). From Once Upon a Time to Happily Ever After: Tracking Emotions in Novels and Fairy Tales (No. arXiv:1309.5909). arXiv. https://doi.org/10.48550/arXiv.1309.5909
Morris, J., & Hirst, G. (2006). The Subjectivity of Lexical Cohesion in Text. In J. G. Shanahan, Y. Qu, & J. Wiebe (Eds), Computing Attitude and Affect in Text: Theory and Applications (pp. 41–48). Springer.
Mozetič, I., Grčar, M., & Smailović, J. (2016). Multilingual Twitter Sentiment Classification: The Role of Human Annotators. PLOS ONE, 11(5), e0155036. https://doi.org/10.1371/journal.pone.0155036
Neagu, D. C., Rus, A. B., Grec, M., Boroianu, M. A., Bogdan, N., & Gal, A. (2022). Towards Sentiment Analysis for Romanian Twitter Content. Algorithms, 15(10). https://doi.org/10.3390/a15100357
Neugarten, J., Dejaeghere, T., Singh, P., Hemmons, A. R., & Birkholz, J. M. (2024). Catching Feelings: Aspect-Based Sentiment Analysis for Fanfiction Comments about Greek Myth. Workshop on Computational Humanities Research. Computational Humanities Research Conference, Aarhus, Denmark.
Nussbaum, M. C. (2013). Political Emotions. Why Love Matters for Justice. The Belknap Press of Harvard University Press.
Păiș, V., & Tufiș, D. (2022). Report on the Romanian Language (No. D1.29). https://european-language-equality.eu/wp-content/uploads/2022/03/ELE___Deliverable_D1_29__Language_Report_Romanian_.pdf
Pascariu, L. E. (2024). Romanul foileton în literatura română a secolului al XIX-lea [The feuilleton novel in 19th-century Romanian literature] [Teză de doctorat nepublicată]. Universitatea „Alexandru Ioan Cuza”.
Patras, R., Pascariu, L., Cuzmici, L., Olteanu, A., Ionescu, O., & Bădeliță, T. (2024). Corpus Pop-Lite [Data set]. Zenodo. https://doi.org/10.5281/zenodo.13771810
Pillat, D. (2013). Mozaic istorico-literar. Secolul XX [A historical-literary mosaic: the 20th century] (Ediție îngrijită de Monica Pillat și George Ardeleanu, Note și Notă asupra ediției de Monica Pillat, Prefață și Dosar de referințe critice de George Ardeleanu). Editura Humanitas.
Plutchik, R. (1991). The Emotions (Revised Edition). University Press of America. (Original work published 1962).
Rădulescu-Niger, N. G. (2024a). Gelozie [Jealousy] (Ediție Pop-Lite). GitHub. https://github.com/RoxanaPatras/POP-LITE/blob/main/Corpus%20POP-LITE/POPLITE028_Radulescu_N_Gelozie.xml (Original work published 1890).
Rădulescu-Niger, N. G. (2024b). Jertfă [Sacrifice] (Ediție Pop-Lite). GitHub. https://github.com/RoxanaPatras/POP-LITE/blob/main/Corpus%20POP-LITE/POPLITE095_RadulescuN_Jertf%C4%83.xml (Original work published 1890).
Rădulescu-Niger, N. G. (2024c). Romanul unei iubiri [The novel of a love] (Ediție Pop-Lite). GitHub. https://github.com/RoxanaPatras/POP-LITE/blob/main/Corpus%20POP-LITE/POPLITE034_Radulescu_N_Romanul.xml (Original work published 1920).
Raveca Buleu, C., Burlacu, D. G., Burlacu, L., Istrate, I., Milea, I., Modola, D., Pop, A., Popa, M., Sasu, A., Stan, E., Tașcu, V., & Vartic, M. (2023). Dicționarul cronologic al romanului românesc de la origini până în anul 2000 [The chronological dictionary of the Romanian novel from its origins until year 2000]. (Vol. 1-2). (Ediție revizuită și adăugită). Presa Universitară Clujeană. (Original work published 2004).
Rebora, S. (2023). Sentiment Analysis in Literary Studies. A Critical Survey. Digital Humanities Quarterly, 017(2).
Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
Șeicaru, P. (1991). Nicolae Iorga. Editura Clio. (Original work published 1937).
Seyeditabari, A., Tabari, N., & Zadrozny, W. (2018). Emotion Detection in Text: A Review (No. arXiv:1806.00674). arXiv. https://doi.org/10.48550/arXiv.1806.00674
Shanahan, J. G., Qu, Y., & Wiebe, J. (Eds). (2006). Preface. In Computing Attitude and Affect in Text: Theory and Applications (pp. xi–xvi). Springer.
Susanto, Y., Livingstone, A. G., Ng, B. C., & Cambria, E. (2020). The Hourglass Model Revisited. IEEE Intelligent Systems, 35(5), 96–102. https://doi.org/10.1109/MIS.2020.2992799
Tache, A. M., Gaman, M., & Ionescu, R. T. (2021). Clustering Word Embeddings with Self-Organizing Maps. Application on LaRoSeDa—A Large Romanian Sentiment Data Set (No. arXiv:2101.04197). arXiv. https://doi.org/10.48550/arXiv.2101.04197
Teodorovici, C. (2020). Rădulescu-Niger, Nicolae G. In E. Simion (Ed.), Dicționarul General al Literaturii Române [The general dictionary of Romanian literature] (Vol. 6). (Ediția a II-a revizuită, adăugită și adusă la zi, pp. 792–794). Editura Muzeul Literaturii Române. (Original work published 2006).
Ursa, A.-G., & Dioşan, L. S. (2024). Bridging Linguistic Gaps: SENTIROM’s Approach to Romanian Sentiment Analysis. Procedia Computer Science, 246, 616–625. https://doi.org/10.1016/j.procs.2024.09.475
Williams, R. (1978). Marxism and Literature. Oxford University Press.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Maria-Corina Dimitriu
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial 4.0 International License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
