Mathematical Sciences
Sub-communities within this community
Collections in this community
Recent Submissions
-
Čugurović, Milan (Beograd , 2025)[more][less]
Abstract: Compilers use program profiles to perform profile-guided optimizations and pro- duce efficient programs. Although dynamic profilers generate high-quality profiles, they have significant drawbacks. They complicate the application build pipeline by requiring two compi- lation steps and an additional profile collection run. Dynamic profilers also consume substantial time and memory and place a heavy burden on developers to create suitable workloads that accurately reflect typical application usage, cover important code paths, and generate well- distributed profiles. In response to the shortcomings of dynamic profilers, modern static profilers employ ma- chine learning (ML) techniques to predict program profiles. However, state-of-the-art ML-based static profilers often rely on handcrafted features that are platform-specific and difficult to adapt across different architectures and programming languages. They also tend to use computation- ally intensive deep neural networks, which increase application compilation time. Moreover, ML-based static profilers can degrade the performance of optimized programs due to inaccurate profile predictions. This dissertation presents GraalSP , an ML-based static profiler that is portable, polyglot, efficient, and robust. GraalSP achieves portability by defining features on a high-level, graph- based intermediate representation and by partially automating the feature extraction process. This design makes GraalSP polyglot, allowing it to predict profiles for programs written in any language that compiles to Java bytecode, such as Java, Scala, or Kotlin. GraalSP is efficient due to its use of a lightweight XGBoost model based on decision trees, and robust because it relies on carefully designed heuristics that correct machine learning predictions and ensure high performance in programs optimized using the predicted profiles. We integrate GraalSP into the Enterprise GraalVM Native Image compiler and evaluate it on 28 benchmarks from the Renaissance, DaCapo, and DaCapo Scala benchmark suites. These suites represent a modern and diverse collection of benchmarks, featuring numerous real-world workloads across a variety of programming paradigms. Our comprehensive evaluation shows that GraalSP achieves a geometric mean speedup of 7.46% in execution time compared to the default compiler configuration, which models program profiles using a uniform distribution. This dissertation also presents a detailed qualitative and quantitative analysis to position and compare the proposed solution against state-of-the-art static profilers. Additionally, to enhance and expand the evaluation and support developers in analyzing GraalSP ’s predictions, this dissertation introduces the GraalSP-PLog tool. This tool allows developers to run the GraalSP static profiler on any program and generate detailed prediction reports, making it easier to inspect individual predictions and identify model mispredictions. Since GraalSP provides substantial performance gains, has minimal impact on binary size and compile time, and includes a modern, fully automated model retraining pipeline, it is well- suited for commercial deployment. As a result, GraalSP has been the default static profiler for the Enterprise GraalVM Native Image compiler since June 2023, consistently improving performance with every build. URI: http://hdl.handle.net/123456789/5778 Files in this item: 1
Milan_Cugurovic_doktorska_disertacija.pdf ( 5.694Mb ) -
Rašić, Staša (Beograd , 2025)[more][less]
URI: http://hdl.handle.net/123456789/5777 Files in this item: 1
Staša Rašić Master rad FLP-MD.pdf ( 929.9Kb ) -
Bardžić, Bojan (Beograd , 2025)[more][less]
URI: http://hdl.handle.net/123456789/5775 Files in this item: 1
implementacija_tekst_editora_za_pisanje_koda.pdf ( 3.432Mb ) -
Šošić, Milena (Beograd , 2025)[more][less]
Abstract: Conversational text messages represent an important form of digital communication in modern society. With the development of information technologies, various communication tools have emerged, such as email, social media, instant messaging tools, and automated response systems. Messages generated within these tools, unlike standard texts, have a specific structure that allows for the classification of individual messages or sets of messages that form a conversation. Classification labels are defined by the specific task being addressed and can be either single-label or multi-label, which enables the recognition of complex interrelationships between the categories. Introducing moral and emotional dimensions of language into research is crucial for understanding the complex patterns of human communication, particularly in the context of digital platforms and social media. Machine learning (ML) methods, such as deep neural networks (DNN), facilitate the utilization and more precise recognition of these aspects while simultaneously providing an efficient way to classify emotions and moral values expressed in texts. The noticeable complexity in the expression of human emotions and moral values, which are often conveyed implicitly and depend heavily on context, makes their recognition particularly challenging. One of the major challenges is the lack of or limited availability of resources in terms of size and diversity for low-resource languages, including Serbian. The development of linguistic resources, such as annotated lexicons and corpora, plays a crucial role in this process by providing the necessary knowledge sources for building and improving existing ML models. Linguistic resources enable models to learn how different emotional expressions and moral values influence the tone and meaning of communication. To support this, a semantic lexicon for sentiment intensity, SentiWords.SR, containing approximately 15k words, was developed for the Serbian language, along with the associated tool SRPOL for measuring sentiment intensity in textual sequences in Serbian. Additionally, a semantic lexicon for emotional affect, EmoLex.SR, comprising around 9.8k words with assigned emotional intensity values, and a semantic lexicon for moral values, MFD.SR, consisting of approximately 4.3k words with associated moral value weights, were developed. Significant efforts were also made in annotating the first conversational corpora from social media with emotional and moral categories. In this regard, the Social-Emo.SR corpus (∼34.6k messages) was developed, consisting of the Twitter-Emo.SR subcorpus (∼16.7k messages) and the Reddit-Emo.SR subcorpus (∼17.9k messages), collected from Twitter and Reddit, respectively. Furthermore, by searching for key moral-related terms, a subset of messages expressing potential moral stances was extracted from Social-Emo.SR. This subset, named Social-Mor.SR (∼13.6k messages), was manually verified and annotated by human annotators and consists of the Twitter-Mor.SR subcorpus (∼6.1k Twitter messages) and the Reddit-Mor.SR subcorpus (∼7.5k Reddit messages). In the context of DNN architectures, models based on recurrent networks or transformers, trained on these resources, enable the recognition and utilization of emotional and moral aspects of language in various contexts. The combination of advanced algorithms, such as Bidirectional Long Short-Term Memory (BiLSTM) networks and the attention mechanism with linguistically and culturally adapted resources (Meta) opens new possibilities for analyzing moral and emotional aspects of language. This has broad applications in classification tasks such as recognizing personal context, truthfulness of posts, or types of engagement in digital communication. For personal context recognition, i.e. classifying corporate emails as either business-related or personal, results show that using a carefully designed hybrid approach (BiLSTM-Att+Meta) across entire conversation branches yields the best results, comparable to published benchmarks on the same task. In experiments related to rumor veracity classification and identifying engagement types in response to rumors, it was demonstrated that moral and emotional attributes derived from semantic lexicons (EmoAttr, MorAttr ⊆ Meta) improve classification accuracy by +4.2% and +3.8% respectively, compared to methods without these attributes. For emotion recognition in Serbian conversational texts, experiments revealed that transformer-based models fine-tuned on the task achieved F1-scores of approximately 53%, reaching performance levels reported for multi-label classification on the same emotional category set. Additionally, experiments showed that further data preprocessing and balancing improved model performance. In moral value and moral sentiment classification tasks, using the Social-Mor.SR corpus and its subcorpora, an F1-score of ∼46% was achieved for moral value recognition and ∼38% for moral sentiment recognition, indicating acceptable results but also the need for further model optimization. Fine-tuning LLaMA models yielded reasonable but slightly lower performance compared to BERT-based architectures. Since model performance is directly dependent on the data they are trained on, there is potential for further improvements by refining and balancing initial annotations in the utilized corpora. URI: http://hdl.handle.net/123456789/5774 Files in this item: 1
Doktorski_rad_Milena_Sosic.pdf ( 6.206Mb ) -
Arsić, Miloš (Beograd , 2025)[more][less]