Please use this identifier to cite or link to this item:
http://artemis.cslab.ece.ntua.gr:8080/jspui/handle/123456789/12716
Title: | Ανάλυση Δεδομένων Σε Κατανεμημένα Συστήματα Πραγματικού Χρόνου |
Authors: | Τζίμα Σοφία Βαρβαρίγου Θεοδώρα |
Keywords: | real-time systems apache storm sentiment analysis probabilistic topic models latent dirichlet allocation cluster computing parallel processing big data systems social networks |
Issue Date: | 27-Mar-2015 |
Abstract: | The scope of this thesis is the study and development of real-time systems, whichprocess large collections of documents and draw conclusions about their content andemotion. We studied different nature algorithms in order to determine both the performanceof the used tools and the real-time response of the algorithm, using metrics such as memoryusage, the amount of data units processed per second, as well as the responsiveness of thesystem under severe time constraints.The usefulness of real-time systems that process document collections, in order todraw conclusions about their content, becomes obvious if we consider the raise of socialnetworks as modern forms of communication and expression. The analysis of user createdcontent in social networks, allows us to compute useful statistics about the feeling thatprevails in public opinion around a particular theme.During the study, algorithms from the areas of probabilistic topic modelling andsentiment analysis were analyzed. We implemented those algorithms using Apache Storm,and created topologies that run endlessly in a Storm cluster. Those topologies accept data asa stream of events and export real-time information about them. Such systems are capable ofmonitoring events and making immediate decisions, based on them. |
URI: | http://artemis-new.cslab.ece.ntua.gr:8080/jspui/handle/123456789/12716 |
Appears in Collections: | Διπλωματικές Εργασίες - Theses |
Files in This Item:
File | Size | Format | |
---|---|---|---|
DT2015-0067.pdf | 1.28 MB | Adobe PDF | View/Open |
Items in Artemis are protected by copyright, with all rights reserved, unless otherwise indicated.