University of Hertfordshire Research Archive

        JavaScript is disabled for your browser. Some features of this site may not work without it.

        Browse

        All of UHRABy Issue DateAuthorsTitlesThis CollectionBy Issue DateAuthorsTitles

        Arkivum Files

        My Downloads
        View Item 
        • UHRA Home
        • University of Hertfordshire
        • Research publications
        • View Item
        • UHRA Home
        • University of Hertfordshire
        • Research publications
        • View Item

        Entropy4Cloud: Using Entropy-Based Complexity To Optimize Cloud Service Resource Management Computational Intelligence for Cloud Computing

        View/Open
        Published_Version.pdf (PDF, 1Mb)
        Author
        Chen, Huikai
        Wang, Frank
        Helian, Na
        Attention
        2299/19659
        Abstract
        In cloud service resource management system, complexity limits the system’s ability to better satisfy the application’s QoS requirements, e.g. cost budget, average response time and reliability. Numerousness, diversity, variety, uncertainty, etc. are some of the complexity factors which lead to the variation between expected plan and actual running performance of cloud applications. In this paper, after defining the complexity clearly, we identify the origin of complexity in cloud service resource management system through the study of ”Local Activity Principle”. In order to manage complexity, an Entropy-based methodology is presented to use which covers identifying, measuring, analysing and controlling (avoid and reduce) of complexity. Finally, we implement such idea in a popular cloud engine, Apache Spark, for running Analysis as a Service (AaaS). Experiments demonstrate that the new, Entropy-based resource management approach can significantly improve the performance of Spark applications. Compare with the Fair Scheduler in Apache Spark, our proposed Entropy Scheduler is able to reduce overall cost by 23%, improve the average service response time by 15% - 20% and minimized the standard deviation of service response time by 30% - 45%.
        Publication date
        2018-01-23
        Published in
        IEEE Transactions on Emerging Topics in Computational Intelligence
        Published version
        https://doi.org/10.1109/TETCI.2017.2755691
        Other links
        http://hdl.handle.net/2299/19659
        Metadata
        Show full item record
        Keep in touch

        © 2019 University of Hertfordshire

        I want to...

        • Apply for a course
        • Download a Prospectus
        • Find a job at the University
        • Make a complaint
        • Contact the Press Office

        Go to...

        • Accommodation booking
        • Your student record
        • Bayfordbury
        • KASPAR
        • UH Arts

        The small print

        • Terms of use
        • Privacy and cookies
        • Criminal Finances Act 2017
        • Modern Slavery Act 2015
        • Sitemap

        Find/Contact us

        • T: +44 (0)1707 284000
        • E: ask@herts.ac.uk
        • Where to find us
        • Parking
        • hr
        • qaa
        • stonewall
        • AMBA
        • ECU Race Charter
        • disability confident
        • AthenaSwan