Reducing energy consumption in the cloud environment using virtual machine migration

Number of pages: 72 File Format: word File Code: 31085
Year: 2012 University Degree: Master's degree Category: Computer Engineering
  • Part of the Content
  • Contents & Resources
  • Summary of Reducing energy consumption in the cloud environment using virtual machine migration

    Master thesis in computer engineering (software)

    Abstract

    Reducing energy consumption in the cloud environment using virtual machine migration

    Reducing energy consumption is one of the most important issues of the day, especially in the industry sector. In recent years, the ever-increasing human needs for computer systems have caused the creation and expansion of more and more data centers with a large number of computers, which in total consume significant electricity. Obviously, in such a situation, many efforts have been made by experts to reduce electricity consumption in these centers, and now efforts in this field are of particular importance. One of the ways to reduce power consumption in data centers is virtual machine migration.

    In this thesis, using virtual machine migration, a software package has been designed and implemented, which based on the workload of each computer and the transfer of load between systems in the form of virtual machine migration creates suitable conditions for reducing power consumption, and by using it, it reduces consumption significantly. 

     

    Chapter One

    Introduction

     

    In this chapter, the electricity consumption in the computer will be explained first. Then, energy consumption in data centers and finally virtualization are described. 1-1- Energy consumption in a computer The electricity consumption in a computer can be divided into two parts: Static: It is a part of the computer's energy consumption that is only used to keep the system on and is not related to the amount of work that the system does. This level of energy consumption keeps the system on and ready to work and is consumed from the moment the system is turned on. A large part of this energy is actually wasted in different ways and at different levels of hardware; such as current leakage in integrated circuits[1].

    Dynamic: it is a part of the computer's energy consumption that is used to perform system activities and varies according to the amount of load[2] on different parts of a system (such as: processor, memory[3], hard disk[4], graphics card[5], etc.). It does not consume, but contrary to what is thought, a server consumes about 60 to 70% of its maximum power[6] when idle [Barroso, 2007] and [Fan, 2007] and [Lefurgy, 2007]. The maximum power consumption of a computer is when it works with its maximum processing power[7].

    1-2- Data centers and their energy consumption

    A data center is a building, including a large number of computers (servers) and their required parts such as network switches and backup energy sources [Kumar, 2009]. such as storage servers [8], cooling systems, network equipment and

    The noteworthy point in this case is the contribution of servers to the energy consumption of the data center of approximately 50%. In other words, only half of the energy consumed by a data center is spent on processing and responding to requests, and the rest is spent on other things, the most important of which are cooling systems. Figure 1-1, which shows the breakdown of the energy consumption of a data center, is a good illustration of this issue.

    Regarding the amount of energy consumption in data centers, statistics show that in addition to the significant amount, it has a growing trend in terms of the amount and share of the total energy consumption of the society [Koomey, 2011]. Figure 2-1 represents this issue. According to research [Barroso, 2007], [Boher, 2002], [Rangan, 2008] and [Siegele, 2008], the average utilization [9] of servers in a data center is less than 30%, and a server is close to maximum utilization only 10% of the time [Armbrust, 2010].

    Thus, according to the share of energy consumption of a server in idle mode, it can be seen that a significant share of the energy consumption of data centers is wasted.

    1-3-     Virtualization

    Virtualization was first introduced in the 1970s for the simultaneous use of a system by several users [Bugnion, 1997].

    Today, virtualization, including tools that have been added to it, features such as increasing the security of users, especially in non-collaborative spaces, increasing the productivity of servers, creating a suitable platform for different software components under different operating systems and at the same time, simplifying service and maintaining systems in data centers, creating the possibility of load balancing [10] between different servers and so on. which has caused most of the industry, especially data centers, to move towards the use of this technology, as today almost all data centers in the world use this technology [Armbrust, 2010]. Such environments consisting of a collection of computers that use virtualization technology to provide their services are called "supervirtuals"[11]. In fact, cloud computing is the same data centers that provide their services on the network and in the form of hardware packages formed through virtualization [Armbrust, 2010] and [Armbrust, 2009]. We call these hardware packages together with the operating system inside it "virtual machine"[12].

    Virtual machine migration[13] is one of the features that were added to it some time after the advent of virtualization, and in short, it is the transfer of a virtual machine from one server to another. Virtual machine migration can be live [14] in such a way that the end user [15] who receives service from the migrating virtual machine does not notice any disruption in receiving the service, and in other words, does not notice the movement of the server virtual machine at all [Clark, 2005]. Figure 1-3 shows a diagram of virtual machine migration between two active servers.

    If we want to examine live virtual machine migration more closely, there will actually be a service interruption, which will be between 60 and 300 milliseconds [Clark, 2005]. Anyway, from the point of view of the user and the response to the requests, it is important that virtual machines can be moved between different servers without problems or paying high time and energy consumption [Liu, 2011]. The third chapter is dedicated to the proposed model for reducing electricity consumption in data centers. In the fourth chapter, we will describe how to implement, the environment and how to perform tests. The summary of the results and the suggestions for the next work are presented in the fifth chapter. Chapter Two Research Background 1 Research Background The huge energy consumption in data centers imposes exorbitant costs and side problems such as global warming and intensifying the energy crisis. In such a situation, trying to save this energy becomes particularly important, especially considering the energy loss that occurs in these centers. Therefore, a lot of work has been done in this field, which we will discuss in this chapter.

    2-1- Saving computer energy

    Methods to save the energy consumed by a computer are divided into two parts, according to which part of the energy they target to save.

    2-1-1.  Saving dynamic energy

    Dynamic power is a part of the power consumption that is caused by the alternating current and frequency of the parts. To reduce this part of power consumption, there are methods at the hardware and software level.

    At the hardware level, by making changes and improving the efficiency of parts during their design and manufacture, such as concentrating circuits as much as possible, using alloys and conductors with higher conductivity, reducing the threshold of significant voltage, energy consumption can be reduced. Such changes will reduce the overall energy consumption of a system, regardless of the environment and under what conditions the system works.

    Creating capabilities in the hardware that enable reducing energy consumption in certain situations and at a higher level. Such as predicting several different performance modes for the main processor [16] and placing the possibility of selecting these modes at the software level so that when the system is working, the operating system can determine the optimal performance mode according to the energy consumption according to the working conditions.

  • Contents & References of Reducing energy consumption in the cloud environment using virtual machine migration

    List:

    Chapter One: Introduction. 1

    1-1 Energy consumption in computers. 2

    1-2 data centers and energy consumption in them. 3

    1-3 virtualization.. 5

    1-4 thesis structure. 7

    Chapter Two: Background of the research. 8

    2-1 Saving computer energy. 9

    2-1-1 saving dynamic energy. 9

    2-1-2 saving static energy. 10

    2-2 Saving energy consumption of data centers. 13

    2-3 Energy saving using virtual machine combination. 15

    Chapter three: The proposed model. 19

    3-1 Definitions.. 20

    3-1-1 Sleep state. 20

    3-1-2 Selection and deployment. 21

    3-1-3 Classification limits. 22

    3-2 Design and parts of the proposed model. 22

    3-3 Performance of the proposed model in a data center. 26

    3-4 side part of the proposed model. 27

    3-4-1 Information collection unit. 28

    3-4-2 Information sending unit. 30

    3-4-3 units of receiving and executing commands. 30

    5-3 The central part of the proposed model. 34

    3-5-1 Information receiving unit. 34

    3-5-2 Information storage unit. 35

    3-5-3 server classification unit. 35

    3-5-4 decision making unit. 37

    3-5-5 command sending units. 40

    3-6 overheads of the proposed model. 40

    Chapter Four: Implementation. 42

    4-1 Free parameters in the resulting software. 43

    4-2 implementation coordinates. 45

    4-2-1 data collection and information transmission interval. 45

    4-2-2 Selection and deployment. 45

    4-2-3 Classification limits and margins. 47

    4-3 custom software configuration. 47

    4-4 test environment. 49

    4-5 initial measurements. 51

    4-6 Loads used for experiments. 52

    4-6-1 Test loading. 53

    4-6-2 Actual loading. 55

    Chapter Five: Results and suggestions. 57

    5-1 Results.. 58

    5-1-1 Experimental loading results. 58

    5-1-2 Actual loading results. 61

    5-2 Summary of results. 64

    3-5 summary and conclusion. 65

    5-4 suggestions.. 66

    List of sources. 68

     

    Source:

    [AMD, 1998] AMD White Paper, Magic Packet Technology Advance Micro Devices, 1998. http://www.amd.com/us-en/ConnectivitySolutions /TechnicalRes- ources/0,,50_233 4_2481,00.html.

    [Armbrust, 2010] Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A. & Zaharia, M. "A view of cloud computing." Communications of the ACM Vol. 53, No. 4, pp. 50-58, 2010.

    [Armbrust, 2009] Armbrust, M., Fox, A., & Griffith, R. "Above the clouds: A Berkeley view of cloud computing." Department Electrical Eng. and Comput. Sciences, University of California, Berkeley, Tech. Rep. UCB/EECS 28 (2009).

    [Barford, 1998] Barford, P., & Crovella, M. "Generating representative web workloads for network and server performance evaluation." ACM SIGMETRICS Performance Evaluation Review. Vol. 26, No. 1, pp. 151-160, 1998.

    [Barham, 2003] Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I.  & Warfield, A. "Xen and the art of virtualization." ACM SIGOPS Operating Systems Review. vol. 37, no. 5, pp. 164-177.2003.

    [Barroso, 2007] Barroso, L. A., & Holzle, U. "The case for energy-proportional computing." IEEE Computer.  Vol. 40, no. 12, pp. 33-37. 2007.

    [Beloglazov, 2010] Beloglazov, A., & Buyya, R. "Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers." Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science, Bangalore, India. p. 4.  2010.

    [Beloglazov, 2012] Beloglazov, A., & Buyya, R. "Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers." Concurrency and Computation: Practice and Experience (CCPE), 2012.

    [Boher, 2002] Bohrer, P., Elnozahy, E., Keller, T., Kistler, M., Lefurgy, C., McDowell, C., & Rajamony, R. "The case for power management in web servers." PowerPower aware computing 78758 (2002).

    [Bugnion, 1997] Bugnion, E., Devine, S., Govil, K., & Rosenblum, M. Disco: Running commodity operating systems on scalable multiprocessors." ACM Transactions on Computer Systems (TOCS) vol. 15, no. 4, pp. 412-447, 1997.

    [Buyya, 2010] Buyya, R., Garg, S.K,. "SLA-oriented resource provisioning for cloud computing: challenges, architecture, and solutions." Cloud and Service Computing (CSC) International Conference, Hong Kong, China, 2010. pp. 1-10.

    [Clark, 2005] Clark, C., Fraser, K., Hand, S., Hansen, J. G., Jul, E., Limpach, C., Pratt, I. & Warfield, A. "Live migration of virtual machines." Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation. Berkeley, CA, USA. Vol. 2, pp. 273-286, 2005.

    [Das, 2010] Das, T., Padala, P., Padmanabhan, V. N., Ramjee, R., & Shin, K. G. "LiteGreen: Saving energy in networked desktops using virtualization." In Proceedings of the 2010 USENIX conference on USENIX annual technical conference (USENIXATC'10). USENIX Association, Berkeley, CA, USA, 3-3. 2010.

    [Fan, 2007] Fan, X., Weber, W. D., & Barroso, L. A. "Power provisioning for a warehouse-sized computer." ACM SIGARCH Computer Architecture News. Vol.  35, no. 2, pp. 13-23, 2007.

    [Feitelson, 2002] Feitelson D. Workload modeling for performance evaluation. Performance Evaluation of Complex Systems: Techniques and Tools. Lecture notes in computer science 2002; pp. 114–141.

    [Iyengar, 2010] Iyengar, M., & Schmidt, R. R. “Energy Consumption of Information Technology Data Centers”, OPEN BATH IMMERSION COOLING IN DATA CENTERS KEEPING MOORESS LAW ALIVE, ElectronicsCooling Winter 2010, p. 28.

    [Jung, 2008] Jung, G., Joshi, K. R., Hiltunen, M. A., Schlichting, R. D., & Pu, C. "Generating adaptation policies for multi-tier applications in consolidated server environments." Autonomic Computing, 2008. ICAC'08. International Conference on Chicago, IL, USA, 2008. pp. 23-32.

    [Kumar, 2009] Kumar, S., Talwar, V., Kumar, V., Ranganathan, P., & Schwan, K. "vManage: loosely coupled platform and virtualization management in data centers." Proceedings of the 6th international conference on autonomous computing, Barcelona, ??Spain, 2009. pp. 127-136.

    [Kusic, 2009] Kusic, D., Kephart, J. O., Hanson, J. E., Kandasamy, N., & Jiang, G. "Power and performance management of virtualized computing environments via lookahead control." Cluster computing, vol. 12, no. 1, pp. 1-15, 2009.

    [Laudon, 2006] Laudon, J. “UltraSPARC T1: A 32-threaded CMP for servers,” Invited talk, Apr 2006.

    [Lefurgy, 2003] Lefurgy, C., Rajamani, K., Rawson, F., Felter, W., Kistler, M., & Keller, J. T. W. "Energy management for commercial servers." IEEE Computer, vol. 36, no. 12, pp. 39-48, 2003.

    [Lefurgy, 2007] Lefurgy, C., Wang, X., & Ware, M. "Server-level power control." in Proc. of the IEEE International Conference on Autonomic Computing, Jan 2007, pp. 4-4.

    [Li, 2009] Li, H. "Workload dynamics on clusters and grids." The Journal of Supercomputing, vol. 47, no. 1, pp. 1-20, 2009.

    [Liu, 2011] Liu, H., Jin, H., Xu, C. Z., & Liao, X. "Performance and energy modeling for live migration of virtual machines." In Proceedings of the 20th international symposium on high performance distributed computing, New York, NY, USA, 2011, pp.171-182.

    [Meisner, 2009] Meisner, D., Gold, B. T., & Wenisch, T. F. "PowerNap: eliminating server idle power." ACM Sigplan Notices. vol.  44, no. 3, pp. 205-216. 2009.

    [Nathuji, 2007] Nathuji, R., & Schwan, K. "VirtualPower: coordinated power management in virtualized enterprise systems." ACM SIGOPS Operating Systems Review. vol. 41. no. 6. pp. 265-278, 2007.

    [Rangan, 2008] Rangan, K., Cooke, A., Post, J., & Schindler, N. “The Cloud Wars: $100+ billion at stake”, Tech. rep., Merrill Lynch, May 2008.

Reducing energy consumption in the cloud environment using virtual machine migration