Presenting an ant community algorithm to improve the time of doing tasks in the grid environment

Number of pages: 85 File Format: word File Code: 31011
Year: 2014 University Degree: Master's degree Category: Computer Engineering
  • Part of the Content
  • Contents & Resources
  • Summary of Presenting an ant community algorithm to improve the time of doing tasks in the grid environment

    Dissertation for M.Sc degree

    Abstract

    In this thesis, we have presented a new method in network processing with Ant Algorithm. The model we used in the network space is a continuous two-way auction. Due to their simplicity and dynamics, these models are used in many algorithms used to control resources and schedule tasks. Many of these models are weak in their response time when managing resources. In the auction model, the auctioneers announce the buyers' desired prices, and the buyer who announced the right price gets the resource. This problem itself causes the response time to increase due to buyers' requests. In this thesis, we presented a new method using the genetic algorithm in the two-way auction scenario. In this method, by intelligentizing the resources, we moved the proposed request packages[1] to a direction. Each of these network environments can be considered as a distributed system that does not interact with other networks and covers a large amount of data. One of the benefits of this method compared to the clustering method is that resources can be geographically dispersed and asymmetrically placed. According to the distribution of data sets, the selection of computing resources and data containing resources should be done appropriately so that the overhead caused by transferring these sets to the grid is minimized. In this research, the problem of scheduling programs that require data is considered. Given that optimal scheduling requires choosing the right set of resources. In network processes, the environments are dynamic in the sense that resources may be on at one time and the same resources may be off at another time

    The implementations made in the simulation software GridSim were examined and the results showed that this new method improves the processing time and reduces the number of auction steps.

    Key words: algorithm, network, software, call for proposal

    Chapter One

    1-1- Introduction

    The main goal of this thesis is to improve efficiency in network processing by the Ant algorithm. This chapter starts with the main problem of network processing and its importance is explained. The use of Ant algorithm in many problems has improved efficiency and reduced processing time. This provides an opportunity to use this algorithm in batch processing.

    1-2- Network processing

    Network processing refers to a set of resources that work from several different points to achieve a goal. Each of these network environments can be considered as a distributed system that does not interact with other networks and covers a large amount of data. One of the benefits of this method compared to the clustering method is that resources can be geographically dispersed and asymmetrically placed. . According to the distribution of data sets, the selection of computing resources and data containing resources should be done appropriately so that the overhead caused by transferring these sets to the grid is minimized. In this research, the problem of scheduling programs that require data is considered. Given that optimal scheduling requires choosing the right set of resources. In network processes, environments are dynamic in the sense that resources may be on at one time and the same resources may be off at another time. Also, in these processes, they may differ in terms of hardware and software.

    Network processing has different architectures, which can be mentioned as follows:

    GT2

    OGSA

    GT3

    1-3- Ant algorithm

    Ant algorithm is a heuristic algorithm with an optimal local search that is used for combinatorial problems. This method is inspired by the natural behavior of ants. In nature, ants show the way to other ants with the substance they emit. In many researches, the ant colony method is used to solve NP-hard problems. This method is used to solve problems such as traveling salesman, graph coloring and routing.

    A community of ants is a collection of intelligent ants that behave as a group.. This community searches the environment to find the optimal solution.

    In the scheduling problem in network environments, each of these tasks is considered as an ant. Each of these ants moves in search of the resources they want.

    The pseudo code of the ant community is shown below:

    Procedure ACO

    begin

    Initialize the pheromone

    while stopping criterion not satisfied do repeat for each ant do Chose next node by applying the state transition rate end for until every ant has build a solution Update the pheromone end while end

    There are different methods for the ant community, which can be mentioned as follows:

    Max-Min Ant System

    Rank-based Ant System

    Fast Ant System

    Elitist Ant System

    1-4- Challenges of network processing

    One of the important challenges in network processing is how to prioritize and time Bandi referred to processes. The scheduling problem in network processing consists of three parts:

    Finding resources that include resources that can be used

    Collecting information about these resources and choosing the best set of resources

    Works are done in this step

    The step of finding the best set of resources is one of the NP-Complete problems. There are two main goals in scheduling jobs:

    The system has the highest efficiency

    Has the highest output

    For the first goal, a method that reduces the processing time should be provided, and for the second goal, a method should be provided that divides the schedule into a set of independent tasks. This work increases the system's capacity to perform work per unit of time.

    Different methods have been provided to solve this problem. One of these methods is to map this problem to the traveling salesman problem. In this method, the paths that the resources have in relation to each other are important. In network processing, due to the fact that the resources are located at different distances and are not symmetrical to each other, this method can be useful in some cases.

    In the continuation of this research, the contents are presented as follows.

    In the second chapter, we have discussed the relevant backgrounds and the generalities of the scheduling methods, ant, genetics, and auction have been discussed.

    In the third chapter, the most important algorithms and methods implemented in the context of scheduling algorithms are presented.

    In the fourth chapter, we present the proposed method and the simulation results of the proposed method (Acdanp) are evaluated and compared with the previous method.

    In the fifth chapter, we present the suggestions and future works. In addition, the source code written in the Gridsim environment is given in Appendix A.

    (images and formulas are available in the main file)

    Chapter Two

    Research Background

    1-1- Overview of Algorithms and Methods

    In this section, we review the work done in grid processing. First, we will explain the basic methods such as Dynamic level scheduling and then the recent methods used in this field.

    2-2- Dynamic multilevel scheduling

    In this method, the goal is to choose the best pair of subtasks and machines for scheduling [1]. A special model has been presented to perform the stated action. The general goal in this method is to reduce the program processing time. In networked processing environments, scheduling algorithms no longer emphasize the subtasks of a program that is executed in the computing host or virtual organization. The main goal is scheduling in such a way that all input programs can use the available power. In the article [2], by adding heuristics to the mentioned method, they have tried to increase the efficiency of the system. 2-3- Allocating the fastest processor to the biggest task. This method depends on two parameters of processor speed and resources and workload. In this method, the largest work is assigned to the fastest resource. If there are a large number of tasks with a large volume, then this method has very low efficiency.

    The dynamic FPLTF method [4] is developed according to the static FPLTF method.

  • Contents & References of Presenting an ant community algorithm to improve the time of doing tasks in the grid environment

    List:

    Abstract 1

    Chapter 1: Introduction. 2

    1-1- Introduction. 3

    1-2- Network processing. 4

    1-3- Ant algorithm. 4

    1-4- Network processing challenges. 5

    Chapter 2: 7

    2-1- Overview of algorithms and methods 8

    2-2- Dynamic multilevel scheduling 8

    2-3- Allocating the fastest processor to the largest task. 8

    2-4- Work queue with repetition (WQR) 8

    2-5- Balanced ant community algorithm (BACO) 9

    2-6- Genetic algorithm method in network processing. 10

    Chapter 3: Research background. 13

    3-1- An agent-based system for resource management (ARMS) 14

    3-2- Ant link method 15

    3-3- Acquisition of resources in network processing by reinforcement learning algorithm. 16

    3-4- Experimental method of ants by allocating resources with time sharing method in network processing. 18

    3-5- Attached two-way auction method courier. 19

    3-6- A combination of genetic algorithms. 20

    3-7- meta-schedulers to schedule parallel programs. 21

    3-8- An improvement method by an ant colony. 31

    3-9- An agent-based method to increase. 34

     

     

    Chapter 4: Presentation of the proposed method and implementation. 37

    4-1 Processing in network environments with business models. 38

    4-2- Two-way auction method in network processing. 40

    4-3- How to implement the presented methods 47

    4-4- Auctioneer class 50

    4-5- User class. 52

    4-6- ExampleAuction.java class. 54

    4-7- Class related to auction resources (AuctionResource.java) 55

    Chapter 5: Conclusion and suggestions. 58

    Resources. 74

     

    Source:

    . Taheri and et al, "A Bee Colony based optimization approach for simultaneous job scheduling and data replication in grid environments", Computers and Operations Research, Vol 40, pp. 1564-1478, 2013.

    [2] K. Gkoutioudi, H. D. Karatza, "Task cluster scheduling in a grid system", Simulation Modeling Practice and Theory, Vol. 18, pp. 1242-1252, 2010.

    [3] Y. Goa and et al, "Adaptive grid job scheduling with genetic algorithms", Future Generation Computer Systems, Vol. 21, pp. 151-161, 2005.

    [4] R. S. Chang and et al, "An ant algorithm for balanced job scheduling in grids", Future Generation Computer Systems, Vol. 25, pp. 20-27, 2009.

    [5] J. Yang and et al, "An ant colony optimization method for generalized TSP problem", Progress in Natural Science, Vol. 18, pp. 1417-1422, 2008.

    [6] M. Mavrivounitis and S. Yang, "Ant colony optimization with immigrants schemes for the dynamic traveling salesman problem with traffic factors", Applied Soft Computing, Vol. 13, pp. 4023-4037, 2013.

    [7] S.M. Chen and C. Y. Chien, "Solving the traveling salesman problem based on the genetic simulated annealing ant colony system with particle swarm optimization techniques", Expert Systems with Applications, Vol. 38, pp. 14439-14450, 2011.

    [8] S. M. Chen and C. Y. Chien, "Parallelized genetic ant colony systems for solving the traveling salesman problem", Expert Systems with Applications, Vol. 38, pp. 3873-3883, 2011.

    [9] T. N. Bui and et al, "An ant-based algorithm for coloring graphs", Discrete Applied Mathematics, Vol. 156, pp. 190-200, 2008.

    [10] K. A. Dowsland and J. M. Thompson, "An improved ant colony optimization heuristic for graph coloring", Discrete Applied Mathematics, Vol. 156, pp. 313-324, 2008.

    [11] Z. Cong and et al, "Ant Colony Routing algorithm for freeway networks", Emerging Technologies, Vol. 37, pp. 1-19, 2013.

    [12] M. Reed and et al, "An ant colony algorithm for the multi-compartment vehicle routing problem", Applied Soft Computing, Vol. 15, pp. 169-176, 2014.

    [13] Z. Xiao and W. J. Qing, “Hybrid Ant Algorithm and Applications for Vehicle Routing Problem”, Physics Procedia Vol. 25, pp. 1892-1899, 2012.

    [14] E. Burke and et al, "An ant hyperheuristic algorithm for the project presentationBurke and et al, "An ant hyperheuristic algorithm for the project presentation scheduling problem", IEEECongress on Evolutionary Computing, Vol. 3, pp. 2263–2270, 2005.

    [15] Y. H. Lee and et al, “Improving job scheduling algorithms in a grid environment”, Future Generation Computer Systems, Vol. 27, pp. 991-998, 2011.

    [16] R. S. Chang and et al, "An Adaptive Scoring Job Scheduling algorithm for grid computing", Information Sciences, Vol. 207, pp. 79-89, 2012.

    [17] L. Wei and et al, "An Improved Ant Algorithm for Grid Task Scheduling Strategy", Physics Procedia, Vol. 24, pp. 1974-1981, 2012.

    [18] L. Dudy, et al. "Efficient hierarchical parallel genetic algorithms using grid computing" Future Generation Computer Systems, Vol. 4, pp. 658-670, 2007.

    [19] Priya and et al, "Fault tolerance-genetic algorithm for grid task scheduling using check point" Grid and Cooperative Computing, International Conference on. IEEE, 2007. [20] Aggarwal and et al, "Genetic algorithm based scheduler for computational grids" High Performance Computing Systems and Applications, International Symposium on. IEEE, 2005.

    [21] S. Singh and et al, "Genetic Algorithm based Resource Broker for Computational Grid", Procedia Technology, Vol. 10, pp. 572-580, 2013.

    [22] S. Nesmachnow and et al, "A parallel micro evolutionary algorithm for heterogeneous computing and grid scheduling", Applied Soft Computing, Vol. 12, pp. 626-639, 2012.

    [23] V. D. Mrtino and et al, "Sub optimal scheduling in a grid using genetic algorithms", Parallel Computing, Vol. 30, pp. 553-565, 2004.

    [24] A. A. Tantar and et al, "A parallel hybrid genetic algorithm for protein structure prediction on the computational grid", Future Generation Computer Systems, Vol. 23, pp. 398-409, 2007.

    [25] J. Kolodziej and et al, "Enhancing the genetic-based scheduling in computational grids by a structured hierarchical population", Future Generation Computer Systems, Vol. 27, pp. 1035-1046, 2011.

    [26] Ritchie, Graham, and John Levine. "A hybrid ant algorithm for scheduling independent jobs in heterogeneous computing environments." 2004. [27] Y. Yuan and et al., “A hybrid harmony search algorithm for the flexible job shop scheduling problem”, Applied Soft Computing, Vol. 3259-3272, 2013. [28] Pooranian, Z., et al technology, Vol. 924-928. [29] Xhafa and A. Abraham, "An adaptive scoring algorithm for grid." computing." Information Sciences, Vol. 207, pp. 79-89, 2012.

    [31] Xu and et al, "Ant algorithm-based task scheduling in grid computing." Electrical and Computer Engineering", Canadian Conference on. Vol. 2. IEEE, 2003.

Presenting an ant community algorithm to improve the time of doing tasks in the grid environment