https://doi.org/10.31449/inf.v43i1.1636 Informatica 43 (2019) 65–75 65 Corresponding Author: Yugal Kumar, Department of Computer Science and Engineering, JUIT, Waknaghat, Solan, Himachal Pardesh, India, yugalkumar.14@gmail.com A New Variant of Teaching Learning Based Optimization Algorithm for Global Optimization Problems Yugal Kumar Department of Computer Science and Engineering, JUIT, Waknaghat, Solan, Himachal Pardesh, India E-mail: yugalkumar.14@gmail.com Neeraj Dahiya and Sanjay Malik Department of Computer Science and Engineering, SRM University, Delhi-NCR Campus, India E-mail: neerajdahiya.cse@gmail.com, skmalik9876@gmail.com Savita Khatri Department of Computer Science and Engineering, BMIET, Sonepat, India E-mail: dhynrj@gmail.com Keywords: teaching learning based optimization, crossover, meta-heuristics, mutation Received: May 19, 2017 This paper presents a new variant of teaching learning based optimization (TLBO) algorithm for solving global optimization problems. The performance of the TLBO algorithm depends on coordination of teacher phase and learner phase. It is noticed that sometimes performance of TLBO algorithm is affected due to lack of diversity in teacher and learner phases. In this work, a new variant of TLBO algorithm is proposed based on genetic crossover and mutation strategies. These strategies are inculcated in TLBO algorithm for improving its search mechanism and convergence rate. Genetic mutation strategy is applied in teacher phase of TLBO algorithm for improving the mean knowledge of leaners. While, Crossover strategy is applied in learner phase of TLBO algorithm to find the good learner. The effectiveness of the proposed algorithm is tested on several bench mark test functions of CEC’14. From simulation results, it is stated that the proposed algorithm provides more optimized results in comparison to same class of algorithms. Povzetek: V prispevku je opisan nov globalni optimizacijski algoritem na osnovi učenja optimizacije (TLBO). 1 Introduction Optimization is an active area of research and it provides robust and viable solutions for complex real-world problems. A lot of efforts are needed to find optimal solution for these problems due to increase dimensionality, differentiability, multi-modality and rotation characteristics. Hence, a lot of research has been carried out in this direction to design a real-time numerical optimizer. This optimizer can provide more accurate, fast and computationally efficient optimization algorithms. Large numbers of algorithms have been developed by research community for solving many numerical optimization techniques. These algorithms can solve optimization problems efficiently and effectively. But, according to no free lunch theorem, there is no universal algorithm that can solve all optimization problems accurately. Over the past few decades, population based meta-heuristic algorithms have attained more popularity among research community. These algorithms have ability to turn itself according to problem domain and provide successful results for many complex problems. It is noticed that large numbers of optimization problems exist in the fields of engineering and science. These problems can be categorized as unimodal and multimodal optimization problems. Further, it can be characterized as unimodal separable and inseparable, and multimodal separable and inseparable. In literature, it is found that numbers of algorithms have been reported for solving these problems either maximizing or minimizing the objective function. Moreover, these algorithms are also adopted for solving real-life problems such as clustering, classification, scheduling, path planning, resource allocation, and many other problems. These algorithms are divided into two categories i.e. exact and approximation algorithms [1]. Exact algorithms find the optimal solution within bounded time, but having exponential computational time. The approximate algorithms provide better results in terms of time and solution using heuristics. Further, the meta-heuristic algorithms are also applied for solving the wide range of optimization problems. These algorithms are sub branch of approximate algorithms. In past decade, many meta-heuristic algorithms are developed for finding exact solution of optimization problems. Most of these are inspired through natural phenomena’s such as swarm behavior, insect’s characteristics, physics law and process etc. Some of are Simulated Annealing (SA) algorithm [2], Genetic Algorithm (GA) [3], Particle Swarm Optimization (PSO) 66 Informatica 43 (2019) 65–75 Y. Kumar et al. [4], Ant Colony Optimization (ACO) [5], Harmony Search (HS) [6], Artificial Bee Colony (ABC) [7, 33], Firefly Algorithm (FA) [8], League Championship Algorithm (LCA) [9], Water Cycle Algorithm (WCA) [10], CSS [11, 12], MCSS[13, 14, 15], TLBO [16, 17, ], CSO[47,48] and Mine Blast Algorithm (MBA) [18]. Recently, Rao et al., have developed teaching learning based optimization (TLBO) algorithm to solve the constrained and unconstrained optimization problems. This algorithm is inspired from class room based teaching methodology [19]. In short span of time, this algorithm become more popular among researchers and has been applied to solve variety of problems. A lot of optimization problems have been solved by using TLBO algorithm and provides better results in comparison to existing algorithms [20-24]. Still, there are several shortcomings that can affect the performance of TLBO algorithm such as quality of solution, stuck in local optima when solving global optimization problems, premature convergence, tradeoff between searching capability and local search ability. Hence, the aim of this work is to design an effective and efficient algorithm for addressing the convergence and quality of solution issues of TLBO algorithm. In order to overcome the aforementioned issues, this work investigates the capability of genetic crossover and mutation operators for improving the performance of TLBO algorithm. It is observed that proposed algorithm provides better results than traditional TLBO and other existing optimization algorithms.The rest of paper is organized as follows: the section 2 describes the related work on improvements in TLBO algorithm and its applicability in diverse fields. Section 3 introduces basic TLBO algorithm. The proposed genetic TLBO algorithm is illustrated in section 4. Section 5 illustrates the simulation results of proposed TLBO algorithm using benchmark functions. The entire work is concluded into section 6 and future work reported in section 7. 2 Related works This section describes the recent work reported on TLBO algorithm. Several studies have been published on the modifications of TLBO algorithm. Some of these are highlighted in this section. To make the effective tradeoff between exploration and exploitation capabilities, Rao et al. have developed an improved TLBO algorithm, called I-TLBO [25]. In this work, authors have introduced the concept of multiple teachers, adaptive teaching factor, self-motivated learning and tutorial training. The self learning and tutorial training methods can be acted as search methods. Further, to explore the local optimum solution in the hope of global optimum solution. The concept of multiple teachers is incorporated in TLBO algorithm to avoid premature convergence. Moreover, adaptive teaching factor is inculcated for fine tuning between exploration and exploitation capabilities. From results, it is seen that I-TLBO effectively overcome the aforementioned problems. Satapathy et al., have presented a new version of TLBO algorithm, called mTLBO for improving the convergence rate [26]. The proposed mTLBO algorithm is applied on global optimization problems for obtaining optimal solution. The proposed algorithm includes the concept of tutorial classes in learner phase to improve the outcomes of learners. The performance of mTLBO is compared with other state of art algorithm like PSO, DE, ABC and GA and it is observed that addition of tutorial class concept improves the results of TLBO algorithm. To enhance local search ability and quality of solutions, Haung et al., have incorporated levy flight based teaching learning process for TLBO algorithm [27]. The proposed algorithm is adopted to solve several engineering optimization problems especially industrial optimization problems. It is seen that the proposed algorithm outperforms than traditional TLBO algorithm. For improving the global performance of traditional TLBO algorithm, Zou et al., have developed an improved variant of TLBO algorithm based on learning experience [28]. Further, a copy operator is also integrated in TLBO algorithm and called it LETLBO. It is noticed that the learning experiences of learners are evaluated using two random possibilities. The performance of algorithm is tested on eighteen standard benchmark functions and compared with state of art algorithms. It is stated that above mentioned improvements significantly improve the global performance of TLBO algorithm. Ouyanget et al. have presented a new variant of TLBO algorithm to address global search and local optima issues, called GC- TLBO [29]. In GC-TLBO, a global crossover operator is introduced for addressing global search issue. Whereas, the local optima issue is controlled using perturbed mechanism. The experimental results reveal that the proposed improvements make the TLBO algorithm more effective and significant one. Ghasemi et al. have developed gaussian bare bones teaching learning optimization algorithm, called GBTLBO for improving the quality of solutions [30]. The results stated that GBTLBO algorithm provides better performance than other algorithms being compared. To avoid the premature convergence and preserve the population diversity, Zou et al. have developed an improved TLBO algorithm based on dynamic group strategy [31]. Moreover, quantum behaved learning scheme is also inculcated into learner phase of TLBO algorithm to maintain population diversity. The feasibility of proposed algorithm is evaluated on eighteen benchmark functions. Simulation results stated that the proposed algorithm is one of effective and efficient algorithm for solving global optimization problems. Lim and Isa have presented a new algorithm by combining PSO and TLBO algorithms for solving global optimization algorithm, called TPLPSO [32]. The performance of TPLPSO is investigated on twenty benchmark functions and it is found that the TPLPSO exhibits better performance than other algorithm being compared. To identify the most relevant gene in the development of the breast cancer, Sahbeig et al. proposed a combination of TLBO and fuzzy adaptive PSO algorithm, called TLBO-PSO [36]. The performance of the proposed algorithm is evaluated using accuracy, sensitivity and specificity parameters. It New Variant of Teaching Learning Based... Informatica 43 (2019) 65–75 67 is revealed that the proposed algorithm obtains higher accuracy rate i.e. 91.88 as compared to other algorithms. Kumar et al. have applied a hybrid TLBO-TS algorithm to deal with problem of simultaneous selection and scheduling of projects [37]. The proposed approach is tested on several datasets and compared with TLBO and TS algorithms. It is seen that combination of TLBO-TS algorithm provides faster convergence than TLBO and TS algorithms. Patel et al. have applied teaching-learning based optimization (TLBO) to design ultra-low reflective coating over a broad wavelength-band using multilayer thin-film structures for optoelectronic devices [38]. The results of TLBO algorithm are compared with GA using Wilcoxon singed ranked test. It is observed that TLBO algorithm gives more effective results than GA. To enhance the performance of original TLBO algorithm and make the balance between local and global searches, Ji et al. developed an improved version of TLBO algorithm, called I-TLBO [39]. In proposed algorithm, a self feedback phase is incorporated to enhance the performance of original TLBO algorithm. The effectiveness of proposed algorithm is tested on several combinatorial optimization problems. It is stated that the proposed improvements have significant impact on the performance of TLBO algorithm. To solve numerical structural analysis problems, Cheng and Prayogo presented fuzzy adaptive teaching learning based optimization algorithm, called FATLBO [40]. In proposed algorithm, three search strategies are included for improving searching capabilities. The performance of proposed algorithm is examined over five well known engineering structural problems. The results show that the proposed algorithm gives excellent and competitive performance. To analyze and predict the time series data, Das and Padhy desgined a hybrid model based on support vector machine (SVM) and TLBO [41]. The proposed model avoids user defined control parameters. The validity and efficacy of proposed model is evaluated on COMDEX commodity futures index. The results stated that proposed model is more effective and performs better than PSO-SVM and SVM models. Kankal and Uzlu adopted neural network with TLBO approach for modeling and forecasting long term electric energy demand in turkey [42]. In proposed approach, TLBO algorithm is used to optimize the parameters of neural network. The simulation results of ANN-TLBO approach is compared with ANN-BP and ANN-ABC models. It is revealed that ANN-TLBO approach provides efficient results than others. Kiziloz et al. applied multi-objective TLBO algorithm for feature subset selection in binary classifications problems [43]. The performance of the proposed algorithm is evaluated on well known benchmark problems and compared with large number of meta-heuristic algorithms such as GA, PSO, NSGA, TS and SS. It is seen that TLBO is one of the competitive algorithms for feature subset selection problem. Prakash et al. presented quasi-oppositional self- learning teacher-learner-based-optimization (QOSL- TLBO) for solving non-convex economic load dispatch (ELD) problem [44]. In this algorithm, self learning mechanism is incorporated in teacher and learner phases. The robustness of the proposed algorithm is evaluated on standard IEEE generator system. Further, the results are compared with well known algorithms. It is seen that the proposed algorithm achieves minimum total cost for all generations. Zheng et al. adopted TLBO to solve multi- skill resource constrained project scheduling problem (MS-RCPSP) with make-span minimization criterion [45]. To make effective balance between exploration and exploitation processes, the concept of reinforcement learning is introduced in TLBO algorithm. From simulation results, it is stated that the computational cost of proposed algorithm is far better than compared algorithms. Birashk et al. designed a cellular TLBO algorithm for dynamic multi objective optimization (DMOO) problems [46]. The performance of cellular TLBO algorithm is evaluated and compared with state of art algorithms using well known DMOO problems. It is observed that cellular TLBO algorithm gives superior results than other algorithms. 3 Teaching learning based optimization (TLBO) algorithm TLBO is a population based meta-heuristic algorithm. Like other population based algorithms, the global solution is represented using population [19]. TLBO algorithm works on the concept of classroom learning paradigm. The teachers are available to teach and enhance the knowledge of learners. The aim of teacher is to improve the learning capability of learners. Further, a learner can also enhance its skills by acquiring the knowledge from other learners. TLBO algorithm consists of two phases: Teacher phase and Learner phase. The detailed discussions on these phases are outlined as given below. Teacher Phase: The aim of this phase is to improve the learning skills of students such that results of class improve significantly and this can lead the mean result of class. In general, teacher can improve the result up to certain level. In practice, several constraints are responsible for results such teaching method, teachers capability, learners grasping ability, interaction of learners to others and knowledge of learners. In teacher phase, M denotes the learner’s knowledge mean and T describes any teacher in iteration. The main task of teacher is to enhance present knowledge of learners. To achieve the same, the present mean knowledge of learners i.e. M to move towards the teacher knowledge i.e. T and it can be described using equation 1. X i,new =X i,old +r∗(X Teacher −T f ×X mean ) 1 ) In equation 1, X Teacher and X mean represent the teacher and the mean of the knowledge of learner in i th iteration, T f denotes the teaching factor, and r is a random number in the range of 0 and 1. The teaching factor is computed using equation 2. T f =round(1+rand(0,1)) (2) Learner Phase: The aim of the learner phase is to enhance the knowledge of learner from others. Hence, to 68 Informatica 43 (2019) 65–75 Y. Kumar et al. improve learning ability, a learner can interact with other learners randomly. In learner phase of TLBO algorithm, learners learn knowledge from others. This learning capability of learners can be expressed as follows. If i th learner wants to interact with the k th learner and the fitness of k th learner is higher than i th learner, then the position of i th learner will be updated otherwise k th learner. This can be summarized in equations 3-4. X i,new =X i,old +r i ×(X k −X i ) (3) Else X i,new =X i,old +r i ×(X i −X k ) (4) If the fitness of i th learner is better than old position, then new position take over the old one otherwise not. 4 Proposed TLBO algorithm This section describes the working of proposed TLBO algorithm for solving global optimization problems. In this work, two amendments are made in TLBO algorithm for improving search mechanism and convergence rate. Hence, to achieve the same, genetic crossover and mutation operators are incorporated into TLBO algorithm. The genetic mutation operator is adopted in teacher phase. Further, genetic crossover operator is used to enhance learning capability of a learner through different learners. These improvements are illustrated in Algorithm 1 and Algorithm 2. Algorithm 1: Teacher Phase of TLBO algorithm For d=1 to N For j =1 to D DifferenceMean =r(T mean −T f ×M i ) T f =round(1+rand(0,1)) IF (DifferenceMean <𝑟𝑎𝑛𝑑 () ) Apply genetic mutation operator on T mean andM i Compute Difference Mean and generate the new mean of knowledge (X i,new ) using equation 3. Else X i,new =X i,old +DifferenceMea n i End End Accept X i,new if f(X i,new ) is better than f(X i,old ) End The aim of these operators is to maintain population diversity during teacher and learner phases, and further, overcome the chance of trapping in local optima. In learner phase, the knowledge of learner is not enhanced gradually, the fitness of leaner is compared with random function. If, it is less than random number, the crossover operator is applied to find other learner to enhance its skills and knowledge. Algorithm 2: Learner Phase of TLBO algorithm For i =1 to N Randomly pick two learners X i and X k such that i≠ j IF (𝐹 (X i )<𝐹 (X k )) IF (𝐹 (X i )