How important is a transfer function in discrete heuristic algorithms

• DOI: 10.1007/s00521-014-1743-5
• Publication Date: 2014-10-06T07:38:52Z
• Authors: Shahrzad Saremi; Seyedali Mirjalili; Andrew Lewis
• Keywords: Artificial intelligence; Machine learning; 0202 electrical engineering, electronic engineering, information engineering; Optimisation; Computer vision and multimedia computation; 02 engineering and technology; Cognitive and computational psychology

Transfer functions are considered the simplest and cheapest operators in designing discrete heuristic algorithms. The main advantage of such operators is the maintenance of the structure and other continuous operators of a continuous algorithm. However, a transfer function may show different behaviour in various heuristic algorithms. This paper investigates the behaviour and importance of transfer functions in improving performance of heuristic algorithms. As case studies, two algorithms with different mechanisms of optimisation were chosen: Gravitational Search Algorithm and Particle Swarm Optimisation. Eight transfer functions were integrated in these two algorithms and compared on a set of test functions. The results show that transfer functions may show diverse behaviours and have different impacts on the performance of algorithms, which should be considered when designing a discrete algorithm. The results also demonstrate the significant role of the transfer function in terms of improved exploration and exploitation of a heuristic algorithm.