|
| Performance Analysis of Various Activation Functions in Generalized MLP Architectures of Neural Networks
|
|
Full
text: |
 PDF(506.3KB) |
|
|
Source |
International Journal of Artificial Intelligence and Expert Systems (IJAE) |
|
Table of Contents |
|
|
Download
Complete Issue PDF(487.48KB) |
|
Volume: 1 Issue: 4 |
| |
Pages: 75-122 |
|
Publication
Date: December 2010 |
|
ISSN
(Online): 2180-124X |
|
|
|
|
|
Pages |
111 - 122 |
|
Author(s) |
|
|
|
Published
Date |
08-02-2011 |
|
Publisher |
CSC
Journals, Kuala Lumpur,
Malaysia |
|
ADDITIONAL
INFORMATION |
| Keywords Abstract References Cited by Related Articles Collaborative
Colleague |
| |
|
| |
KEYWORDS: Activation Functions, Multi Layered Perceptron, Neural Networks, Performance Analysis |
|
|
| |
|
|
| This Manuscript is indexed in the following databases/websites:- |
|
| 1. Docstoc |
| 2. Google Scholar |
| |
|
| |
|
|
| The activation function used to transform the activation level of a unit (neuron) into an output signal. There are a number of common activation functions in use with artificial neural networks (ANN). The most common choice of activation functions for multi layered perceptron (MLP) is used as transfer functions in research and engineering. Among the reasons for this popularity are its boundedness in the unit interval, the function’s and its derivative’s fast computability, and a number of amenable mathematical properties in the realm of approximation theory. However, considering the huge variety of problem domains MLP is applied in, it is intriguing to suspect that specific problems call for single or a set of specific activation functions. The aim of this study is to analyze the performance of generalized MLP architectures which has back-propagation algorithm using various different activation functions for the neurons of hidden and output layers. For experimental comparisons, Bi-polar sigmoid, Uni-polar sigmoid, Tanh, Conic Section, and Radial Bases Function (RBF) were used. |
| |
|
| |
|
| |
| |
|
| |
|
| |
| 1 |
KARAN O?uz, BAYRAKTAR Canan, GÜMÜ?KAYA Haluk, KARLIK Bekir, “Diagnosing Diabetes Using Neural Networks on Small Mobile Devices”, Expert Systems with Applications, vol. 39 (2012), pp. 54-60, 2012
|
|
|
| |
|
| |
|
| |
| |
|
| |
|
| |
|
| Bekir Karlik : Colleagues
|
|
| Ahmet Vehbi : Colleagues
|
|
