Monotone Approximation by Quadratic Neural Network of Functions in Lp Spaces for p<1
DOI:
https://doi.org/10.24996/ijs.2020.61.4.20Keywords:
Essential approximation, monotone approximation, modulus of smoothness, activation function, neural networkAbstract
Some researchers are interested in using the flexible and applicable properties of quadratic functions as activation functions for FNNs. We study the essential approximation rate of any Lebesgue-integrable monotone function by a neural network of quadratic activation functions. The simultaneous degree of essential approximation is also studied. Both estimates are proved to be within the second order of modulus of smoothness.