Activation functions are fundamental to the representational power of deep neural networks, introducing non-linearity that enables the modelling of complex patterns beyond linear relationships. Early ...