10-01-2024, 04:49 PM
(translated by Google translator)
Hello.
My thoughts about the structure of our SB-Neuron led me to splines.
As a starting point, the question that's in my head right now is: "What happens if we insert a custom Bezier curve into a classic neuron instead of a sigmoid as the activation function?". And, during training, we will change not only the input data weights, but also the shape of the Bezier curve.
What do you think will come of this?
Hello.
My thoughts about the structure of our SB-Neuron led me to splines.
As a starting point, the question that's in my head right now is: "What happens if we insert a custom Bezier curve into a classic neuron instead of a sigmoid as the activation function?". And, during training, we will change not only the input data weights, but also the shape of the Bezier curve.
What do you think will come of this?