09-23-2024, 11:49 AM
(09-23-2024, 11:15 AM)litdev Wrote: Worth pursuing, but ultimately I suspect you will conclude that the 'standard' way is best - but its great to test ideas and draw your own conclusions. Do have a look at the link I posted previously, while it is great to pursure your own reasearch it is also good to see how others think about it.
One issue I see is that imagine we have a larger realistic case with say 100 neurons, storing an activation function for each one (potentially thousands of values in each) is going to need lots of memory and be slow to run - for non integers it will need to be interpolated. My understanding is that the main purpose of the activation function is to convert summed weights from a previous layer to a neuron value between 0 and 1 (often called a compression function).
I am also very interested to know WHAT and WHY it will work out.
This is the great value of the SB-Prime Editor and Extension you created. Thanks to you, many people have the opportunity to very easily use programming for benefit and pleasure.
Thank you on behalf of all these people!
