Activation functions are implementation details. See appendix for the general fo... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		rdlecler1 on July 15, 2024 \| parent \| context \| favorite \| on: General Theory of Neural Networks Activation functions are implementation details. See appendix for the general formula.

LarsDu88 on July 15, 2024 [–]

Ok, I get what you mean now. You can build a model by plugging in any activation function into the two slots in the equation at the bottom.

There's a typo in the activation function next to "otherwise" in the "Ant Pheromone Signaling" row.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact