Hi,

The swish was originally coined the "SiLU" in https://arxiv.org/pdf/1606.08415.pdf (2016) and re-introduced in https://arxiv.org/abs/1702.03118 (early 2017) long before the swish paper. Renaming other peoples' exact same ideas is unacceptable, as we all know. A recent discussion and a recent pytorch and jax and tensorflow issue show that we should call this the SiLU. In light of recent efforts to make the ML community more equitable and fair, this is a no-brainer. (Since this repo uses pytorch, I'll note that a future version of pytorch will add the silu activation.)