smooth-approximation-function

一些函数的光滑逼近的实现与可视化。相关的讨论见函数光滑近似（4）：Heaviside step函数及其应用。

Heaviside step函数光滑近似

relu衍生的六种激活函数对比，

基于广义正态分布的relu衍生，

abs衍生的六种光滑逼近函数对比，

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
asset		asset
.gitignore		.gitignore
README.md		README.md
delta_func.py		delta_func.py
generalized_normal.py		generalized_normal.py
generalized_normal_relus.py		generalized_normal_relus.py
mishs.py		mishs.py
mixed_normal.py		mixed_normal.py
sigmoid_ex.py		sigmoid_ex.py
smooth_1.py		smooth_1.py
smooth_2.py		smooth_2.py
smooth_3.py		smooth_3.py
smooth_4.py		smooth_4.py
smooth_5.py		smooth_5.py
smooth_6.py		smooth_6.py
smooth_7.py		smooth_7.py
smooth_abs.py		smooth_abs.py
smooth_relu.py		smooth_relu.py