Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gaussian (normal distribution) activation function #915

Closed
damiano1996 opened this issue Jan 21, 2020 · 3 comments
Closed

Gaussian (normal distribution) activation function #915

damiano1996 opened this issue Jan 21, 2020 · 3 comments

Comments

@damiano1996
Copy link

Describe the feature and the current behavior/state.
After this article I tried to implement a perceptron with an apical activation function similar to the real.
An approximation function of the apical was the gaussian, thus I implemented it.
In my fork you can find it.

Now, also the perceptron can learn the XOR logic function:
XOR

Relevant information

  • Are you willing to contribute it? (yes/no): yes.
  • Are you willing to maintain it going forward? (yes/no): no.
  • Is there a relevant academic paper? (if so, where): I don't know.
  • Is there already an implementation in another framework? (if so, where): I did not find anything.
  • Was it part of tf.contrib? (if so, where): no.

Which API type would this fall under (layer, metric, optimizer, etc.)
activations.

Who will benefit with this feature?
researchers, developers.

Any other info.

@damiano1996
Copy link
Author

What can I do? The code is just ready in my fork.

@seanpmorgan
Copy link
Member

@damiano9669 Apologies for the delay in response. So I think this is an interesting idea, but I do not have a lot of intuition on how useful this is to the community at large. Without an academic paper describing the results and uses it's difficult to asses.

I would propose we leave this issue open and if community interests builds we could accept a PR for this. Alternatively if you proposed (and then included) a nice tutorial that shows its use and how it accomplishes something improved or novel then it would be a potential addition IMO.

@seanpmorgan
Copy link
Member

TensorFlow Addons is transitioning to a minimal maintenance and release mode. New features will not be added to this repository. For more information, please see our public messaging on this decision:
TensorFlow Addons Wind Down

Please consider sending feature requests / contributions to other repositories in the TF community with a similar charters to TFA:
Keras
Keras-CV
Keras-NLP

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants