![]() |
Deepity
Ultra-fast, SIMD-accelerated Predictive Coding
|
Files | |
| ActivationDispatch.h | |
| Function-pointer types and ActivationType <-> function dispatch tables shared by every activation family. Forward-declares the concrete activation functions (defined in the sibling Relu.h/Gelu.h/Tanh.h/ Sigmoid.h/Linear.h) so the dispatchers below can take their addresses without depending on inclusion order. | |
| ActivationMacros.h | |
| The RESTRICT portability macro shared by every activation header. Split out so each per-activation header is includable on its own, without relying on include order through the Activations.h umbrella. | |
| Gelu.h | |
| GELU (tanh approximation) and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail. | |
| Linear.h | |
| The identity activation and its (constant) derivative. | |
| Relu.h | |
| ReLU and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail. | |
| Sigmoid.h | |
| Logistic sigmoid and Elliot ("fast") sigmoid, and their derivatives (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail. | |
| Tanh.h | |
| tanh and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail. | |
| VectorMath.h | |
| SIMD-vectorized exp/log helpers (AVX512/AVX2/SSE with a scalar tail). Currently unused by the rest of the codebase – kept for planned future use (e.g. a vectorized softmax path) rather than deleted. | |