Deepity
Ultra-fast, SIMD-accelerated Predictive Coding
Loading...
Searching...
No Matches
activations Directory Reference

Files

 
ActivationDispatch.h
 Function-pointer types and ActivationType <-> function dispatch tables shared by every activation family. Forward-declares the concrete activation functions (defined in the sibling Relu.h/Gelu.h/Tanh.h/ Sigmoid.h/Linear.h) so the dispatchers below can take their addresses without depending on inclusion order.
 
ActivationMacros.h
 The RESTRICT portability macro shared by every activation header. Split out so each per-activation header is includable on its own, without relying on include order through the Activations.h umbrella.
 
Gelu.h
 GELU (tanh approximation) and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail.
 
Linear.h
 The identity activation and its (constant) derivative.
 
Relu.h
 ReLU and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail.
 
Sigmoid.h
 Logistic sigmoid and Elliot ("fast") sigmoid, and their derivatives (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail.
 
Tanh.h
 tanh and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail.
 
VectorMath.h
 SIMD-vectorized exp/log helpers (AVX512/AVX2/SSE with a scalar tail). Currently unused by the rest of the codebase – kept for planned future use (e.g. a vectorized softmax path) rather than deleted.