Deepity
Ultra-fast, SIMD-accelerated Predictive Coding
Loading...
Searching...
No Matches
Activations.h
Go to the documentation of this file.
1#pragma once
2
27
28#include <deepity/utils/activations/ActivationDispatch.h>
29#include <deepity/utils/activations/VectorMath.h>
30#include <deepity/utils/activations/Relu.h>
31#include <deepity/utils/activations/Gelu.h>
32#include <deepity/utils/activations/Tanh.h>
33#include <deepity/utils/activations/Sigmoid.h>
34#include <deepity/utils/activations/Linear.h>
ActivationDispatch.h
Function-pointer types and ActivationType <-> function dispatch tables shared by every activation fam...
Gelu.h
GELU (tanh approximation) and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE pa...
Linear.h
The identity activation and its (constant) derivative.
Relu.h
ReLU and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail...
Sigmoid.h
Logistic sigmoid and Elliot ("fast") sigmoid, and their derivatives (plain and two-buffer variants),...
Tanh.h
tanh and its derivative (plain and two-buffer variants), with AVX512/AVX2/SSE paths and a scalar tail...
VectorMath.h
SIMD-vectorized exp/log helpers (AVX512/AVX2/SSE with a scalar tail). Currently unused by the rest of...