Layer
float(type==0.)*sin(x)+float(type==1.)*max(0.,x) + float(type==2.)*(1./(1.+exp(-x))) + float(type==3.)*step(0.5,x) + float(type==4.)*(-cos(x)+1.)/2. + float(type==5.)*clamp(0.,1.,x) + float(type==6.)*x*x + float(type==7.)*sqrt(max(0.,x))+float(type==8.)*sin(x*pi/2.)
sin(x)
ReLU (max(0,x))
Sigmoid (1/(1+exp(-x)))
Step
Identity/Linear
Clamp (clamp(0.,1.,x))
Quadratic
Sqare root
Sine with period 1 (sin(x*pi/2))
(-cos(x)+1.)/2.
Activation Function:
float(type==0.)*sin(x)+float(type==1.)*max(0.,x) + float(type==2.)*(1./(1.+exp(-x))) + float(type==3.)*step(0.5,x) + float(type==4.)*(-cos(x)+1.)/2. + float(type==5.)*clamp(0.,1.,x) + float(type==6.)*x*x + float(type==7.)*sqrt(max(0.,x))+float(type==8.)*sin(x*pi/2.)
sin(x)
ReLU (max(0,x))
Sigmoid (1/(1+exp(-x)))
Step
Identity/Linear
Clamp (clamp(0.,1.,x))
Quadratic
Sqare root
Sine with period 1 (sin(x*pi/2))
(-cos(x)+1.)/2.
Toggle table
Hej!