Question 42
A four-dimensional input vector x = [1,−2, 3,−4] is passed to a hidden layer with a single neuron and an activation function a(.) to obtain z. Assume that the corresponding weights (from input to hidden layer) are [0.5,−0.3, 0.8, 1.2] and bias is −0.2. If the activation function a(.) is Sigmoid, Linear, Indicator function, Softplus, ReLU and Leaky- ReLU, what are the corresponding values of z? (Note that Indicator function returns 1 for a positive input, and 0 otherwise. Softplus is defined as: ln(1 + exp(z))).
Based on the above data, answer the given subquestions.
Sigmoid ____________