Neural Network Fundamentals and Regularization Techniques
Posted by Anonymous and classified in Mathematics
Written on in
English with a size of 205.18 KB
Chapter 1 -
Linearity: As long as the values that vary (assuming any other values R
constant) R not themselves involved in anything more than
○addition&
○scalar multiplication
Chapter 2 -
Shallow network
y = f[x, ϕ]
y = ϕ₀ + ϕ₁ a[θ₁₀ + θ₁₁x] + ϕ₂ a[θ₂₀ + θ₂₁x] + ϕ₃ a[θ₃₀ + θ₃₁x]
y = ϕ₀ + ϕ₁h₁ + ϕ₂h₂ + ϕ₃h₃
neural network can describe any continuous function on a
compact subset ofto arbitrary precision
Terminology - The hidden units themselves are sometimes referred to as neurons. Rhe values of the inputs to the hidden layer (i.E., before the ReLU functions are applied) are termed pre-activations. The values at... Continue reading "Neural Network Fundamentals and Regularization Techniques" »
