The architecture of neural networks

neural network have three layers , input layer , output layer and ’not an input or output layer'

again, we have an network

the leftmost layer is input neurons the rightmost is outputneurons The middle layer is called a hidden layer t really means nothing more than “not an input or an output”.

input and output often strightforword, while there is often an art to the design of the hidden layers.

There are some design heuristics for the hidden layers. we are not included here

until now, the output from one layer is used as input to the next layer is called feedforward network  information is always fed forward, no loop acceptable

recurrent neural networks allow such loop, They’re much closer in spirit to how our brains work than feedforward networks.

simpleclassifynet