Backsubstitution as matrix multiplication. The left ma-trix M k in Fig. 2 encodes bounds for ` -th layer neurons with polyhedral expressions defined over the neurons in layer 1 ≤ k < ` . The center matrix F k encodes con-straints for k -th layer neurons defined over the neurons in layer k − 1 . We focus on the computation of the entry ( h 2 , j... See more

The Fisher information matrix is simply the Hessian of KL divergence at the point where two distributions are equal.