Matrix Inverse and Orthogonality