Polynomial control on stability, inversion and powers of matrices on simple graphs