Quantum diffusion beyond slow-roll: implications for primordial black-hole production