Infrared Effects of Ultraviolet Operators on Dark Matter Freeze-In