Three-point functions in duality-invariant higher-derivative gravity