Factorization and resummation: A new paradigm to improve gravitational wave amplitudes. II. the higher multipolar modes