True and false symmetries in the classification of optical scatterers