"On what basis can a person possibly declare polygamy wrong or illegal and not homosexuality?"

Easy. Polygamy is a patriarchal concept that generally propogates the subjugation of women to customs they have not defined. It limits their freedom. As for gay marriage (Homosexuality is no more "wrong" than being left-handed. It's a naturally occuring biological difference), it involves no subjugation and represents an expansion of freedom.