Would you appear at a function of an anti-Maori or anti-Chinese hate group? No? Then why the fuck are you sitting down with Destiny Church?
Destiny Church is a virulently homophobic organisation. Homophobia is morally no different from racism. And like racism, it doesn't suddenly become acceptable if shrouded in religion.
By sitting down with bigots, you are tacitly endorsing their bigotry. If that's not a message you want to send, then you need to start apologising right now. Otherwise, you have only yourselves to blame if voters conclude that you too are a bigot.
Lie down with dogs, get up with fleas.