Gigaba said the LGBTI community faces daily atrocities for defining their identity.
Anderson has been accused of making repeated anti-gay comments.
He was planning to visit the country for what he calls "an evangelical crusade".
Home Affairs says Anderson won't be allowed to enter South Africa in terms of the Immigration Act.