Richard Spencer says that antifa sucked all the fun out of college appearances, calls it quits