Enh, everyone always goes back. The Avengers are like Clive Davis. Sure, he's a dick, but he's a dick that makes you a star.

There's no hard feelings. Not against you, anyway. You're not the one who has to constantly build metaphoric symbols of your epeen all over Manhattan. That's all the Avengers are.