You forget how Bruce banner was constantly on the run and being hunted by general Ross and blonsky in the 2008 hulk film and that's MCU phase 1. Then in the avengers when black widow picked him up he was still in the run. Up untill age of Ultron they kept the core essence of the Bruce / hulk dynamic. As for hulk recipe ing no reprivals for destroying a south African city he too a quinjet and went to space before. Anybody could do anything. Also the outcry form the south African incident wouldn't have done anything to serve the story so there's that.
Now take Bruce's life of constantly being hunted, being on the run, trying to keep the hulk under control manage his anger. Not being able to have a normal life or be near the woman he loves to Jennifer's " o woe is me th construction workers are catcalling me, I hate it when my coworkers are mansplaining to me blah blah blah, etc feminazi bullshit and tell me who has it rougher out of the two.